-- Logs begin at Wed 2022-07-27 17:22:30 UTC, end at Wed 2022-07-27 19:01:09 UTC. -- Jul 27 18:23:45.224552 dv-cinder-799871-43-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 27 18:23:45.231969 dv-cinder-799871-43-smb devstack@keystone.service[80414]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 27 18:23:45.233971 dv-cinder-799871-43-smb devstack@keystone.service[80414]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 18:23:45 2022] *** Jul 27 18:23:45.233971 dv-cinder-799871-43-smb devstack@keystone.service[80414]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 18:23:45.233971 dv-cinder-799871-43-smb devstack@keystone.service[80414]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 18:23:45.233971 dv-cinder-799871-43-smb devstack@keystone.service[80414]: nodename: dv-cinder-799871-43-smb Jul 27 18:23:45.233971 dv-cinder-799871-43-smb devstack@keystone.service[80414]: machine: x86_64 Jul 27 18:23:45.233971 dv-cinder-799871-43-smb devstack@keystone.service[80414]: clock source: unix Jul 27 18:23:45.233971 dv-cinder-799871-43-smb devstack@keystone.service[80414]: pcre jit disabled Jul 27 18:23:45.234445 dv-cinder-799871-43-smb devstack@keystone.service[80414]: detected number of CPU cores: 4 Jul 27 18:23:45.234445 dv-cinder-799871-43-smb devstack@keystone.service[80414]: current working directory: / Jul 27 18:23:45.234445 dv-cinder-799871-43-smb devstack@keystone.service[80414]: detected binary path: /usr/bin/uwsgi-core Jul 27 18:23:45.234445 dv-cinder-799871-43-smb devstack@keystone.service[80414]: your processes number limit is 47680 Jul 27 18:23:45.234445 dv-cinder-799871-43-smb devstack@keystone.service[80414]: your memory page size is 4096 bytes Jul 27 18:23:45.234445 dv-cinder-799871-43-smb devstack@keystone.service[80414]: detected max file descriptor number: 2048 Jul 27 18:23:45.234445 dv-cinder-799871-43-smb devstack@keystone.service[80414]: lock engine: pthread robust mutexes Jul 27 18:23:45.234445 dv-cinder-799871-43-smb devstack@keystone.service[80414]: thunder lock: enabled Jul 27 18:23:45.234445 dv-cinder-799871-43-smb devstack@keystone.service[80414]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 27 18:23:45.234445 dv-cinder-799871-43-smb devstack@keystone.service[80414]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 18:23:45.276933 dv-cinder-799871-43-smb devstack@keystone.service[80414]: Python main interpreter initialized at 0x5653fa7ce9c0 Jul 27 18:23:45.276933 dv-cinder-799871-43-smb devstack@keystone.service[80414]: python threads support enabled Jul 27 18:23:45.276933 dv-cinder-799871-43-smb devstack@keystone.service[80414]: your server socket listen backlog is limited to 100 connections Jul 27 18:23:45.276933 dv-cinder-799871-43-smb devstack@keystone.service[80414]: your mercy for graceful operations on workers is 90 seconds Jul 27 18:23:45.277333 dv-cinder-799871-43-smb devstack@keystone.service[80414]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 18:23:45.277471 dv-cinder-799871-43-smb devstack@keystone.service[80414]: *** Operational MODE: preforking *** Jul 27 18:23:45.277821 dv-cinder-799871-43-smb devstack@keystone.service[80414]: *** uWSGI is running in multiple interpreter mode *** Jul 27 18:23:45.277821 dv-cinder-799871-43-smb devstack@keystone.service[80414]: spawned uWSGI master process (pid: 80414) Jul 27 18:23:45.278035 dv-cinder-799871-43-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 27 18:23:45.279306 dv-cinder-799871-43-smb devstack@keystone.service[80414]: spawned uWSGI worker 1 (pid: 80428, cores: 1) Jul 27 18:23:45.279306 dv-cinder-799871-43-smb devstack@keystone.service[80414]: spawned uWSGI worker 2 (pid: 80429, cores: 1) Jul 27 18:23:45.279306 dv-cinder-799871-43-smb devstack@keystone.service[80414]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 18:23:50.884961 dv-cinder-799871-43-smb devstack@keystone.service[80429]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 18:23:50.884961 dv-cinder-799871-43-smb devstack@keystone.service[80429]: from cryptography.utils import int_from_bytes Jul 27 18:23:50.885769 dv-cinder-799871-43-smb devstack@keystone.service[80429]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 18:23:50.885769 dv-cinder-799871-43-smb devstack@keystone.service[80429]: from cryptography.utils import int_from_bytes Jul 27 18:23:50.885907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 18:23:50.885907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: from cryptography.utils import int_from_bytes Jul 27 18:23:50.885907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 18:23:50.885907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: from cryptography.utils import int_from_bytes Jul 27 18:23:50.936618 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 18:23:50.936801 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 18:23:50.936913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 18:23:50.937070 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] command line args: [] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 18:23:50.937165 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 18:23:50.937250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 18:23:50.937331 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] command line args: [] {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 18:23:50.937409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ================================================================================ {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 18:23:50.937546 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 18:23:50.937642 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] admin_token = **** {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.937755 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ================================================================================ {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 18:23:50.937891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] config_dir = [] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.938033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] admin_token = **** {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.938120 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.938252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] config_source = [] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.938337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] config_dir = [] {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.938437 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] debug = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.938527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.938603 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] config_source = [] {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.938672 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.938887 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] debug = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.938961 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.939043 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.939184 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.939295 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.939378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.939441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.939637 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.939753 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.939882 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.940004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] list_limit = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.940109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] log_config_append = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.940224 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] list_limit = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.940322 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.940418 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] log_config_append = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.940518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] log_dir = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.940622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.940719 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] log_file = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.940819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] log_dir = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.940819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] log_file = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.941025 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.941108 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.941240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.941324 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.941403 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.941527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.941605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.941726 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.941814 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.941897 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.941976 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.942102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.942185 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.942268 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.942394 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.942472 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.942596 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.942695 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.942790 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.942937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.943085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.943190 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.943433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.943551 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.943761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.944026 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.944137 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.944241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.944344 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.944449 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.944754 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.944924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.945027 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] publish_errors = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.945158 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] publish_errors = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.945243 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.945367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.945444 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.945568 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.945651 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.945735 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.945808 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.945900 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.946018 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.946108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.946210 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] standard_threads = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.946289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] standard_threads = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.946442 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.946563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.946688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.946779 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.946860 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.946936 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.947054 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] use_journal = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.947136 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] use_journal = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.947209 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] use_json = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.947438 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] use_json = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.947520 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] use_stderr = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.947639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] use_syslog = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.947714 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] use_stderr = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.947829 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.947960 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] use_syslog = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.948049 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.948251 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.948341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:23:50.948514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.948762 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.948855 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.949134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.949219 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.949293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.949487 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.949600 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.949729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.949981 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.950067 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.950232 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.950390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.950475 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.950717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.950808 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.950970 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.951147 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.951225 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.951480 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.951567 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.951734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.951931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.952011 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.952220 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.952305 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.952478 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.952689 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.952776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.952958 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.953041 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.953217 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.953421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.953510 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.953732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.953811 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.953986 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.954156 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.954235 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.954445 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.954526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.954681 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.954892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.954979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.955163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.955312 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.955440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.955676 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.955761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.955914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.956083 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.956178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.956403 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.956488 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.956646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.956844 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.956931 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.957122 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.957259 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.957367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.957598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.957693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.957829 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.958023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.958105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.958286 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.958366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.959029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.959253 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.959361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.959554 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.959633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.959776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.960811 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.960917 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.960917 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.961033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.961140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.961140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.961285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.961357 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.961419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.961478 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.961478 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.961584 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.961644 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.961832 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.961912 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.962081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.962171 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.962325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.962538 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.962645 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.962803 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.962955 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.963120 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.963293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.963438 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.963564 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.963714 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.963870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.963996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.964120 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.964267 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.964394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.964482 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.964684 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.964818 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.964959 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.965048 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.965203 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.965380 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.965464 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.965697 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.965779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.965942 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.966117 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.966523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.966523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.966671 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.966745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.966817 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.966947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.967173 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.967254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.967458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.967579 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.967706 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.967946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.968039 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.968191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.968330 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.968457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.968662 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.968750 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.968933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.969044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.969170 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.969414 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.969502 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.969654 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.969811 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.969888 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.970133 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.970212 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.970398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.970494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.970614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.970839 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.970921 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.971075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.971206 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.971354 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.971565 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.971714 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.971843 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.971969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.972093 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.972266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.972389 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.972543 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.972678 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.972808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.972996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.973120 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.973248 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.973385 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.973520 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.973723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] auth.external = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.973851 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.973976 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.974100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.974811 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.975052 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.975180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.975368 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] auth.password = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.975500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.975628 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] auth.token = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.975761 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.975888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.976024 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.976200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.976335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.976462 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.976594 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.976720 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.976929 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.977060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.977189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.977315 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.977448 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] credential.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.977633 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.977704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.977892 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.977963 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.978148 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.978233 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.978402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.978478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.978638 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.978751 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.978878 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.978956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.979158 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.979228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.979531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.979729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.979866 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.980003 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.980131 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.980255 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.980409 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.980542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.980671 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.980805 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.980931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.981066 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.981194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.981324 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.981455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.981582 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.981717 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.981854 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] federation.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.981938 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.982061 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.982177 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.982302 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.982428 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.982563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.982690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.982815 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.982941 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.983066 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.983149 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.983304 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.983431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.983559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.983684 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.983811 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.983938 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.984076 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.984076 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.984339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.984467 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.984594 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.984727 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.984861 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.984990 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.985139 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.985269 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.985397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] auth.external = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.985521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.985721 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.985848 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.986057 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.986149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.986273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.986439 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.986531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] auth.password = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.986693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.986820 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] auth.token = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.986957 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.987085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.987212 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.987375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.987500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.987624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.987752 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.987875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.988007 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.988131 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.988255 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.988255 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.988490 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.988614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.988753 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.988878 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.988878 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.989112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] credential.caching = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.989241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.989367 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.989504 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.989504 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.989743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.989868 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.990000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.990083 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.990804 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.990937 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.990937 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.991173 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.991364 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.991491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.991632 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.991632 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.991878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.992004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.992127 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.992211 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.992211 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.992417 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.992493 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.992572 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.992647 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.992836 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.992925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.993075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.993294 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.993376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.993543 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.993693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.993783 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.994026 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.994106 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.994277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.994488 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.994569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.994778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.994891 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] federation.caching = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.995034 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.995184 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.995305 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.995458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.995552 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.995710 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.995792 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.995943 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.996024 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.996191 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.996289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.996430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.996512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.996686 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.996773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.996938 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.997028 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.997175 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.997256 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.997420 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.997502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.997684 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.997774 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.997901 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] identity.caching = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.997980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.998153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.998234 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.998401 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.998495 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.998637 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.998720 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.998878 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.998958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.999114 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.999315 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.999455 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.999665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.999746 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:50.999929 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.000027 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.000167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.000398 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.000482 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.000659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.000781 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.000911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.001138 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.001305 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.001494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.001573 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.001786 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.001874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.002040 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.002233 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.002323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.002515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.002598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.002759 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.002939 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.003019 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.003238 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.003373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.003515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.003968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.004057 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.004261 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.004376 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.004496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.004742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.004830 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.004982 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.005103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.005222 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.006023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.006166 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.006304 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.006441 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.006558 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.006817 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.006902 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.007064 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.007159 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.007334 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] resource.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.007421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.007594 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.007676 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.007887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.007999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.008080 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.008155 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.008339 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.008423 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.008583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.008674 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.008825 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.008907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.009077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.009157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.009320 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.009412 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.009564 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.009645 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.009802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] role.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.009882 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.010030 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.010120 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] role.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.010269 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.010352 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.010506 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.010588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.010747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.010842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.011038 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.011134 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.011277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.011487 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.011571 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.011775 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.011859 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.012028 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.012276 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.012374 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.012509 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.012675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.012754 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.012915 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.012997 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.013240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.013320 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.013494 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.013653 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.013950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.014032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.014195 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.014357 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.014441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.014694 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.014775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.014949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.015053 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.user = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.015205 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.015473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.015568 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.015729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.015870 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.016027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.016219 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.016351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.016457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.016591 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.016694 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.016977 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.017083 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.017293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.017370 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.017445 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.017674 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.017756 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.017916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.018116 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.018199 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.018381 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.018462 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.018623 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] token.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.018715 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.018867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.018949 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.019097 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.019179 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.019368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.019469 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.019617 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.019700 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.019864 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.019946 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.020106 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.020289 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.020395 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.020539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.020621 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.020770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.020851 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.021033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.021119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.021286 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.021523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.021603 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.021758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.021848 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.021994 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.022075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.022260 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.022365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.022559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.022742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.022826 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.023040 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.023120 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.023341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.connection = **** {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.023511 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.023625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.023842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.023949 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.024079 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.024212 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.024345 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.024557 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.024700 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.024832 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.024965 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.025095 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.025258 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.025393 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.025541 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.025627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.025736 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.025979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.026060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.026218 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.026331 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.026472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.026692 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.026773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.026950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.027065 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] resource.caching = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.027186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.027457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.027541 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.027701 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.027831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.027912 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 18:23:51.028207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.028616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.029038 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.029435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.029802 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.030148 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.030505 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.030822 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] role.caching = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.031072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] role.driver = sql {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.031324 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.031579 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.031829 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.032079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.032326 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.032575 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.032821 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.033066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.033313 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.033547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.033793 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.034039 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.034286 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.034532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.034972 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.035211 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.035487 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.035736 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.035983 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.036232 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.036467 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.036758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.037013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.037252 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.037483 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.037714 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.037944 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.038194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.038448 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.038696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.038931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.039165 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.039417 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.039652 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] token.caching = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.039889 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.040134 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.040369 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.040625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.040873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.041111 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.041354 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.041596 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.041842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.042077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.042314 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.042547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.042790 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.043033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.043278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.043519 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.043810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.044070 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] database.connection = **** {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.044315 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.044560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.044795 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.045037 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.045274 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.045509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.045744 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.045980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.046222 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.046457 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.046704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.046936 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.047182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.047437 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.047683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.047912 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.048152 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.048390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:23:51.048558 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 18:23:51.057622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.057861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.058090 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.066554 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.073859 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.074092 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.074319 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.082683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.097070 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.097303 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.102536 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.102760 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.150956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.151447 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.202397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.202582 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.202657 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.202732 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.267766 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.267996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.268131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.268224 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.268371 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.268458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.268601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.268700 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.268827 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.268915 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.269051 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.269275 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.292752 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.292985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.293218 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.293446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.293608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.293724 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.293868 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.293951 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.294083 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.294251 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.294569 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.294882 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.295188 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.295526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.306014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.311879 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.319519 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.319759 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.319989 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.320214 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.320430 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.320647 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.320863 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.328024 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.328253 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.328483 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.328707 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.328930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.329146 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.329362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:23:51.338689 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.338905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 18:23:51.339254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.339482 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 18:23:51.339757 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.340019 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.340277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.340534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.340619 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.340827 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 18:23:51.341163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.341361 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 18:23:51.341630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.341892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.342148 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.342402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.350965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.351249 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.351544 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.351825 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.352674 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.352945 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.353210 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.353488 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.358735 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.360446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.363578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.363861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.364148 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.364428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.364707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.365611 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.365890 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.366037 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.366161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.366352 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.366522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.366658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.366760 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.366908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.367109 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.367228 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.367332 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.367554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.367824 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.368095 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.368368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.368631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.390892 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.391753 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.392419 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.392698 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.393251 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.393526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.397487 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.397776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.398059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.398225 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.398501 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.398778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.404760 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.404986 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.405425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.405709 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.409151 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.409440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.409727 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.410011 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.410104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.410303 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.410400 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.410587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.410695 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.410860 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.410955 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.411140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.411237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.411459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.412270 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.412726 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.428324 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.428606 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.429141 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.429417 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.432565 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.433364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.435721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.436020 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.436452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.436736 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.440423 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.441097 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.443624 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.444371 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.446803 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.447100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.447419 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.447566 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.447711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.447861 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.448006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.448141 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.448310 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.448430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.448686 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.448967 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.464234 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.464519 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.464789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.464925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.465056 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.465203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.465466 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.465722 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.471952 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.472534 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.473497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.473779 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.474069 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.474987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.477144 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.477427 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.477668 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.477769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.477945 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.478039 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.478230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.478313 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.478515 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.478811 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.489655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.490528 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.490626 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.490814 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.490900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.491097 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.491181 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.491402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.491488 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.491683 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.491770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.491962 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.492046 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.492231 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.507775 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.507990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.510736 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.510905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.514709 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.514913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.516399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.517306 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.517882 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.518164 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.518467 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.518822 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.519109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.519422 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.525226 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.526010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.526689 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.527639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.529603 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.529887 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.530165 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.530441 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.530561 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.530855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.531141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.531451 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.539085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.539391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.539669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.540042 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.540334 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.540618 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.548641 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.548641 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.548641 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.548641 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.548921 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:23:51.548992 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.549056 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.549119 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.549182 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.549244 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.549321 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.549387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.549450 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.549513 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.549574 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.549644 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.549709 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.549773 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.549773 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.549885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.549955 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.550021 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.550091 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.550156 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.550768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.550768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.550982 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.551412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:23:51.583981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5653fa7ce9c0 pid: 80429 (default app) Jul 27 18:23:51.585015 dv-cinder-799871-43-smb devstack@keystone.service[80428]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5653fa7ce9c0 pid: 80428 (default app) Jul 27 18:23:51.587763 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2c3f7-a71f-4780-9469-01b20fc04716 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:23:51.588051 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2c3f7-a71f-4780-9469-01b20fc04716 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:23:51.588327 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2c3f7-a71f-4780-9469-01b20fc04716 None None] PATH_INFO: `/v3` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:23:51.592574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 791 bytes} [Wed Jul 27 18:23:51 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:00.557947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41d286-cd00-458b-8dca-d99d225ce090 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:00.564213 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41d286-cd00-458b-8dca-d99d225ce090 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:00.564213 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41d286-cd00-458b-8dca-d99d225ce090 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:00.564213 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1/2] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:00.568600 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c63bda-f333-4894-9f4f-0ed0a48fe211 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:00.569066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c63bda-f333-4894-9f4f-0ed0a48fe211 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:00.569159 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c63bda-f333-4894-9f4f-0ed0a48fe211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:00.639391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: INFO dbcounter [None req-91c63bda-f333-4894-9f4f-0ed0a48fe211 None None] Registered counter for database keystone Jul 27 18:24:00.660775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG oslo_db.sqlalchemy.engines [None req-91c63bda-f333-4894-9f4f-0ed0a48fe211 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80429) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 18:24:00.667422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writer thread running {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 18:24:00.851556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG passlib.handlers.bcrypt [None req-91c63bda-f333-4894-9f4f-0ed0a48fe211 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80429) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 18:24:00.851930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG passlib.handlers.bcrypt [None req-91c63bda-f333-4894-9f4f-0ed0a48fe211 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80429) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 18:24:00.906750 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-91c63bda-f333-4894-9f4f-0ed0a48fe211 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:00.908425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-91c63bda-f333-4894-9f4f-0ed0a48fe211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:01.035905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 27 18:24:01.185851 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41d286-cd00-458b-8dca-d99d225ce090 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:01.255768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: INFO dbcounter [None req-4d41d286-cd00-458b-8dca-d99d225ce090 None None] Registered counter for database keystone Jul 27 18:24:01.274998 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG oslo_db.sqlalchemy.engines [None req-4d41d286-cd00-458b-8dca-d99d225ce090 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80428) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 18:24:01.281279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writer thread running {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 18:24:01.400387 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41d286-cd00-458b-8dca-d99d225ce090 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:01.404868 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd803f-f9ac-4696-af0d-959630c21ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:01.405525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd803f-f9ac-4696-af0d-959630c21ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:01.405810 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd803f-f9ac-4696-af0d-959630c21ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:01.406090 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd803f-f9ac-4696-af0d-959630c21ab7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:01.415450 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd803f-f9ac-4696-af0d-959630c21ab7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:01.467445 dv-cinder-799871-43-smb devstack@keystone.service[80428]: WARNING keystone.common.rbac_enforcer.enforcer [None req-89cd803f-f9ac-4696-af0d-959630c21ab7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 18:24:01.467714 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd803f-f9ac-4696-af0d-959630c21ab7 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:01.478533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 2/4] 10.222.0.65 () {58 vars in 1324 bytes} [Wed Jul 27 18:24:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:24:01.484658 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c63bda-f333-4894-9f4f-0ed0a48fe211 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:01.499704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c63bda-f333-4894-9f4f-0ed0a48fe211 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:01.504406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dc725-3e08-46dc-a975-7f5cf73a2c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:01.506083 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc725-3e08-46dc-a975-7f5cf73a2c3f admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:01.506365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc725-3e08-46dc-a975-7f5cf73a2c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:01.506643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc725-3e08-46dc-a975-7f5cf73a2c3f admin admin] PATH_INFO: `/v3/projects/940bf108a6364eafb1a69efe7e124464` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:01.508159 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dc725-3e08-46dc-a975-7f5cf73a2c3f admin admin] RBAC: Authorizing `identity:get_project(project_id=940bf108a6364eafb1a69efe7e124464)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:01.558069 dv-cinder-799871-43-smb devstack@keystone.service[80429]: WARNING keystone.common.rbac_enforcer.enforcer [None req-230dc725-3e08-46dc-a975-7f5cf73a2c3f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 18:24:01.560883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dc725-3e08-46dc-a975-7f5cf73a2c3f admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:01.563167 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 3/5] 10.222.0.65 () {56 vars in 1207 bytes} [Wed Jul 27 18:24:01 2022] GET /identity/v3/projects/940bf108a6364eafb1a69efe7e124464 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:03.560862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a37c0-6dd3-4b9e-a9d3-00afbafa0693 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:03.561356 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a37c0-6dd3-4b9e-a9d3-00afbafa0693 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:03.561451 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a37c0-6dd3-4b9e-a9d3-00afbafa0693 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:03.565572 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 3/6] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:03.571712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46335d1c-e331-4610-ba8a-ac6f19b6b78c None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:03.572120 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46335d1c-e331-4610-ba8a-ac6f19b6b78c None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:03.572261 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46335d1c-e331-4610-ba8a-ac6f19b6b78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:03.593219 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-46335d1c-e331-4610-ba8a-ac6f19b6b78c None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:03.594769 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-46335d1c-e331-4610-ba8a-ac6f19b6b78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:03.603154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 4/7] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 27 18:24:03.626083 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a37c0-6dd3-4b9e-a9d3-00afbafa0693 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:03.639198 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a37c0-6dd3-4b9e-a9d3-00afbafa0693 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:03.643447 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f3a2e-437b-4c39-bf29-e6d8adbdde26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:03.644053 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f3a2e-437b-4c39-bf29-e6d8adbdde26 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:03.644334 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f3a2e-437b-4c39-bf29-e6d8adbdde26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:03.644606 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f3a2e-437b-4c39-bf29-e6d8adbdde26 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:03.653205 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f3a2e-437b-4c39-bf29-e6d8adbdde26 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:03.654994 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f3a2e-437b-4c39-bf29-e6d8adbdde26 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:03.664121 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1324 bytes} [Wed Jul 27 18:24:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:24:03.669713 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46335d1c-e331-4610-ba8a-ac6f19b6b78c None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:03.679051 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46335d1c-e331-4610-ba8a-ac6f19b6b78c None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:03.683498 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b11f17-a914-4c69-bdd6-2f969ee37dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:03.684143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b11f17-a914-4c69-bdd6-2f969ee37dda admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:03.684433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b11f17-a914-4c69-bdd6-2f969ee37dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:03.684715 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b11f17-a914-4c69-bdd6-2f969ee37dda admin admin] PATH_INFO: `/v3/users/0dc5c37ef1d94f0cacb3f037f735dea7` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:03.686096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b11f17-a914-4c69-bdd6-2f969ee37dda admin admin] RBAC: Authorizing `identity:get_user(user_id=0dc5c37ef1d94f0cacb3f037f735dea7)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:03.688012 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b11f17-a914-4c69-bdd6-2f969ee37dda admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:03.689596 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 5/9] 10.222.0.65 () {56 vars in 1198 bytes} [Wed Jul 27 18:24:03 2022] GET /identity/v3/users/0dc5c37ef1d94f0cacb3f037f735dea7 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:05.788423 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af335190-c98a-49d0-9f9c-d3fc193d7f02 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:05.788975 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af335190-c98a-49d0-9f9c-d3fc193d7f02 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:05.788975 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af335190-c98a-49d0-9f9c-d3fc193d7f02 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:05.790329 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 5/10] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:24:05.795731 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5669a-87f7-44fe-8dfc-212223cde838 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:05.796165 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5669a-87f7-44fe-8dfc-212223cde838 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:05.796434 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5669a-87f7-44fe-8dfc-212223cde838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:05.816493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-20b5669a-87f7-44fe-8dfc-212223cde838 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:05.817700 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2f0d6-03ff-4297-ad8e-55ca77f6b7f0 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:05.817838 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-20b5669a-87f7-44fe-8dfc-212223cde838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:05.818042 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2f0d6-03ff-4297-ad8e-55ca77f6b7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:05.818352 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2f0d6-03ff-4297-ad8e-55ca77f6b7f0 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:05.820027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 6/11] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:24:05.825594 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820551ae-b14b-44c6-8fe1-0d370e279b52 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:05.825968 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820551ae-b14b-44c6-8fe1-0d370e279b52 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:05.826156 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820551ae-b14b-44c6-8fe1-0d370e279b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:05.869324 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG passlib.handlers.bcrypt [None req-820551ae-b14b-44c6-8fe1-0d370e279b52 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80428) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 18:24:05.869752 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG passlib.handlers.bcrypt [None req-820551ae-b14b-44c6-8fe1-0d370e279b52 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80428) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 18:24:05.902251 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 6/12] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:05.915565 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-820551ae-b14b-44c6-8fe1-0d370e279b52 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:05.917195 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-820551ae-b14b-44c6-8fe1-0d370e279b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:05.925910 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5669a-87f7-44fe-8dfc-212223cde838 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:05.951218 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:06.019829 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 7/13] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:24:06.034893 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5669a-87f7-44fe-8dfc-212223cde838 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:06.042342 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820551ae-b14b-44c6-8fe1-0d370e279b52 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:06.070808 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bbae5-5c83-43cc-9a58-8701fe683481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:06.071423 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bbae5-5c83-43cc-9a58-8701fe683481 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:06.071712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bbae5-5c83-43cc-9a58-8701fe683481 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:06.071992 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bbae5-5c83-43cc-9a58-8701fe683481 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:06.084422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bbae5-5c83-43cc-9a58-8701fe683481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:06.093278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-9f3bbae5-5c83-43cc-9a58-8701fe683481 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:24:06.093278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:06.093278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:06.093278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:06.093278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:06.093278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:06.093278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:06.093278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:06.093278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:06.093278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:06.093278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:06.093278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:06.093278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:06.093278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:06.093278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:06.093278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:06.094431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:06.094431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:06.094431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:06.094431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:06.094431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:06.094431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:06.094431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:06.094431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:06.094431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:06.094431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:06.094431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:06.094431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:06.094431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:06.094431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:06.094431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:06.094431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:06.095512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:06.095512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:06.095512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:06.095512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:06.095512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:06.095512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:06.095512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:06.095512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:06.095512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:06.095512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:06.095512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:24:06.095512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:24:06.095512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 7/14] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:24:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:24:06.100576 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bbae5-5c83-43cc-9a58-8701fe683481 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:06.146487 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820551ae-b14b-44c6-8fe1-0d370e279b52 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:06.149143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:06.186142 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121f1a5-b9a9-47a8-97b6-89fb7856bf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:06.187013 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121f1a5-b9a9-47a8-97b6-89fb7856bf5d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:06.187330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121f1a5-b9a9-47a8-97b6-89fb7856bf5d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:06.187619 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121f1a5-b9a9-47a8-97b6-89fb7856bf5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:06.187789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:06.205975 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bbae5-5c83-43cc-9a58-8701fe683481 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:06.240712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da1f8b-952b-42ce-b820-2bc49dc177f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:06.241339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da1f8b-952b-42ce-b820-2bc49dc177f4 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:06.241625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da1f8b-952b-42ce-b820-2bc49dc177f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:06.241904 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da1f8b-952b-42ce-b820-2bc49dc177f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:06.242634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da1f8b-952b-42ce-b820-2bc49dc177f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:06.242944 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da1f8b-952b-42ce-b820-2bc49dc177f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:06.244407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da1f8b-952b-42ce-b820-2bc49dc177f4 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:06.258506 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 8/15] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:06.261113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121f1a5-b9a9-47a8-97b6-89fb7856bf5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:06.262642 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121f1a5-b9a9-47a8-97b6-89fb7856bf5d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:06.264199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da1f8b-952b-42ce-b820-2bc49dc177f4 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:06.367357 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 8/16] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 18:24:06.373242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121f1a5-b9a9-47a8-97b6-89fb7856bf5d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:06.376505 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:06.478755 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da1f8b-952b-42ce-b820-2bc49dc177f4 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:06.479404 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121f1a5-b9a9-47a8-97b6-89fb7856bf5d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:06.515770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dbab9-e8c5-4248-a615-e9f96b0faa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:06.516424 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dbab9-e8c5-4248-a615-e9f96b0faa96 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:06.516708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dbab9-e8c5-4248-a615-e9f96b0faa96 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:06.516992 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dbab9-e8c5-4248-a615-e9f96b0faa96 None admin] PATH_INFO: `/v3/users/0dc5c37ef1d94f0cacb3f037f735dea7` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:06.518155 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724dbab9-e8c5-4248-a615-e9f96b0faa96 None admin] RBAC: Authorizing `identity:get_user(user_id=0dc5c37ef1d94f0cacb3f037f735dea7)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:06.518750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef8334-b71a-49e6-ad09-021c9af4389d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:06.519660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724dbab9-e8c5-4248-a615-e9f96b0faa96 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:06.520027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef8334-b71a-49e6-ad09-021c9af4389d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:06.520481 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef8334-b71a-49e6-ad09-021c9af4389d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:06.520887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef8334-b71a-49e6-ad09-021c9af4389d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:06.521397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 9/17] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:06 2022] GET /identity/v3/users/0dc5c37ef1d94f0cacb3f037f735dea7 => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:06.526905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dbab9-e8c5-4248-a615-e9f96b0faa96 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:06.542391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:06.546294 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef8334-b71a-49e6-ad09-021c9af4389d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:06.547843 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef8334-b71a-49e6-ad09-021c9af4389d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:06.567622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-8bef8334-b71a-49e6-ad09-021c9af4389d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:24:06.567622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:06.567622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:06.567622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:06.567622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:06.567622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:06.567622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:06.567622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:06.567622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:06.567622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:06.567622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:06.567622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:06.567622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:24:06.567622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:24:06.567622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:24:06.568488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:24:06.568488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:06.568488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:06.568488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:06.568488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:06.568488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:06.568488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:06.568488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:06.568488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:06.568488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:06.568488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:06.568488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:06.568488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:06.568488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:06.568488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:06.568488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:06.568488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:06.569308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:24:06.569308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:24:06.569308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:24:06.569308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:24:06.569308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 9/18] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:24:06.574711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef8334-b71a-49e6-ad09-021c9af4389d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:06.633110 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dbab9-e8c5-4248-a615-e9f96b0faa96 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:06.633762 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:06.667377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988303c-8e09-4f98-b86d-996f77f355ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:06.668029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988303c-8e09-4f98-b86d-996f77f355ef None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:06.668313 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988303c-8e09-4f98-b86d-996f77f355ef None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:06.668592 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988303c-8e09-4f98-b86d-996f77f355ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:06.669754 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988303c-8e09-4f98-b86d-996f77f355ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:06.671421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988303c-8e09-4f98-b86d-996f77f355ef None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:06.673018 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 10/19] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:24:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:06.677987 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef8334-b71a-49e6-ad09-021c9af4389d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:06.679207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988303c-8e09-4f98-b86d-996f77f355ef None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:06.712584 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45703b95-8689-46d8-9e9e-230b905dc68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:06.713209 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45703b95-8689-46d8-9e9e-230b905dc68b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:06.713495 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45703b95-8689-46d8-9e9e-230b905dc68b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:06.713778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45703b95-8689-46d8-9e9e-230b905dc68b None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:06.714487 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45703b95-8689-46d8-9e9e-230b905dc68b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:06.714792 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45703b95-8689-46d8-9e9e-230b905dc68b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:06.716216 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45703b95-8689-46d8-9e9e-230b905dc68b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:06.733973 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 10/20] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:06.764918 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:06.785266 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988303c-8e09-4f98-b86d-996f77f355ef None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:06.826177 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8493696-bd4d-4010-b0ba-e7f730283f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:06.826877 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8493696-bd4d-4010-b0ba-e7f730283f98 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:06.827135 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8493696-bd4d-4010-b0ba-e7f730283f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:06.827447 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8493696-bd4d-4010-b0ba-e7f730283f98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:06.828293 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8493696-bd4d-4010-b0ba-e7f730283f98 None admin] RBAC: Adding query filter params (role.id=4ae8d11d74f14bcc80117d897ba2f5b6, scope.domain.id=default, user.id=0dc5c37ef1d94f0cacb3f037f735dea7) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:06.828615 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8493696-bd4d-4010-b0ba-e7f730283f98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:06.830165 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8493696-bd4d-4010-b0ba-e7f730283f98 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:06.839200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 11/21] 10.222.0.65 () {56 vars in 1322 bytes} [Wed Jul 27 18:24:06 2022] GET /identity/v3/role_assignments?user.id=0dc5c37ef1d94f0cacb3f037f735dea7&scope.domain.id=default&role.id=4ae8d11d74f14bcc80117d897ba2f5b6 => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:09.202100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1a4aa-ff8e-4c78-962c-154306a03966 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:09.203129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1a4aa-ff8e-4c78-962c-154306a03966 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:09.203668 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1a4aa-ff8e-4c78-962c-154306a03966 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:09.205258 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 11/22] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:09.211762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476706e-aa97-4545-ad8d-fab0a393bbbc None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:09.212263 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476706e-aa97-4545-ad8d-fab0a393bbbc None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:09.212339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476706e-aa97-4545-ad8d-fab0a393bbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:09.236544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-b476706e-aa97-4545-ad8d-fab0a393bbbc None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:09.237770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b476706e-aa97-4545-ad8d-fab0a393bbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:09.326550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 12/23] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:09.361660 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1a4aa-ff8e-4c78-962c-154306a03966 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:09.464635 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1cc46-c84e-4401-a689-8547009d14fe None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:09.464934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1cc46-c84e-4401-a689-8547009d14fe None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:09.465124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1cc46-c84e-4401-a689-8547009d14fe None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:09.466903 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 13/24] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:09.474377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d8205-7899-4076-ba12-efa756a3a695 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:09.474683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d8205-7899-4076-ba12-efa756a3a695 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:09.474961 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d8205-7899-4076-ba12-efa756a3a695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:09.516632 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-bf2d8205-7899-4076-ba12-efa756a3a695 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:09.517898 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-bf2d8205-7899-4076-ba12-efa756a3a695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:09.518144 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1a4aa-ff8e-4c78-962c-154306a03966 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:09.567890 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:09.586348 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649c3ed-d7ff-42e4-9cd0-260aaee5f6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:09.587034 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649c3ed-d7ff-42e4-9cd0-260aaee5f6cb None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:09.587349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649c3ed-d7ff-42e4-9cd0-260aaee5f6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:09.587635 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649c3ed-d7ff-42e4-9cd0-260aaee5f6cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:09.620223 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649c3ed-d7ff-42e4-9cd0-260aaee5f6cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:09.626964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-a649c3ed-d7ff-42e4-9cd0-260aaee5f6cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:24:09.626964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:09.626964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:09.626964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:09.626964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:09.626964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:09.626964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:09.626964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:09.626964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:09.626964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:09.626964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:09.626964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:09.626964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:09.626964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:09.626964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:09.626964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:09.628375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:09.628375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:09.628375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:09.628375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:09.628375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:09.628375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:09.628375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:09.628375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:09.628375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:09.628375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:09.628375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:09.628375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:09.628375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:09.628375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:09.628375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:09.628375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:09.629333 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:09.629333 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:09.629333 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:09.629333 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:09.629333 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:09.629333 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:09.629333 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:09.629333 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:09.629333 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:09.629333 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:09.629333 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:24:09.629333 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:24:09.631626 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 12/25] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:24:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:09.640439 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649c3ed-d7ff-42e4-9cd0-260aaee5f6cb None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:09.736787 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 14/26] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:09.738029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e96f8-d345-4a62-bedf-8ddae8228fe2 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:09.738322 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e96f8-d345-4a62-bedf-8ddae8228fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:09.738606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e96f8-d345-4a62-bedf-8ddae8228fe2 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:09.740536 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 15/27] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:09.775637 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d05680-033c-4328-a6b1-36390b1549fd None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:09.775937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d05680-033c-4328-a6b1-36390b1549fd None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:09.776200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d05680-033c-4328-a6b1-36390b1549fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:09.803122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:09.817350 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649c3ed-d7ff-42e4-9cd0-260aaee5f6cb None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:09.827273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-32d05680-033c-4328-a6b1-36390b1549fd None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:09.828503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-32d05680-033c-4328-a6b1-36390b1549fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:09.860483 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbd598-4bb4-42d9-937d-72dbd7e1ebe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:09.861133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbd598-4bb4-42d9-937d-72dbd7e1ebe4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:09.861420 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbd598-4bb4-42d9-937d-72dbd7e1ebe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:09.861707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbd598-4bb4-42d9-937d-72dbd7e1ebe4 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:09.862448 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bbd598-4bb4-42d9-937d-72dbd7e1ebe4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:09.862765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bbd598-4bb4-42d9-937d-72dbd7e1ebe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:09.865739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bbd598-4bb4-42d9-937d-72dbd7e1ebe4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:09.885223 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 13/28] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:09.885223 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbd598-4bb4-42d9-937d-72dbd7e1ebe4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:09.923291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 16/29] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:09.924652 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6336e3-f347-452e-8286-729ddc51e811 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:09.924941 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6336e3-f347-452e-8286-729ddc51e811 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:09.925219 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6336e3-f347-452e-8286-729ddc51e811 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:09.927422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 17/30] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:09.928566 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6336e3-f347-452e-8286-729ddc51e811 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:10.052254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:10.054314 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6336e3-f347-452e-8286-729ddc51e811 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:10.103775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4410490-896f-48fa-a985-903989a6a835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:10.104856 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4410490-896f-48fa-a985-903989a6a835 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:10.105143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4410490-896f-48fa-a985-903989a6a835 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:10.105422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4410490-896f-48fa-a985-903989a6a835 None admin] PATH_INFO: `/v3/users/0dc5c37ef1d94f0cacb3f037f735dea7` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:10.107165 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4410490-896f-48fa-a985-903989a6a835 None admin] RBAC: Authorizing `identity:get_user(user_id=0dc5c37ef1d94f0cacb3f037f735dea7)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:10.108680 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4410490-896f-48fa-a985-903989a6a835 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:10.110805 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 18/31] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:09 2022] GET /identity/v3/users/0dc5c37ef1d94f0cacb3f037f735dea7 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:10.112365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123adb7-9ace-4cbe-8a6e-8460eded8fb5 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:10.112649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123adb7-9ace-4cbe-8a6e-8460eded8fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:10.112927 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123adb7-9ace-4cbe-8a6e-8460eded8fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:10.122476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:10.123850 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbd598-4bb4-42d9-937d-72dbd7e1ebe4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:10.139467 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-7123adb7-9ace-4cbe-8a6e-8460eded8fb5 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:10.140719 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-7123adb7-9ace-4cbe-8a6e-8460eded8fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:10.173144 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6443073-a06e-4f3f-9352-ff5822b9dc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:10.174041 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6443073-a06e-4f3f-9352-ff5822b9dc26 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:10.174322 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6443073-a06e-4f3f-9352-ff5822b9dc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:10.174600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6443073-a06e-4f3f-9352-ff5822b9dc26 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:10.176001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6443073-a06e-4f3f-9352-ff5822b9dc26 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:10.177973 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6443073-a06e-4f3f-9352-ff5822b9dc26 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:10.228891 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 19/32] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:10.229762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123adb7-9ace-4cbe-8a6e-8460eded8fb5 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:10.354450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123adb7-9ace-4cbe-8a6e-8460eded8fb5 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:10.390244 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:10.396196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c41c9-20cf-44c1-87a4-06d3aef96db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:10.396861 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c41c9-20cf-44c1-87a4-06d3aef96db9 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:10.397154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c41c9-20cf-44c1-87a4-06d3aef96db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:10.397439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c41c9-20cf-44c1-87a4-06d3aef96db9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:10.413774 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c41c9-20cf-44c1-87a4-06d3aef96db9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:10.414109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 14/33] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Jul 27 18:24:09 2022] POST /identity/v3/roles => generated 219 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:10.415473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c41c9-20cf-44c1-87a4-06d3aef96db9 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:10.416809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6443073-a06e-4f3f-9352-ff5822b9dc26 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:10.439239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-cf1c41c9-20cf-44c1-87a4-06d3aef96db9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:24:10.439239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:10.439239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:10.439239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:10.439239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:10.439239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:10.439239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:10.439239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:10.439239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:10.439239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:10.439239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:10.439239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:10.439239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:24:10.439239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:24:10.439239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:24:10.440182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:24:10.440182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:10.440182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:10.440182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:10.440182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:10.440182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:10.440182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:10.440182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:10.440182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:10.440182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:10.440182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:10.440182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:10.440182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:10.440182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:10.440182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:10.440182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:10.440182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:10.441539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:24:10.441539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:24:10.441539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:24:10.441539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:24:10.441539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 20/34] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:10.441539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c41c9-20cf-44c1-87a4-06d3aef96db9 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:10.564879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:10.570251 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6443073-a06e-4f3f-9352-ff5822b9dc26 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:10.603394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c41c9-20cf-44c1-87a4-06d3aef96db9 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:10.619012 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d1c50-32c7-4f36-bb5c-8c43cd050d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:10.620124 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d1c50-32c7-4f36-bb5c-8c43cd050d30 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:10.620428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d1c50-32c7-4f36-bb5c-8c43cd050d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:10.620712 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d1c50-32c7-4f36-bb5c-8c43cd050d30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:10.622378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d1c50-32c7-4f36-bb5c-8c43cd050d30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:10.624083 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d1c50-32c7-4f36-bb5c-8c43cd050d30 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:10.625884 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 15/35] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:24:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:10.629419 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20cb8e-f9a3-43e8-a3ca-ba441c6ecc1e None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:10.629419 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20cb8e-f9a3-43e8-a3ca-ba441c6ecc1e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:10.629419 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20cb8e-f9a3-43e8-a3ca-ba441c6ecc1e None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:10.629419 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 16/36] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:10.630210 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20cb8e-f9a3-43e8-a3ca-ba441c6ecc1e None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:10.656370 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a88c6b-56da-47e9-93ec-bd0679de3931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:10.657072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a88c6b-56da-47e9-93ec-bd0679de3931 None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:10.657537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a88c6b-56da-47e9-93ec-bd0679de3931 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:10.657827 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a88c6b-56da-47e9-93ec-bd0679de3931 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:10.659041 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a88c6b-56da-47e9-93ec-bd0679de3931 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:10.660999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a88c6b-56da-47e9-93ec-bd0679de3931 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:10.740840 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20cb8e-f9a3-43e8-a3ca-ba441c6ecc1e None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:10.775839 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412c99a-b064-48b6-889c-f1b799ed9f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:10.776484 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412c99a-b064-48b6-889c-f1b799ed9f3e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:10.776734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412c99a-b064-48b6-889c-f1b799ed9f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:10.777010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412c99a-b064-48b6-889c-f1b799ed9f3e None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:10.777711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412c99a-b064-48b6-889c-f1b799ed9f3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:10.778018 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412c99a-b064-48b6-889c-f1b799ed9f3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:10.779432 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412c99a-b064-48b6-889c-f1b799ed9f3e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:10.792170 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 17/37] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:10.792800 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412c99a-b064-48b6-889c-f1b799ed9f3e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:10.820199 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:10.855716 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 21/38] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Jul 27 18:24:10 2022] POST /identity/v3/roles => generated 225 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:10.857293 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844727d-debb-4979-9ee9-05128c6dee63 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:10.857492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844727d-debb-4979-9ee9-05128c6dee63 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:10.857778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844727d-debb-4979-9ee9-05128c6dee63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:10.887049 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-4844727d-debb-4979-9ee9-05128c6dee63 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:10.889012 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4844727d-debb-4979-9ee9-05128c6dee63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:10.906538 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412c99a-b064-48b6-889c-f1b799ed9f3e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:10.938221 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:10.955166 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19dbc8-2495-4992-87c9-050d4349bf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:10.955914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19dbc8-2495-4992-87c9-050d4349bf6b None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:10.956206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19dbc8-2495-4992-87c9-050d4349bf6b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:10.956840 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19dbc8-2495-4992-87c9-050d4349bf6b None admin] PATH_INFO: `/v3/domains/default/users/0dc5c37ef1d94f0cacb3f037f735dea7/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:10.959654 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19dbc8-2495-4992-87c9-050d4349bf6b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0dc5c37ef1d94f0cacb3f037f735dea7, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:10.961177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19dbc8-2495-4992-87c9-050d4349bf6b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:10.974322 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 22/39] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:10.976480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329a175-984d-4e25-b923-3f4167e38744 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:10.978413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329a175-984d-4e25-b923-3f4167e38744 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:10.978413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329a175-984d-4e25-b923-3f4167e38744 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:10.978863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 23/40] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:10.985661 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329a175-984d-4e25-b923-3f4167e38744 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:11.054443 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 18/41] 10.222.0.65 () {58 vars in 1361 bytes} [Wed Jul 27 18:24:10 2022] PUT /identity/v3/domains/default/users/0dc5c37ef1d94f0cacb3f037f735dea7/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:11.055975 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150dfc6-33c1-437b-92a2-d8105dd46b2a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:11.056892 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150dfc6-33c1-437b-92a2-d8105dd46b2a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:11.057307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150dfc6-33c1-437b-92a2-d8105dd46b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:11.080289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f150dfc6-33c1-437b-92a2-d8105dd46b2a None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:11.080656 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f150dfc6-33c1-437b-92a2-d8105dd46b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:11.116780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329a175-984d-4e25-b923-3f4167e38744 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:11.159683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac9570-8da3-4bd6-8f7a-b9014c01aaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:11.160247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac9570-8da3-4bd6-8f7a-b9014c01aaee None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:11.160577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac9570-8da3-4bd6-8f7a-b9014c01aaee None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:11.160998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac9570-8da3-4bd6-8f7a-b9014c01aaee None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:11.161715 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac9570-8da3-4bd6-8f7a-b9014c01aaee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:11.163466 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac9570-8da3-4bd6-8f7a-b9014c01aaee None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:11.173214 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 19/42] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:11.173214 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150dfc6-33c1-437b-92a2-d8105dd46b2a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:11.188376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:11.276599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 24/43] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 18:24:10 2022] POST /identity/v3/projects => generated 301 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:11.277619 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac9570-8da3-4bd6-8f7a-b9014c01aaee None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:11.299556 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150dfc6-33c1-437b-92a2-d8105dd46b2a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:11.314926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:11.342699 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c376f2-6fa8-45c9-9380-729a05672424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:11.343671 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c376f2-6fa8-45c9-9380-729a05672424 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:11.344158 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c376f2-6fa8-45c9-9380-729a05672424 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:11.344609 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c376f2-6fa8-45c9-9380-729a05672424 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:11.345538 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c376f2-6fa8-45c9-9380-729a05672424 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:11.347182 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c376f2-6fa8-45c9-9380-729a05672424 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:11.404791 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac9570-8da3-4bd6-8f7a-b9014c01aaee None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:11.434917 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 20/44] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Jul 27 18:24:11 2022] POST /identity/v3/roles => generated 223 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:11.460237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d388c-ea89-4ebc-9945-b8c072fa7432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:11.461339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d388c-ea89-4ebc-9945-b8c072fa7432 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:11.461851 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d388c-ea89-4ebc-9945-b8c072fa7432 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:11.462331 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d388c-ea89-4ebc-9945-b8c072fa7432 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:11.464134 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d388c-ea89-4ebc-9945-b8c072fa7432 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:11.466056 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d388c-ea89-4ebc-9945-b8c072fa7432 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:11.468234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 25/45] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:24:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:11.475062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c376f2-6fa8-45c9-9380-729a05672424 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:11.576946 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:11.601971 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c376f2-6fa8-45c9-9380-729a05672424 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:11.640177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdf230-bcb1-407e-a3a0-03889d5badac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:11.641104 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdf230-bcb1-407e-a3a0-03889d5badac None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:11.641586 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdf230-bcb1-407e-a3a0-03889d5badac None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:11.641868 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdf230-bcb1-407e-a3a0-03889d5badac None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:11.642587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdf230-bcb1-407e-a3a0-03889d5badac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:11.644106 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdf230-bcb1-407e-a3a0-03889d5badac None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:11.737919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 21/46] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 18:24:11 2022] POST /identity/v3/projects => generated 312 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:13.093164 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333ef58-c8f4-4601-bf0a-d36ac4694148 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:13.093726 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333ef58-c8f4-4601-bf0a-d36ac4694148 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:13.093726 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333ef58-c8f4-4601-bf0a-d36ac4694148 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:13.095176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 26/47] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:13.101134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b79d1-35a5-4699-a745-1493afdef0bf None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:13.101562 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b79d1-35a5-4699-a745-1493afdef0bf None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:13.101695 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b79d1-35a5-4699-a745-1493afdef0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:13.120918 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-443b79d1-35a5-4699-a745-1493afdef0bf None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:13.122096 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-443b79d1-35a5-4699-a745-1493afdef0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:13.186662 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 22/48] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:13.210123 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333ef58-c8f4-4601-bf0a-d36ac4694148 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:13.304887 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:13.315486 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333ef58-c8f4-4601-bf0a-d36ac4694148 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:13.351360 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72ae31-8a04-4075-b197-b5814769f392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:13.351959 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72ae31-8a04-4075-b197-b5814769f392 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:13.352253 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72ae31-8a04-4075-b197-b5814769f392 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:13.352541 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72ae31-8a04-4075-b197-b5814769f392 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:13.363005 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72ae31-8a04-4075-b197-b5814769f392 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:13.368044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-bd72ae31-8a04-4075-b197-b5814769f392 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:24:13.368044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:13.368044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:13.368044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:13.368044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:13.368044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:13.368044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:13.368044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:13.368044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:13.368044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:13.368044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:13.368044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:13.368044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:13.368044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:13.368044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:13.368044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:13.368878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:13.368878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:13.368878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:13.368878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:13.368878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:13.368878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:13.368878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:13.368878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:13.368878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:13.368878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:13.368878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:13.368878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:13.368878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:13.368878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:13.368878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:13.368878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:13.369890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:13.369890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:13.369890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:13.369890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:13.369890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:13.369890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:13.369890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:13.369890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:13.369890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:13.369890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:13.369890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:24:13.369890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:24:13.369890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 27/49] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:24:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:13.375071 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b79d1-35a5-4699-a745-1493afdef0bf None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:13.437402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:13.479945 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b79d1-35a5-4699-a745-1493afdef0bf None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:13.513572 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44e869-cabe-43e7-ab61-3ce6114bf04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:13.514193 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44e869-cabe-43e7-ab61-3ce6114bf04f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:13.514483 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44e869-cabe-43e7-ab61-3ce6114bf04f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:13.514769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44e869-cabe-43e7-ab61-3ce6114bf04f None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:13.515863 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44e869-cabe-43e7-ab61-3ce6114bf04f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:13.516545 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44e869-cabe-43e7-ab61-3ce6114bf04f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:13.518466 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44e869-cabe-43e7-ab61-3ce6114bf04f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:13.527568 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 23/50] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:13.533330 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72ae31-8a04-4075-b197-b5814769f392 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:13.637092 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72ae31-8a04-4075-b197-b5814769f392 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:13.672167 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5eddd-f7db-4018-b948-f96575cca328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:13.672817 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5eddd-f7db-4018-b948-f96575cca328 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:13.673105 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5eddd-f7db-4018-b948-f96575cca328 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:13.673386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5eddd-f7db-4018-b948-f96575cca328 None admin] PATH_INFO: `/v3/users/0dc5c37ef1d94f0cacb3f037f735dea7` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:13.674568 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5eddd-f7db-4018-b948-f96575cca328 None admin] RBAC: Authorizing `identity:get_user(user_id=0dc5c37ef1d94f0cacb3f037f735dea7)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:13.676077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5eddd-f7db-4018-b948-f96575cca328 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:13.677904 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 28/51] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:13 2022] GET /identity/v3/users/0dc5c37ef1d94f0cacb3f037f735dea7 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:13.683318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44e869-cabe-43e7-ab61-3ce6114bf04f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:13.784767 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44e869-cabe-43e7-ab61-3ce6114bf04f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:13.787778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce4657-b1eb-4070-80d2-7b056d2a57aa None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:13.788145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce4657-b1eb-4070-80d2-7b056d2a57aa None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:13.788439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce4657-b1eb-4070-80d2-7b056d2a57aa None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:13.789805 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 29/52] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:24:13.794654 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df7a4d-90d3-4316-bc9c-a3b6af87cd43 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:13.794949 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df7a4d-90d3-4316-bc9c-a3b6af87cd43 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:13.795235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df7a4d-90d3-4316-bc9c-a3b6af87cd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:13.805783 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:13.813469 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-94df7a4d-90d3-4316-bc9c-a3b6af87cd43 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:13.817486 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-94df7a4d-90d3-4316-bc9c-a3b6af87cd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:13.820835 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e719af6-d839-4c7a-b38e-dec70b1abe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:13.821486 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e719af6-d839-4c7a-b38e-dec70b1abe66 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:13.821775 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e719af6-d839-4c7a-b38e-dec70b1abe66 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:13.822064 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e719af6-d839-4c7a-b38e-dec70b1abe66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:13.823335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e719af6-d839-4c7a-b38e-dec70b1abe66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:13.824806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e719af6-d839-4c7a-b38e-dec70b1abe66 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:13.826428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 24/53] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:24:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:13.832186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e719af6-d839-4c7a-b38e-dec70b1abe66 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:13.832919 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:13.884406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 30/54] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:24:13.907587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df7a4d-90d3-4316-bc9c-a3b6af87cd43 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:13.937084 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e719af6-d839-4c7a-b38e-dec70b1abe66 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:13.970742 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae860db8-ab25-4892-9ac0-932a22ae6ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:13.971414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae860db8-ab25-4892-9ac0-932a22ae6ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:13.971704 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae860db8-ab25-4892-9ac0-932a22ae6ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:13.971984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae860db8-ab25-4892-9ac0-932a22ae6ea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:13.972787 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae860db8-ab25-4892-9ac0-932a22ae6ea8 None admin] RBAC: Adding query filter params (role.id=4ae8d11d74f14bcc80117d897ba2f5b6, scope.domain.id=default, user.id=0dc5c37ef1d94f0cacb3f037f735dea7) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:13.973687 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae860db8-ab25-4892-9ac0-932a22ae6ea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:13.975310 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae860db8-ab25-4892-9ac0-932a22ae6ea8 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:13.983372 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 25/55] 10.222.0.65 () {56 vars in 1322 bytes} [Wed Jul 27 18:24:13 2022] GET /identity/v3/role_assignments?user.id=0dc5c37ef1d94f0cacb3f037f735dea7&scope.domain.id=default&role.id=4ae8d11d74f14bcc80117d897ba2f5b6 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:14.013874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df7a4d-90d3-4316-bc9c-a3b6af87cd43 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:14.051345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2870d5d-8e47-4a9a-8cac-17513cbbac30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:14.052663 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2870d5d-8e47-4a9a-8cac-17513cbbac30 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:14.052986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2870d5d-8e47-4a9a-8cac-17513cbbac30 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:14.053270 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2870d5d-8e47-4a9a-8cac-17513cbbac30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:14.054539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2870d5d-8e47-4a9a-8cac-17513cbbac30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:14.056082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2870d5d-8e47-4a9a-8cac-17513cbbac30 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:14.057769 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 31/56] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:24:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:14.063666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae860db8-ab25-4892-9ac0-932a22ae6ea8 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:14.120968 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:14.170913 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae860db8-ab25-4892-9ac0-932a22ae6ea8 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:14.205367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11b187-57bf-47b0-bb02-c4b8706277e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:14.205992 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11b187-57bf-47b0-bb02-c4b8706277e6 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:14.206280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11b187-57bf-47b0-bb02-c4b8706277e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:14.206636 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11b187-57bf-47b0-bb02-c4b8706277e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:14.207285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11b187-57bf-47b0-bb02-c4b8706277e6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:14.209445 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11b187-57bf-47b0-bb02-c4b8706277e6 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:14.276609 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 26/57] 10.222.0.65 () {60 vars in 1140 bytes} [Wed Jul 27 18:24:14 2022] POST /identity/v3/projects => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:24:16.341317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80be350-5709-4dda-9949-8ab4a457e0b9 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:16.341876 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80be350-5709-4dda-9949-8ab4a457e0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:16.341876 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80be350-5709-4dda-9949-8ab4a457e0b9 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:16.343246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 32/58] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:16.349057 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41264ed-9216-40f6-86ee-4b7454e13f30 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:16.349497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41264ed-9216-40f6-86ee-4b7454e13f30 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:16.349624 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41264ed-9216-40f6-86ee-4b7454e13f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:16.368158 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-e41264ed-9216-40f6-86ee-4b7454e13f30 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:16.369386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e41264ed-9216-40f6-86ee-4b7454e13f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:16.438983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 27/59] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:16.463377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80be350-5709-4dda-9949-8ab4a457e0b9 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:16.485742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:16.565811 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80be350-5709-4dda-9949-8ab4a457e0b9 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:16.600164 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39a005-da56-4f3e-a037-28dde8d1b845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:16.600737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39a005-da56-4f3e-a037-28dde8d1b845 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:16.601026 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39a005-da56-4f3e-a037-28dde8d1b845 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:16.601306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39a005-da56-4f3e-a037-28dde8d1b845 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:16.602466 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39a005-da56-4f3e-a037-28dde8d1b845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:16.603963 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39a005-da56-4f3e-a037-28dde8d1b845 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:16.605566 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 33/60] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:24:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:16.611155 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41264ed-9216-40f6-86ee-4b7454e13f30 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:16.643805 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:16.709360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41264ed-9216-40f6-86ee-4b7454e13f30 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:16.742209 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e880b1-5e14-4473-9856-7798a1ad92b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:16.742863 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e880b1-5e14-4473-9856-7798a1ad92b0 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:16.743424 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e880b1-5e14-4473-9856-7798a1ad92b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:16.743884 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e880b1-5e14-4473-9856-7798a1ad92b0 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:16.745144 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e880b1-5e14-4473-9856-7798a1ad92b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:16.746607 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e880b1-5e14-4473-9856-7798a1ad92b0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:16.864909 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 28/61] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 18:24:16 2022] POST /identity/v3/users => generated 275 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:20.243858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5224e7a-0202-4c17-97e4-85a7243a32ba None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:20.244908 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5224e7a-0202-4c17-97e4-85a7243a32ba None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:20.245407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5224e7a-0202-4c17-97e4-85a7243a32ba None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:20.247183 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 34/62] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:20.248025 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd241b8a-7846-4e1f-8638-d99ba40d5bcd None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:20.248463 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd241b8a-7846-4e1f-8638-d99ba40d5bcd None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:20.248653 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd241b8a-7846-4e1f-8638-d99ba40d5bcd None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:20.250097 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 29/63] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:20.256419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90224b-fd4f-4560-97eb-7105ba9564dd None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:20.257059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90224b-fd4f-4560-97eb-7105ba9564dd None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:20.257756 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90224b-fd4f-4560-97eb-7105ba9564dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:20.262294 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bc5c1-ad30-4b24-b220-b6cfb97b2a1c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:20.262613 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bc5c1-ad30-4b24-b220-b6cfb97b2a1c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:20.262857 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bc5c1-ad30-4b24-b220-b6cfb97b2a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:20.290396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-9e90224b-fd4f-4560-97eb-7105ba9564dd None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:20.291674 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-9e90224b-fd4f-4560-97eb-7105ba9564dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:20.298569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-d01bc5c1-ad30-4b24-b220-b6cfb97b2a1c None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:20.299797 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d01bc5c1-ad30-4b24-b220-b6cfb97b2a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:20.418907 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 35/64] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:24:20.431926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 30/65] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:24:20.434265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324dcb6-e431-4d5b-8e93-6ea11ad226f1 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:20.434783 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324dcb6-e431-4d5b-8e93-6ea11ad226f1 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:20.435306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324dcb6-e431-4d5b-8e93-6ea11ad226f1 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:20.436894 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 36/66] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:20.442489 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9976c-836d-4e62-b817-d1dbf9242cf9 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:20.443078 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9976c-836d-4e62-b817-d1dbf9242cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:20.443594 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9976c-836d-4e62-b817-d1dbf9242cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:20.463217 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f7d9976c-836d-4e62-b817-d1dbf9242cf9 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:20.464804 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f7d9976c-836d-4e62-b817-d1dbf9242cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:20.467137 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4e5b7-356c-4e68-9e6f-4286a214165f None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:20.467698 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4e5b7-356c-4e68-9e6f-4286a214165f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:20.468177 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4e5b7-356c-4e68-9e6f-4286a214165f None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:20.469794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 37/67] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:20.471608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4e5b7-356c-4e68-9e6f-4286a214165f None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:20.486202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:20.492240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:20.541461 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 31/68] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:20.542598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9976c-836d-4e62-b817-d1dbf9242cf9 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:20.583040 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4e5b7-356c-4e68-9e6f-4286a214165f None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:20.618457 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ef985-7c33-4204-9583-ce3bdff3fa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:20.619113 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ef985-7c33-4204-9583-ce3bdff3fa0d None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:20.619440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ef985-7c33-4204-9583-ce3bdff3fa0d None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:20.619727 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ef985-7c33-4204-9583-ce3bdff3fa0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:20.631213 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ef985-7c33-4204-9583-ce3bdff3fa0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:20.636199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-2f1ef985-7c33-4204-9583-ce3bdff3fa0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:20.636199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:20.636199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:20.636199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:20.636199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:20.636199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:20.636199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:20.636199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:20.636199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:20.636199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:20.636199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:20.636199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:20.636199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:20.636199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:20.636199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:20.636199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:20.637174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:20.637174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:20.637174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:20.637174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:20.637174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:20.637174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:20.637174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:20.637174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:20.637174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:20.637174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:20.637174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:20.637174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:20.637174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:20.637174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:20.637174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:20.637174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:20.637946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:20.637946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:20.637946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:20.637946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:20.637946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:20.637946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:20.637946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:20.637946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:20.637946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:20.637946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:20.637946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:20.637946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:24:20.637946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 38/69] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:20.639037 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127122cf-2abc-4319-a46b-3e68f749334a None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:20.639295 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127122cf-2abc-4319-a46b-3e68f749334a None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:20.639578 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127122cf-2abc-4319-a46b-3e68f749334a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:20.651874 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9976c-836d-4e62-b817-d1dbf9242cf9 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:20.658383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-127122cf-2abc-4319-a46b-3e68f749334a None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:20.659624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-127122cf-2abc-4319-a46b-3e68f749334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:20.686612 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f7eb8-e3c2-454c-9341-b168d760821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:20.687280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f7eb8-e3c2-454c-9341-b168d760821d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:20.687562 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f7eb8-e3c2-454c-9341-b168d760821d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:20.687838 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f7eb8-e3c2-454c-9341-b168d760821d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:20.698546 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f7eb8-e3c2-454c-9341-b168d760821d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:20.703513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-555f7eb8-e3c2-454c-9341-b168d760821d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:24:20.703513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:20.703513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:20.703513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:20.703513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:20.703513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:20.703513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:20.703513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:20.703513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:20.703513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:20.703513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:20.703513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:20.703513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:20.703513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:20.703513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:20.703513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:20.704380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:20.704380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:20.704380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:20.704380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:20.704380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:20.704380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:20.704380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:20.704380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:20.704380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:20.704380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:20.704380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:20.704380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:20.704380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:20.704380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:20.704380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:20.704380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:20.705143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:20.705143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:20.705143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:20.705143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:20.705143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:20.705143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:20.705143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:20.705143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:20.705143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:20.705143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:20.705143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:24:20.705143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:24:20.705143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 32/70] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:24:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:20.706497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616147b-a47a-4123-a8fa-6d5c24f84465 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:20.706726 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616147b-a47a-4123-a8fa-6d5c24f84465 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:20.706982 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616147b-a47a-4123-a8fa-6d5c24f84465 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:20.709224 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 33/71] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:20.710904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616147b-a47a-4123-a8fa-6d5c24f84465 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:20.723341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:20.729126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 39/72] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:20.730247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127122cf-2abc-4319-a46b-3e68f749334a None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:20.745635 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:20.834034 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616147b-a47a-4123-a8fa-6d5c24f84465 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:20.841660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127122cf-2abc-4319-a46b-3e68f749334a None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:20.869597 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b99667-3ed4-4d03-9619-c93385c965a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:20.870243 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b99667-3ed4-4d03-9619-c93385c965a7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:20.870523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b99667-3ed4-4d03-9619-c93385c965a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:20.870798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b99667-3ed4-4d03-9619-c93385c965a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:20.877647 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb7b73-3aec-4b68-a5b3-f3e84776304e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:20.877831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb7b73-3aec-4b68-a5b3-f3e84776304e None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:20.878041 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb7b73-3aec-4b68-a5b3-f3e84776304e None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:20.878326 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb7b73-3aec-4b68-a5b3-f3e84776304e None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:20.879620 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb7b73-3aec-4b68-a5b3-f3e84776304e None admin] RBAC: Adding query filter params (name=member) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:20.879958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb7b73-3aec-4b68-a5b3-f3e84776304e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:20.881363 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb7b73-3aec-4b68-a5b3-f3e84776304e None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:20.882066 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b99667-3ed4-4d03-9619-c93385c965a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:20.887082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-87b99667-3ed4-4d03-9619-c93385c965a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:20.887082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:20.887082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:20.887082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:20.887082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:20.887082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:20.887082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:20.887082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:20.887082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:20.887082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:20.887082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:20.887082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:20.887082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:20.887082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:20.887082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:20.887082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:20.887985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:20.887985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:20.887985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:20.887985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:20.887985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:20.887985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:20.887985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:20.887985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:20.887985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:20.887985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:20.887985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:20.887985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:20.887985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:20.887985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:20.887985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:20.887985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:20.888749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:20.888749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:20.888749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:20.888749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:20.888749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:20.888749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:20.888749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:20.888749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:20.888749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:20.888749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:20.888749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:20.888749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:24:20.888749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 34/73] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:20.889392 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b99667-3ed4-4d03-9619-c93385c965a7 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:20.890098 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 40/74] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:20.891402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8474c-9f98-4b53-9224-873be31f13d1 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:20.891701 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8474c-9f98-4b53-9224-873be31f13d1 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:20.891982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8474c-9f98-4b53-9224-873be31f13d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:20.909985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-dcf8474c-9f98-4b53-9224-873be31f13d1 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:20.911330 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-dcf8474c-9f98-4b53-9224-873be31f13d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:20.967705 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:20.976767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:20.981338 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 41/75] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:20.985797 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8474c-9f98-4b53-9224-873be31f13d1 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:21.003101 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b99667-3ed4-4d03-9619-c93385c965a7 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:21.038239 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2e28f-6883-4076-8c73-00e78c8fd78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:21.038901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2e28f-6883-4076-8c73-00e78c8fd78e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:21.039148 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2e28f-6883-4076-8c73-00e78c8fd78e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:21.039458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2e28f-6883-4076-8c73-00e78c8fd78e None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:21.040184 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2e28f-6883-4076-8c73-00e78c8fd78e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:21.040492 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2e28f-6883-4076-8c73-00e78c8fd78e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:21.041905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2e28f-6883-4076-8c73-00e78c8fd78e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:21.050575 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 35/76] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:21.052245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2e28f-6883-4076-8c73-00e78c8fd78e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:21.096863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8474c-9f98-4b53-9224-873be31f13d1 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:21.134782 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe7df4-deb6-44c4-bf42-a66022b7b7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:21.135691 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe7df4-deb6-44c4-bf42-a66022b7b7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:21.136117 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe7df4-deb6-44c4-bf42-a66022b7b7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:21.136536 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe7df4-deb6-44c4-bf42-a66022b7b7e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:21.149400 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe7df4-deb6-44c4-bf42-a66022b7b7e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:21.154402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-f9fe7df4-deb6-44c4-bf42-a66022b7b7e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:24:21.154402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:21.154402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:21.154402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:21.154402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:21.154402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:21.154402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:21.154402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:21.154402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:21.154402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:21.154402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:21.154402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:21.154402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:21.154402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:21.154402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:21.154402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:21.155366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:21.155366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:21.155366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:21.155366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:21.155366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:21.155366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:21.155366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:21.155366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:21.155366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:21.155366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:21.155366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:21.155366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:21.155366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:21.155366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:21.155366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:21.155366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:21.156154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:21.156154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:21.156154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:21.156154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:21.156154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:21.156154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:21.156154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:21.156154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:21.156154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:21.156154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:21.156154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:24:21.156154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:24:21.156154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 42/77] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 18:24:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:21.156808 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe7df4-deb6-44c4-bf42-a66022b7b7e1 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:21.168900 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2e28f-6883-4076-8c73-00e78c8fd78e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:21.198298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:21.203869 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13167631-1ec8-460a-8942-40c42b68f987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:21.209354 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13167631-1ec8-460a-8942-40c42b68f987 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:21.209354 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13167631-1ec8-460a-8942-40c42b68f987 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:21.209354 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13167631-1ec8-460a-8942-40c42b68f987 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:21.209354 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13167631-1ec8-460a-8942-40c42b68f987 None admin] RBAC: Adding query filter params (name=member) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:21.209354 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13167631-1ec8-460a-8942-40c42b68f987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:21.209354 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13167631-1ec8-460a-8942-40c42b68f987 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:21.216852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:21.221927 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 36/78] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:21.221927 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13167631-1ec8-460a-8942-40c42b68f987 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:21.264377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe7df4-deb6-44c4-bf42-a66022b7b7e1 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:21.298405 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340de8a7-7cbb-4b17-aebd-877ab0c18e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:21.299052 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340de8a7-7cbb-4b17-aebd-877ab0c18e94 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:21.299222 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340de8a7-7cbb-4b17-aebd-877ab0c18e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:21.299530 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340de8a7-7cbb-4b17-aebd-877ab0c18e94 None admin] PATH_INFO: `/v3/users/034095ad77554819b83324ec8dd53a22` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:21.314615 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340de8a7-7cbb-4b17-aebd-877ab0c18e94 None admin] RBAC: Authorizing `identity:get_user(user_id=034095ad77554819b83324ec8dd53a22)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:21.316170 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340de8a7-7cbb-4b17-aebd-877ab0c18e94 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:21.318484 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 43/79] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:21 2022] GET /identity/v3/users/034095ad77554819b83324ec8dd53a22 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:21.319273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340de8a7-7cbb-4b17-aebd-877ab0c18e94 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:21.319886 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13167631-1ec8-460a-8942-40c42b68f987 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:21.354954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59026618-2e7f-4c47-bde3-6857718d1ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:21.355548 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59026618-2e7f-4c47-bde3-6857718d1ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:21.355838 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59026618-2e7f-4c47-bde3-6857718d1ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:21.356128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59026618-2e7f-4c47-bde3-6857718d1ae9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:21.357409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59026618-2e7f-4c47-bde3-6857718d1ae9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:21.358875 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59026618-2e7f-4c47-bde3-6857718d1ae9 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:21.360539 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 37/80] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:24:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:21.362983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59026618-2e7f-4c47-bde3-6857718d1ae9 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:21.422837 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340de8a7-7cbb-4b17-aebd-877ab0c18e94 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:21.426971 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:21.445376 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:21.464794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd288d2-2570-472b-818c-1a0bf8aa3316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:21.465461 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd288d2-2570-472b-818c-1a0bf8aa3316 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:21.465753 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd288d2-2570-472b-818c-1a0bf8aa3316 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:21.466036 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd288d2-2570-472b-818c-1a0bf8aa3316 None admin] PATH_INFO: `/v3/users/0dc5c37ef1d94f0cacb3f037f735dea7` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:21.467232 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59026618-2e7f-4c47-bde3-6857718d1ae9 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:21.467356 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd288d2-2570-472b-818c-1a0bf8aa3316 None admin] RBAC: Authorizing `identity:get_user(user_id=0dc5c37ef1d94f0cacb3f037f735dea7)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:21.468765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd288d2-2570-472b-818c-1a0bf8aa3316 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:21.471544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 44/81] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:21 2022] GET /identity/v3/users/0dc5c37ef1d94f0cacb3f037f735dea7 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:21.471544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd288d2-2570-472b-818c-1a0bf8aa3316 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:21.503778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03312912-8f22-41a2-9190-df2ed968e9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:21.505124 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03312912-8f22-41a2-9190-df2ed968e9ad None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:21.505418 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03312912-8f22-41a2-9190-df2ed968e9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:21.505701 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03312912-8f22-41a2-9190-df2ed968e9ad None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:21.506432 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03312912-8f22-41a2-9190-df2ed968e9ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:21.506746 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03312912-8f22-41a2-9190-df2ed968e9ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:21.508176 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03312912-8f22-41a2-9190-df2ed968e9ad None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:21.516157 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 38/82] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:24:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:21.516960 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03312912-8f22-41a2-9190-df2ed968e9ad None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:21.585842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd288d2-2570-472b-818c-1a0bf8aa3316 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:21.621014 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d9c84-c725-4a95-9203-886235fdb06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:21.621588 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d9c84-c725-4a95-9203-886235fdb06b None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:21.621878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d9c84-c725-4a95-9203-886235fdb06b None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:21.622165 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d9c84-c725-4a95-9203-886235fdb06b None admin] PATH_INFO: `/v3/users/034095ad77554819b83324ec8dd53a22` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:21.623409 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d9c84-c725-4a95-9203-886235fdb06b None admin] RBAC: Authorizing `identity:get_user(user_id=034095ad77554819b83324ec8dd53a22)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:21.624889 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d9c84-c725-4a95-9203-886235fdb06b None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:21.626530 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 45/83] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:21 2022] GET /identity/v3/users/034095ad77554819b83324ec8dd53a22 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:21.627552 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d9c84-c725-4a95-9203-886235fdb06b None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:21.629768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03312912-8f22-41a2-9190-df2ed968e9ad None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:21.653793 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:21.665133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ed312-35e1-4966-b682-1fc866bfbac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:21.671621 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ed312-35e1-4966-b682-1fc866bfbac4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:21.671621 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ed312-35e1-4966-b682-1fc866bfbac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:21.671621 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ed312-35e1-4966-b682-1fc866bfbac4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:21.693038 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:21.738778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ed312-35e1-4966-b682-1fc866bfbac4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:21.740329 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ed312-35e1-4966-b682-1fc866bfbac4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:21.740600 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d9c84-c725-4a95-9203-886235fdb06b None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:21.782233 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb493427-1155-4fa9-9307-e7de0ae65107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:21.782872 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb493427-1155-4fa9-9307-e7de0ae65107 None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:21.783172 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb493427-1155-4fa9-9307-e7de0ae65107 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:21.783482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb493427-1155-4fa9-9307-e7de0ae65107 None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:21.784181 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb493427-1155-4fa9-9307-e7de0ae65107 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:21.786259 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb493427-1155-4fa9-9307-e7de0ae65107 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:21.843283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 39/84] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:24:21.844291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ed312-35e1-4966-b682-1fc866bfbac4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:21.869441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:21.942127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ed312-35e1-4966-b682-1fc866bfbac4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:21.954148 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 46/85] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 18:24:21 2022] POST /identity/v3/users => generated 289 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:21.954992 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb493427-1155-4fa9-9307-e7de0ae65107 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:21.984334 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902e859-beb9-48cc-ac62-f6355c8c5d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:21.984990 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902e859-beb9-48cc-ac62-f6355c8c5d8d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:21.985280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902e859-beb9-48cc-ac62-f6355c8c5d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:21.985565 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902e859-beb9-48cc-ac62-f6355c8c5d8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:22.065251 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902e859-beb9-48cc-ac62-f6355c8c5d8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:22.067000 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902e859-beb9-48cc-ac62-f6355c8c5d8d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:22.069915 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb493427-1155-4fa9-9307-e7de0ae65107 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:22.082837 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:22.094694 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:22.109073 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc271d-ca5e-4432-8b9f-3af4202b8112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:22.109742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc271d-ca5e-4432-8b9f-3af4202b8112 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:22.110031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc271d-ca5e-4432-8b9f-3af4202b8112 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:22.110315 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc271d-ca5e-4432-8b9f-3af4202b8112 None admin] PATH_INFO: `/v3/users/034095ad77554819b83324ec8dd53a22` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:22.114075 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc271d-ca5e-4432-8b9f-3af4202b8112 None admin] RBAC: Authorizing `identity:get_user(user_id=034095ad77554819b83324ec8dd53a22)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:22.117597 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc271d-ca5e-4432-8b9f-3af4202b8112 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:22.119087 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 47/86] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:21 2022] GET /identity/v3/users/034095ad77554819b83324ec8dd53a22 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:22.120664 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc271d-ca5e-4432-8b9f-3af4202b8112 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:22.188837 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 40/87] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:24:22.189516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902e859-beb9-48cc-ac62-f6355c8c5d8d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:22.252712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc271d-ca5e-4432-8b9f-3af4202b8112 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:22.296419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbf4b4-9160-4dbf-913d-e35d8ba8e56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:22.297066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbf4b4-9160-4dbf-913d-e35d8ba8e56e None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:22.297445 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbf4b4-9160-4dbf-913d-e35d8ba8e56e None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:22.297728 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbf4b4-9160-4dbf-913d-e35d8ba8e56e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:22.322190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902e859-beb9-48cc-ac62-f6355c8c5d8d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:22.350292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:22.362803 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:22.375659 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbf4b4-9160-4dbf-913d-e35d8ba8e56e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:22.377151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbf4b4-9160-4dbf-913d-e35d8ba8e56e None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:22.378081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b69f17-0cd6-466f-8226-d5291056cf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:22.379523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b69f17-0cd6-466f-8226-d5291056cf64 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:22.380173 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b69f17-0cd6-466f-8226-d5291056cf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:22.380679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b69f17-0cd6-466f-8226-d5291056cf64 None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:22.382954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b69f17-0cd6-466f-8226-d5291056cf64 None admin] RBAC: Authorizing `identity:get_project(project_id=8067a8a77005444fb4e26dc5e9b19761)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:22.384667 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b69f17-0cd6-466f-8226-d5291056cf64 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:22.387127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 41/88] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:22 2022] GET /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:22.388246 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b69f17-0cd6-466f-8226-d5291056cf64 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:22.505314 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 48/89] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:24:22.510025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbf4b4-9160-4dbf-913d-e35d8ba8e56e None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:22.523764 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b69f17-0cd6-466f-8226-d5291056cf64 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:22.571572 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53ae78-b4d7-4a6b-bfe5-91e29bebde15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:22.572825 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53ae78-b4d7-4a6b-bfe5-91e29bebde15 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:22.573118 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53ae78-b4d7-4a6b-bfe5-91e29bebde15 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:22.573397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53ae78-b4d7-4a6b-bfe5-91e29bebde15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:22.607569 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:22.638265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbf4b4-9160-4dbf-913d-e35d8ba8e56e None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:22.652735 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:22.663114 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53ae78-b4d7-4a6b-bfe5-91e29bebde15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:22.664814 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53ae78-b4d7-4a6b-bfe5-91e29bebde15 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:22.684245 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca0eb6-1fee-4583-ad0d-d51353bc749a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:22.685312 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca0eb6-1fee-4583-ad0d-d51353bc749a None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:22.686889 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca0eb6-1fee-4583-ad0d-d51353bc749a None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:22.687374 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca0eb6-1fee-4583-ad0d-d51353bc749a None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:22.688830 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca0eb6-1fee-4583-ad0d-d51353bc749a None admin] RBAC: Authorizing `identity:get_project(project_id=8067a8a77005444fb4e26dc5e9b19761)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:22.692468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca0eb6-1fee-4583-ad0d-d51353bc749a None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:22.695020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 49/90] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:22 2022] GET /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:22.696022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca0eb6-1fee-4583-ad0d-d51353bc749a None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:22.789147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 42/91] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:24:22.790106 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53ae78-b4d7-4a6b-bfe5-91e29bebde15 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:22.845635 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca0eb6-1fee-4583-ad0d-d51353bc749a None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:22.896573 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:22.900172 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43576a1f-b244-48c2-b77e-d3b309f60c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:22.901276 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43576a1f-b244-48c2-b77e-d3b309f60c8b None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:22.901733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43576a1f-b244-48c2-b77e-d3b309f60c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:22.902150 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43576a1f-b244-48c2-b77e-d3b309f60c8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:22.903501 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43576a1f-b244-48c2-b77e-d3b309f60c8b None admin] RBAC: Adding query filter params (role.id=f105208a21c84d4fa134aa0aeb62f3bb, scope.project.id=8067a8a77005444fb4e26dc5e9b19761, user.id=034095ad77554819b83324ec8dd53a22) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:22.903851 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43576a1f-b244-48c2-b77e-d3b309f60c8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:22.905367 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43576a1f-b244-48c2-b77e-d3b309f60c8b None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:22.911415 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53ae78-b4d7-4a6b-bfe5-91e29bebde15 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:22.916658 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 50/92] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:24:22 2022] GET /identity/v3/role_assignments?user.id=034095ad77554819b83324ec8dd53a22&scope.project.id=8067a8a77005444fb4e26dc5e9b19761&role.id=f105208a21c84d4fa134aa0aeb62f3bb => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:22.924930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43576a1f-b244-48c2-b77e-d3b309f60c8b None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:22.953618 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:22.981598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e025f-4d28-4698-93e5-07e4d8a789bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:22.982319 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e025f-4d28-4698-93e5-07e4d8a789bc None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:22.982611 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e025f-4d28-4698-93e5-07e4d8a789bc None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:22.982892 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e025f-4d28-4698-93e5-07e4d8a789bc None admin] PATH_INFO: `/v3/projects/1912f6c229c643cd8d2a4173755bc1ee` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:22.985058 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e025f-4d28-4698-93e5-07e4d8a789bc None admin] RBAC: Authorizing `identity:get_project(project_id=1912f6c229c643cd8d2a4173755bc1ee)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:22.986597 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e025f-4d28-4698-93e5-07e4d8a789bc None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:22.988715 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 43/93] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:22 2022] GET /identity/v3/projects/1912f6c229c643cd8d2a4173755bc1ee => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:22.989359 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e025f-4d28-4698-93e5-07e4d8a789bc None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:23.139392 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43576a1f-b244-48c2-b77e-d3b309f60c8b None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:23.169952 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e025f-4d28-4698-93e5-07e4d8a789bc None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:23.186527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005691c7-07a8-4500-92b7-23a4e334ea43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:23.187610 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005691c7-07a8-4500-92b7-23a4e334ea43 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.187903 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005691c7-07a8-4500-92b7-23a4e334ea43 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.188186 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005691c7-07a8-4500-92b7-23a4e334ea43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.189346 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005691c7-07a8-4500-92b7-23a4e334ea43 None admin] RBAC: Adding query filter params (role.id=4ae8d11d74f14bcc80117d897ba2f5b6, scope.project.id=8067a8a77005444fb4e26dc5e9b19761, user.id=0dc5c37ef1d94f0cacb3f037f735dea7) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:23.189703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005691c7-07a8-4500-92b7-23a4e334ea43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:23.192220 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005691c7-07a8-4500-92b7-23a4e334ea43 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:23.200070 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 51/94] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:24:22 2022] GET /identity/v3/role_assignments?user.id=0dc5c37ef1d94f0cacb3f037f735dea7&scope.project.id=8067a8a77005444fb4e26dc5e9b19761&role.id=4ae8d11d74f14bcc80117d897ba2f5b6 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:23.201294 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005691c7-07a8-4500-92b7-23a4e334ea43 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:23.221619 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33cd48-d6dc-434b-ad86-27d0a0dd4672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:23.222722 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33cd48-d6dc-434b-ad86-27d0a0dd4672 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.223227 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33cd48-d6dc-434b-ad86-27d0a0dd4672 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.223724 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33cd48-d6dc-434b-ad86-27d0a0dd4672 None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.228032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33cd48-d6dc-434b-ad86-27d0a0dd4672 None admin] RBAC: Authorizing `identity:get_project(project_id=8067a8a77005444fb4e26dc5e9b19761)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:23.229788 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33cd48-d6dc-434b-ad86-27d0a0dd4672 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:23.231767 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 44/95] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:22 2022] GET /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:23.237848 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33cd48-d6dc-434b-ad86-27d0a0dd4672 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:23.299829 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:23.307349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:23.336154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005691c7-07a8-4500-92b7-23a4e334ea43 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:23.385735 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0818ccf-a7f1-4cac-8479-df61359435b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:23.390884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0818ccf-a7f1-4cac-8479-df61359435b8 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.390884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0818ccf-a7f1-4cac-8479-df61359435b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.390884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0818ccf-a7f1-4cac-8479-df61359435b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.390884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0818ccf-a7f1-4cac-8479-df61359435b8 None admin] RBAC: Adding query filter params (role.id=f105208a21c84d4fa134aa0aeb62f3bb, scope.project.id=1912f6c229c643cd8d2a4173755bc1ee, user.id=034095ad77554819b83324ec8dd53a22) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:23.390884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0818ccf-a7f1-4cac-8479-df61359435b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:23.390884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0818ccf-a7f1-4cac-8479-df61359435b8 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:23.398502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 52/96] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:24:23 2022] GET /identity/v3/role_assignments?user.id=034095ad77554819b83324ec8dd53a22&scope.project.id=1912f6c229c643cd8d2a4173755bc1ee&role.id=f105208a21c84d4fa134aa0aeb62f3bb => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:23.451559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33cd48-d6dc-434b-ad86-27d0a0dd4672 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:23.500137 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56699fc-1672-498b-99df-c1f2f69befea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:23.501262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56699fc-1672-498b-99df-c1f2f69befea None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.501810 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56699fc-1672-498b-99df-c1f2f69befea None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.502552 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56699fc-1672-498b-99df-c1f2f69befea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.503867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56699fc-1672-498b-99df-c1f2f69befea None admin] RBAC: Adding query filter params (role.id=dd7069600e364802831ce7c375e57fcd, scope.project.id=8067a8a77005444fb4e26dc5e9b19761, user.id=034095ad77554819b83324ec8dd53a22) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:23.505128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56699fc-1672-498b-99df-c1f2f69befea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:23.507833 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56699fc-1672-498b-99df-c1f2f69befea None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:23.520814 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 45/97] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:24:23 2022] GET /identity/v3/role_assignments?user.id=034095ad77554819b83324ec8dd53a22&scope.project.id=8067a8a77005444fb4e26dc5e9b19761&role.id=dd7069600e364802831ce7c375e57fcd => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:24.647353 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570995a-f500-4090-9bb5-f26fd64329ed None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:24.647969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570995a-f500-4090-9bb5-f26fd64329ed None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:24.647969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570995a-f500-4090-9bb5-f26fd64329ed None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:24.649271 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 53/98] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:24.654648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584a015-878f-47c3-9d67-dc938e4eafb7 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:24.655513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584a015-878f-47c3-9d67-dc938e4eafb7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:24.656010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584a015-878f-47c3-9d67-dc938e4eafb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:24.684364 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0584a015-878f-47c3-9d67-dc938e4eafb7 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:24.685911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0584a015-878f-47c3-9d67-dc938e4eafb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:24.777770 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 46/99] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:24.819568 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570995a-f500-4090-9bb5-f26fd64329ed None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:24.972096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570995a-f500-4090-9bb5-f26fd64329ed None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:25.017457 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb7f34-2985-44d1-bc56-9cf08089f7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:25.018113 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb7f34-2985-44d1-bc56-9cf08089f7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.018401 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb7f34-2985-44d1-bc56-9cf08089f7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.018683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb7f34-2985-44d1-bc56-9cf08089f7f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.023971 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb7f34-2985-44d1-bc56-9cf08089f7f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:25.025450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb7f34-2985-44d1-bc56-9cf08089f7f4 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:25.027427 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 54/100] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:24:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:25.032940 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584a015-878f-47c3-9d67-dc938e4eafb7 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:25.057809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92894ab8-84e1-4bdb-baa6-3df271d48709 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.057809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92894ab8-84e1-4bdb-baa6-3df271d48709 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.057809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92894ab8-84e1-4bdb-baa6-3df271d48709 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.057809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 55/101] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:24:25.067589 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714eeb5-6c5a-4aa3-b576-cafe7c05e5e1 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.067922 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714eeb5-6c5a-4aa3-b576-cafe7c05e5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.068168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714eeb5-6c5a-4aa3-b576-cafe7c05e5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.083041 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:25.090284 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:25.102443 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-8714eeb5-6c5a-4aa3-b576-cafe7c05e5e1 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:25.107751 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-8714eeb5-6c5a-4aa3-b576-cafe7c05e5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:25.201199 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584a015-878f-47c3-9d67-dc938e4eafb7 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:25.269045 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 56/102] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:25.294307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82127af-4799-43d0-aeb3-7a50bff74284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:25.294970 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82127af-4799-43d0-aeb3-7a50bff74284 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.295253 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82127af-4799-43d0-aeb3-7a50bff74284 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.295557 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82127af-4799-43d0-aeb3-7a50bff74284 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.296257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82127af-4799-43d0-aeb3-7a50bff74284 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:25.297725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82127af-4799-43d0-aeb3-7a50bff74284 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:25.321511 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714eeb5-6c5a-4aa3-b576-cafe7c05e5e1 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:25.432998 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 47/103] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 18:24:25 2022] POST /identity/v3/projects => generated 302 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:25.448721 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714eeb5-6c5a-4aa3-b576-cafe7c05e5e1 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:25.487452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e1c3c-aec3-4ca1-80a0-1a9aa7139f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:25.488723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e1c3c-aec3-4ca1-80a0-1a9aa7139f6f None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.489176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e1c3c-aec3-4ca1-80a0-1a9aa7139f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.489476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e1c3c-aec3-4ca1-80a0-1a9aa7139f6f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.492772 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:25.502042 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e1c3c-aec3-4ca1-80a0-1a9aa7139f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:25.508623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-4b7e1c3c-aec3-4ca1-80a0-1a9aa7139f6f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:24:25.508623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:25.508623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:25.508623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:25.508623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:25.508623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:25.508623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:25.508623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:25.508623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:25.508623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:25.508623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:25.508623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:25.508623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:25.508623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:25.508623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:25.508623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:25.509548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:25.509548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:25.509548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:25.509548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:25.509548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:25.509548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:25.509548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:25.509548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:25.509548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:25.509548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:25.509548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:25.509548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:25.509548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:25.509548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:25.509548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:25.509548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:25.510397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:25.510397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:25.510397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:25.510397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:25.510397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:25.510397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:25.510397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:25.510397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:25.510397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:25.510397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:25.510397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:24:25.510397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:24:25.510397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 57/104] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:24:25.517000 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82127af-4799-43d0-aeb3-7a50bff74284 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:25.782928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:25.812919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82127af-4799-43d0-aeb3-7a50bff74284 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:25.859347 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcaa27-fc50-4859-829b-e51ac822c519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:25.859988 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcaa27-fc50-4859-829b-e51ac822c519 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.860266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcaa27-fc50-4859-829b-e51ac822c519 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.860542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcaa27-fc50-4859-829b-e51ac822c519 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.861265 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcaa27-fc50-4859-829b-e51ac822c519 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:25.861571 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcaa27-fc50-4859-829b-e51ac822c519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:25.862970 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcaa27-fc50-4859-829b-e51ac822c519 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:25.872248 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 48/105] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:25.879661 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e1c3c-aec3-4ca1-80a0-1a9aa7139f6f None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:26.006900 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5062a78-b0ac-4f24-a12b-d69310138385 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.007299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5062a78-b0ac-4f24-a12b-d69310138385 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.007501 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5062a78-b0ac-4f24-a12b-d69310138385 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.009132 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 49/106] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:26.014627 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a347c3e-5752-48df-a2a3-458f10eaeb75 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.014960 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a347c3e-5752-48df-a2a3-458f10eaeb75 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.015191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a347c3e-5752-48df-a2a3-458f10eaeb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.047512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-4a347c3e-5752-48df-a2a3-458f10eaeb75 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:26.048820 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4a347c3e-5752-48df-a2a3-458f10eaeb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:26.053984 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e1c3c-aec3-4ca1-80a0-1a9aa7139f6f None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:26.112033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986be98-9d01-4361-88dc-dac83023376f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:26.112698 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986be98-9d01-4361-88dc-dac83023376f None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.113030 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986be98-9d01-4361-88dc-dac83023376f None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.113445 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986be98-9d01-4361-88dc-dac83023376f None admin] PATH_INFO: `/v3/users/ff326157b5cc49c597f34a87b4b840f8` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.141080 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986be98-9d01-4361-88dc-dac83023376f None admin] RBAC: Authorizing `identity:get_user(user_id=ff326157b5cc49c597f34a87b4b840f8)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:26.142890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986be98-9d01-4361-88dc-dac83023376f None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:26.146418 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 58/107] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:25 2022] GET /identity/v3/users/ff326157b5cc49c597f34a87b4b840f8 => generated 289 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:26.154617 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986be98-9d01-4361-88dc-dac83023376f None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:26.190194 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 50/108] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:24:26.229764 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a347c3e-5752-48df-a2a3-458f10eaeb75 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:26.244338 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:26.291641 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986be98-9d01-4361-88dc-dac83023376f None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:26.350441 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898f345-74bf-48e6-8eb4-29ce311c15b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:26.351061 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898f345-74bf-48e6-8eb4-29ce311c15b8 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.351558 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898f345-74bf-48e6-8eb4-29ce311c15b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.351891 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898f345-74bf-48e6-8eb4-29ce311c15b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.356610 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:26.404315 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a347c3e-5752-48df-a2a3-458f10eaeb75 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:26.448706 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9f343-9380-4a19-9005-8274b8227f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:26.449619 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9f343-9380-4a19-9005-8274b8227f20 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.449905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9f343-9380-4a19-9005-8274b8227f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.450776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9f343-9380-4a19-9005-8274b8227f20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.452550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898f345-74bf-48e6-8eb4-29ce311c15b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:26.454041 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898f345-74bf-48e6-8eb4-29ce311c15b8 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:26.464735 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9f343-9380-4a19-9005-8274b8227f20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:26.472023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-abf9f343-9380-4a19-9005-8274b8227f20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:26.472023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:26.472023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:26.472023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:26.472023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:26.472023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:26.472023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:26.472023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:26.472023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:26.472023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:26.472023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:26.472023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:26.472023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:26.472023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:26.472023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:26.472023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:26.473476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:26.473476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:26.473476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:26.473476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:26.473476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:26.473476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:26.473476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:26.473476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:26.473476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:26.473476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:26.473476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:26.473476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:26.473476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:26.473476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:26.473476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:26.473476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:26.474361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:26.474361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:26.474361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:26.474361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:26.474361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:26.474361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:26.474361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:26.474361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:26.474361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:26.474361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:26.474361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:26.474361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:24:26.475565 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 51/109] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:26.478247 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a2450-805d-4bda-8e44-906431cfd898 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.478247 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a2450-805d-4bda-8e44-906431cfd898 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.478247 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a2450-805d-4bda-8e44-906431cfd898 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.478247 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 52/110] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:26.479092 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df32bf-70ec-42f1-8a1d-f359e217a7f1 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.483650 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df32bf-70ec-42f1-8a1d-f359e217a7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.483947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df32bf-70ec-42f1-8a1d-f359e217a7f1 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.485457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 53/111] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:26.486076 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df32bf-70ec-42f1-8a1d-f359e217a7f1 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:26.526884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:26.579301 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 59/112] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:24:26.580731 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f91ae-1b75-47c0-a600-26b20a8c6fee None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.580959 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f91ae-1b75-47c0-a600-26b20a8c6fee None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.581245 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f91ae-1b75-47c0-a600-26b20a8c6fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.601323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-cf3f91ae-1b75-47c0-a600-26b20a8c6fee None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:26.602471 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-cf3f91ae-1b75-47c0-a600-26b20a8c6fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:26.636633 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df32bf-70ec-42f1-8a1d-f359e217a7f1 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:26.670692 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:26.685686 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763a59b-e638-498d-9ce5-2fc9cbb487c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:26.687095 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763a59b-e638-498d-9ce5-2fc9cbb487c8 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.688404 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763a59b-e638-498d-9ce5-2fc9cbb487c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.689311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763a59b-e638-498d-9ce5-2fc9cbb487c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.691007 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763a59b-e638-498d-9ce5-2fc9cbb487c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:26.691917 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763a59b-e638-498d-9ce5-2fc9cbb487c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:26.694536 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763a59b-e638-498d-9ce5-2fc9cbb487c8 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:26.702522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 60/113] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:26.704116 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54019a-48a3-4c64-92f6-81d572b903f1 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.704514 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54019a-48a3-4c64-92f6-81d572b903f1 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.704902 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54019a-48a3-4c64-92f6-81d572b903f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.707815 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 54/114] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:26.709113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763a59b-e638-498d-9ce5-2fc9cbb487c8 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:26.729682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-bb54019a-48a3-4c64-92f6-81d572b903f1 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:26.730994 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-bb54019a-48a3-4c64-92f6-81d572b903f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:26.807618 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 61/115] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:26.807618 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54019a-48a3-4c64-92f6-81d572b903f1 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:26.827445 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:26.833190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763a59b-e638-498d-9ce5-2fc9cbb487c8 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:26.869897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c3ae2-215e-456d-904c-63adb3bc2519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:26.870490 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c3ae2-215e-456d-904c-63adb3bc2519 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.870754 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c3ae2-215e-456d-904c-63adb3bc2519 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.871031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c3ae2-215e-456d-904c-63adb3bc2519 None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.872228 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c3ae2-215e-456d-904c-63adb3bc2519 None admin] RBAC: Authorizing `identity:get_project(project_id=8067a8a77005444fb4e26dc5e9b19761)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:26.873703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c3ae2-215e-456d-904c-63adb3bc2519 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:26.875411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 55/116] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:26 2022] GET /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:26.876181 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c3ae2-215e-456d-904c-63adb3bc2519 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:26.922297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54019a-48a3-4c64-92f6-81d572b903f1 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:26.939195 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:26.959477 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dc057-4216-4671-bcb4-a22414615671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:26.960192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dc057-4216-4671-bcb4-a22414615671 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.960488 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dc057-4216-4671-bcb4-a22414615671 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.960773 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dc057-4216-4671-bcb4-a22414615671 None admin] PATH_INFO: `/v3/users/034095ad77554819b83324ec8dd53a22` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.962054 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dc057-4216-4671-bcb4-a22414615671 None admin] RBAC: Authorizing `identity:get_user(user_id=034095ad77554819b83324ec8dd53a22)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:26.963881 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dc057-4216-4671-bcb4-a22414615671 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:26.965207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 62/117] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:26 2022] GET /identity/v3/users/034095ad77554819b83324ec8dd53a22 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:26.966523 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf483198-0cee-4ce9-b384-94e7ef95dfe2 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.966813 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf483198-0cee-4ce9-b384-94e7ef95dfe2 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.967088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf483198-0cee-4ce9-b384-94e7ef95dfe2 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.971568 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 63/118] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:26.971568 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf483198-0cee-4ce9-b384-94e7ef95dfe2 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:26.995740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c3ae2-215e-456d-904c-63adb3bc2519 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:27.038957 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def086b-0832-44da-b5a3-2b37cd5cfa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:27.039638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def086b-0832-44da-b5a3-2b37cd5cfa4a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:27.039926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def086b-0832-44da-b5a3-2b37cd5cfa4a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:27.040205 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def086b-0832-44da-b5a3-2b37cd5cfa4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:27.051150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def086b-0832-44da-b5a3-2b37cd5cfa4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:27.056578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-7def086b-0832-44da-b5a3-2b37cd5cfa4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:24:27.056578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:27.056578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:27.056578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:27.056578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:27.056578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:27.056578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:27.056578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:27.056578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:27.056578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:27.056578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:27.056578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:27.056578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:27.056578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:27.056578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:27.056578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:27.057588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:27.057588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:27.057588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:27.057588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:27.057588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:27.057588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:27.057588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:27.057588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:27.057588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:27.057588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:27.057588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:27.057588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:27.057588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:27.057588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:27.057588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:27.057588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:27.058524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:27.058524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:27.058524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:27.058524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:27.058524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:27.058524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:27.058524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:27.058524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:27.058524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:27.058524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:27.058524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:24:27.058524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:24:27.058524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 56/119] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:24:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:27.059324 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def086b-0832-44da-b5a3-2b37cd5cfa4a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:27.080039 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:27.104767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf483198-0cee-4ce9-b384-94e7ef95dfe2 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:27.146173 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdedbfb-f2b1-40b3-8fa6-de465c9c5e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:27.146835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdedbfb-f2b1-40b3-8fa6-de465c9c5e8f None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:27.147118 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdedbfb-f2b1-40b3-8fa6-de465c9c5e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:27.147427 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdedbfb-f2b1-40b3-8fa6-de465c9c5e8f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:27.157992 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdedbfb-f2b1-40b3-8fa6-de465c9c5e8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:27.163003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-abdedbfb-f2b1-40b3-8fa6-de465c9c5e8f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:24:27.163003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:27.163003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:27.163003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:27.163003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:27.163003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:27.163003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:27.163003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:27.163003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:27.163003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:27.163003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:27.163003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:27.163003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:27.163003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:27.163003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:27.163003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:27.163925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:27.163925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:27.163925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:27.163925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:27.163925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:27.163925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:27.163925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:27.163925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:27.163925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:27.163925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:27.163925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:27.163925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:27.163925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:27.163925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:27.163925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:27.163925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:27.164699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:27.164699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:27.164699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:27.164699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:27.164699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:27.164699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:27.164699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:27.164699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:27.164699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:27.164699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:27.164699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:24:27.164699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:24:27.164699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 64/120] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 18:24:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:27.165353 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdedbfb-f2b1-40b3-8fa6-de465c9c5e8f None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:27.178300 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def086b-0832-44da-b5a3-2b37cd5cfa4a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:27.198159 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:27.217147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bde19-c1a2-400b-9074-195ac148d9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:27.217801 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bde19-c1a2-400b-9074-195ac148d9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:27.218096 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bde19-c1a2-400b-9074-195ac148d9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:27.218385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bde19-c1a2-400b-9074-195ac148d9b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:27.219199 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50bde19-c1a2-400b-9074-195ac148d9b1 None admin] RBAC: Adding query filter params (role.id=27bb3ae43da44e3a87a409e5adae712c, scope.project.id=8067a8a77005444fb4e26dc5e9b19761, user.id=ff326157b5cc49c597f34a87b4b840f8) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:27.219552 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50bde19-c1a2-400b-9074-195ac148d9b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:27.221036 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50bde19-c1a2-400b-9074-195ac148d9b1 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:27.226562 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 57/121] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:24:27 2022] GET /identity/v3/role_assignments?user.id=ff326157b5cc49c597f34a87b4b840f8&scope.project.id=8067a8a77005444fb4e26dc5e9b19761&role.id=27bb3ae43da44e3a87a409e5adae712c => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:27.227938 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51546af-2871-444b-8890-20a3b050a38c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:27.228237 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51546af-2871-444b-8890-20a3b050a38c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:27.228519 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51546af-2871-444b-8890-20a3b050a38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:27.263395 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a51546af-2871-444b-8890-20a3b050a38c None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:27.265258 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a51546af-2871-444b-8890-20a3b050a38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:27.289446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdedbfb-f2b1-40b3-8fa6-de465c9c5e8f None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:27.345106 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c35af-7cd8-400e-a98f-93b4fc593be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:27.346212 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c35af-7cd8-400e-a98f-93b4fc593be6 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:27.346701 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c35af-7cd8-400e-a98f-93b4fc593be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:27.347222 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c35af-7cd8-400e-a98f-93b4fc593be6 None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:27.349863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c35af-7cd8-400e-a98f-93b4fc593be6 None admin] RBAC: Authorizing `identity:get_project(project_id=8067a8a77005444fb4e26dc5e9b19761)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:27.352024 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c35af-7cd8-400e-a98f-93b4fc593be6 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:27.354641 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 65/122] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:27 2022] GET /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:27.355887 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c35af-7cd8-400e-a98f-93b4fc593be6 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:27.367335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 58/123] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:27.368325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51546af-2871-444b-8890-20a3b050a38c None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:27.386281 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:27.507079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c35af-7cd8-400e-a98f-93b4fc593be6 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:27.522675 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51546af-2871-444b-8890-20a3b050a38c None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:27.542810 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:27.566908 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7704c-b019-4f95-8ab1-6da7e09b46bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:27.567954 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7704c-b019-4f95-8ab1-6da7e09b46bd None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:27.568447 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7704c-b019-4f95-8ab1-6da7e09b46bd None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:27.568939 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7704c-b019-4f95-8ab1-6da7e09b46bd None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:27.569896 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7704c-b019-4f95-8ab1-6da7e09b46bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:27.570408 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7704c-b019-4f95-8ab1-6da7e09b46bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:27.572242 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7704c-b019-4f95-8ab1-6da7e09b46bd None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:27.577298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f6ec6-5fa2-4f06-964b-aa964086af0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:27.577935 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f6ec6-5fa2-4f06-964b-aa964086af0f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:27.578220 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f6ec6-5fa2-4f06-964b-aa964086af0f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:27.578498 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f6ec6-5fa2-4f06-964b-aa964086af0f None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:27.579277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f6ec6-5fa2-4f06-964b-aa964086af0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:27.580231 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f6ec6-5fa2-4f06-964b-aa964086af0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:27.582044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f6ec6-5fa2-4f06-964b-aa964086af0f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:27.583864 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 66/124] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:27.585079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7704c-b019-4f95-8ab1-6da7e09b46bd None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:27.593199 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 59/125] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:24:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:27.598617 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f6ec6-5fa2-4f06-964b-aa964086af0f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:27.673254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:27.709082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7704c-b019-4f95-8ab1-6da7e09b46bd None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:27.730063 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f6ec6-5fa2-4f06-964b-aa964086af0f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:27.750127 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a95a42-0276-4665-8487-8ca75a95e0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:27.751209 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a95a42-0276-4665-8487-8ca75a95e0ca None admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:27.752265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a95a42-0276-4665-8487-8ca75a95e0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:27.752656 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a95a42-0276-4665-8487-8ca75a95e0ca None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761/users/034095ad77554819b83324ec8dd53a22/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:27.755740 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a95a42-0276-4665-8487-8ca75a95e0ca None admin] RBAC: Authorizing `identity:create_grant(project_id=8067a8a77005444fb4e26dc5e9b19761, user_id=034095ad77554819b83324ec8dd53a22, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:27.757704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a95a42-0276-4665-8487-8ca75a95e0ca None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:27.771442 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6c7a0-02be-40f1-a502-140e6a75226d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:27.772102 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6c7a0-02be-40f1-a502-140e6a75226d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:27.772388 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6c7a0-02be-40f1-a502-140e6a75226d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:27.772668 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6c7a0-02be-40f1-a502-140e6a75226d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:27.783536 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6c7a0-02be-40f1-a502-140e6a75226d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:27.789765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-34c6c7a0-02be-40f1-a502-140e6a75226d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:27.789765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:27.789765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:27.789765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:27.789765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:27.789765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:27.789765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:27.789765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:27.789765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:27.789765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:27.789765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:27.789765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:27.789765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:27.789765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:27.789765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:27.789765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:27.790798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:27.790798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:27.790798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:27.790798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:27.790798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:27.790798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:27.790798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:27.790798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:27.790798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:27.790798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:27.790798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:27.790798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:27.790798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:27.790798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:27.790798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:27.790798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:27.791614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:27.791614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:27.791614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:27.791614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:27.791614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:27.791614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:27.791614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:27.791614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:27.791614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:27.791614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:27.791614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:27.791614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:24:27.791614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 60/126] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:27.792310 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6c7a0-02be-40f1-a502-140e6a75226d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:27.825096 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:27.866995 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 67/127] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:24:27 2022] PUT /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761/users/034095ad77554819b83324ec8dd53a22/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:27.869138 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a95a42-0276-4665-8487-8ca75a95e0ca None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:27.926360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6c7a0-02be-40f1-a502-140e6a75226d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:28.009141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2759e6a-4943-4f8e-aa6c-f76948cb56ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:28.009732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2759e6a-4943-4f8e-aa6c-f76948cb56ee None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:28.010017 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2759e6a-4943-4f8e-aa6c-f76948cb56ee None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:28.010296 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2759e6a-4943-4f8e-aa6c-f76948cb56ee None admin] PATH_INFO: `/v3/users/0dc5c37ef1d94f0cacb3f037f735dea7` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:28.010524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a95a42-0276-4665-8487-8ca75a95e0ca None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:28.011543 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2759e6a-4943-4f8e-aa6c-f76948cb56ee None admin] RBAC: Authorizing `identity:get_user(user_id=0dc5c37ef1d94f0cacb3f037f735dea7)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:28.013033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2759e6a-4943-4f8e-aa6c-f76948cb56ee None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:28.014851 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 61/128] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:27 2022] GET /identity/v3/users/0dc5c37ef1d94f0cacb3f037f735dea7 => generated 247 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:28.015456 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2759e6a-4943-4f8e-aa6c-f76948cb56ee None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:28.053578 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:28.060904 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fb091-7789-4a6e-840c-a8a6c2957f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:28.061967 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fb091-7789-4a6e-840c-a8a6c2957f83 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:28.062522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fb091-7789-4a6e-840c-a8a6c2957f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:28.062957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fb091-7789-4a6e-840c-a8a6c2957f83 None admin] PATH_INFO: `/v3/users/034095ad77554819b83324ec8dd53a22` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:28.064371 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fb091-7789-4a6e-840c-a8a6c2957f83 None admin] RBAC: Authorizing `identity:get_user(user_id=034095ad77554819b83324ec8dd53a22)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:28.066259 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fb091-7789-4a6e-840c-a8a6c2957f83 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:28.072097 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 68/129] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:27 2022] GET /identity/v3/users/034095ad77554819b83324ec8dd53a22 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:28.078361 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fb091-7789-4a6e-840c-a8a6c2957f83 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:28.202513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2759e6a-4943-4f8e-aa6c-f76948cb56ee None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:28.218386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:28.225013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fb091-7789-4a6e-840c-a8a6c2957f83 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:28.248967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d615b-e407-4656-a84b-0d042ad81484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:28.249740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d615b-e407-4656-a84b-0d042ad81484 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:28.250120 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d615b-e407-4656-a84b-0d042ad81484 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:28.250540 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d615b-e407-4656-a84b-0d042ad81484 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:28.251558 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d615b-e407-4656-a84b-0d042ad81484 None admin] RBAC: Adding query filter params (name=member) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:28.251949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d615b-e407-4656-a84b-0d042ad81484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:28.255225 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d615b-e407-4656-a84b-0d042ad81484 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:28.266002 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19a299-0653-4d87-8139-261da3bed64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:28.267426 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19a299-0653-4d87-8139-261da3bed64b None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:28.268133 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19a299-0653-4d87-8139-261da3bed64b None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:28.268571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19a299-0653-4d87-8139-261da3bed64b None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:28.270047 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19a299-0653-4d87-8139-261da3bed64b None admin] RBAC: Authorizing `identity:get_project(project_id=8067a8a77005444fb4e26dc5e9b19761)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:28.275404 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 62/130] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:28.275404 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d615b-e407-4656-a84b-0d042ad81484 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:28.276659 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19a299-0653-4d87-8139-261da3bed64b None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:28.278742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 69/131] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:28 2022] GET /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:28.279818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32580326-f167-40ba-9194-9b0e06947983 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:28.280176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32580326-f167-40ba-9194-9b0e06947983 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:28.280460 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32580326-f167-40ba-9194-9b0e06947983 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:28.281915 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 70/132] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:28.282628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32580326-f167-40ba-9194-9b0e06947983 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:28.365466 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:28.390379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d615b-e407-4656-a84b-0d042ad81484 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:28.408241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32580326-f167-40ba-9194-9b0e06947983 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:28.431309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448566d9-7a9c-4a3c-97ee-5de73e3315df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:28.431977 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448566d9-7a9c-4a3c-97ee-5de73e3315df None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:28.432263 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448566d9-7a9c-4a3c-97ee-5de73e3315df None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:28.432541 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448566d9-7a9c-4a3c-97ee-5de73e3315df None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:28.433816 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448566d9-7a9c-4a3c-97ee-5de73e3315df None admin] RBAC: Authorizing `identity:get_project(project_id=8067a8a77005444fb4e26dc5e9b19761)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:28.435745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448566d9-7a9c-4a3c-97ee-5de73e3315df None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:28.437316 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 63/133] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:28 2022] GET /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:28.438071 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448566d9-7a9c-4a3c-97ee-5de73e3315df None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:28.461811 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa428c81-99f6-4e4b-af46-c92ba560d3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:28.462478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa428c81-99f6-4e4b-af46-c92ba560d3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:28.462766 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa428c81-99f6-4e4b-af46-c92ba560d3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:28.463044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa428c81-99f6-4e4b-af46-c92ba560d3e2 None admin] PATH_INFO: `/v3/users/034095ad77554819b83324ec8dd53a22` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:28.464833 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa428c81-99f6-4e4b-af46-c92ba560d3e2 None admin] RBAC: Authorizing `identity:get_user(user_id=034095ad77554819b83324ec8dd53a22)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:28.466553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa428c81-99f6-4e4b-af46-c92ba560d3e2 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:28.468685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 71/134] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:28 2022] GET /identity/v3/users/034095ad77554819b83324ec8dd53a22 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:28.469849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0557d7e-d240-496c-af12-b13c20ddb5f9 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:28.470131 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0557d7e-d240-496c-af12-b13c20ddb5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:28.470408 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0557d7e-d240-496c-af12-b13c20ddb5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:28.489627 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:28.494395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-e0557d7e-d240-496c-af12-b13c20ddb5f9 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:28.495860 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e0557d7e-d240-496c-af12-b13c20ddb5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:28.571283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448566d9-7a9c-4a3c-97ee-5de73e3315df None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:28.589602 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 72/135] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:28.590715 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0557d7e-d240-496c-af12-b13c20ddb5f9 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:28.622399 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a7363-36eb-4d38-b1d1-de8d4523ae40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:28.623127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a7363-36eb-4d38-b1d1-de8d4523ae40 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:28.623427 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a7363-36eb-4d38-b1d1-de8d4523ae40 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:28.623704 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a7363-36eb-4d38-b1d1-de8d4523ae40 None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761/users/0dc5c37ef1d94f0cacb3f037f735dea7/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:28.627943 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a7363-36eb-4d38-b1d1-de8d4523ae40 None admin] RBAC: Authorizing `identity:create_grant(project_id=8067a8a77005444fb4e26dc5e9b19761, user_id=0dc5c37ef1d94f0cacb3f037f735dea7, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:28.630020 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a7363-36eb-4d38-b1d1-de8d4523ae40 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:28.664234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:28.699181 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0557d7e-d240-496c-af12-b13c20ddb5f9 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:28.726230 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 64/136] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:24:28 2022] PUT /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761/users/0dc5c37ef1d94f0cacb3f037f735dea7/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:28.727986 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a7363-36eb-4d38-b1d1-de8d4523ae40 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:28.747800 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936139a-dd2c-488a-8d0f-0073dcc141b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:28.750065 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936139a-dd2c-488a-8d0f-0073dcc141b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:28.751568 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936139a-dd2c-488a-8d0f-0073dcc141b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:28.752400 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936139a-dd2c-488a-8d0f-0073dcc141b6 None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761/users/034095ad77554819b83324ec8dd53a22/roles/dd7069600e364802831ce7c375e57fcd` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:28.760143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936139a-dd2c-488a-8d0f-0073dcc141b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8067a8a77005444fb4e26dc5e9b19761, user_id=034095ad77554819b83324ec8dd53a22, role_id=dd7069600e364802831ce7c375e57fcd)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:28.763250 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936139a-dd2c-488a-8d0f-0073dcc141b6 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:28.866591 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:28.879209 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 73/137] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:24:28 2022] PUT /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761/users/034095ad77554819b83324ec8dd53a22/roles/dd7069600e364802831ce7c375e57fcd => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:28.880545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936139a-dd2c-488a-8d0f-0073dcc141b6 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:28.895145 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a7363-36eb-4d38-b1d1-de8d4523ae40 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:28.961517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a9ac7-8b85-4cab-97c5-b4ca25fa2220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:28.963127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a9ac7-8b85-4cab-97c5-b4ca25fa2220 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:28.963658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a9ac7-8b85-4cab-97c5-b4ca25fa2220 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:28.964156 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a9ac7-8b85-4cab-97c5-b4ca25fa2220 None admin] PATH_INFO: `/v3/projects/1912f6c229c643cd8d2a4173755bc1ee` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:28.965701 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a9ac7-8b85-4cab-97c5-b4ca25fa2220 None admin] RBAC: Authorizing `identity:get_project(project_id=1912f6c229c643cd8d2a4173755bc1ee)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:28.967638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a9ac7-8b85-4cab-97c5-b4ca25fa2220 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:28.969932 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 65/138] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:28 2022] GET /identity/v3/projects/1912f6c229c643cd8d2a4173755bc1ee => generated 312 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:28.976167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a9ac7-8b85-4cab-97c5-b4ca25fa2220 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:29.077796 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936139a-dd2c-488a-8d0f-0073dcc141b6 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:29.136324 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:29.159456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60960bda-d570-44ba-a613-28f294634be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:29.160703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60960bda-d570-44ba-a613-28f294634be1 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:29.161192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60960bda-d570-44ba-a613-28f294634be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:29.161707 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60960bda-d570-44ba-a613-28f294634be1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:29.164185 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60960bda-d570-44ba-a613-28f294634be1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:29.165753 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60960bda-d570-44ba-a613-28f294634be1 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:29.168064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 74/139] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:24:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:29.182585 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60960bda-d570-44ba-a613-28f294634be1 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:29.230116 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a9ac7-8b85-4cab-97c5-b4ca25fa2220 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:29.288763 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fe91f-9874-482f-a69c-acaecdca0f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:29.289468 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fe91f-9874-482f-a69c-acaecdca0f05 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:29.289761 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fe91f-9874-482f-a69c-acaecdca0f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:29.290047 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fe91f-9874-482f-a69c-acaecdca0f05 None admin] PATH_INFO: `/v3/projects/1912f6c229c643cd8d2a4173755bc1ee/users/034095ad77554819b83324ec8dd53a22/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:29.292117 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fe91f-9874-482f-a69c-acaecdca0f05 None admin] RBAC: Authorizing `identity:create_grant(project_id=1912f6c229c643cd8d2a4173755bc1ee, user_id=034095ad77554819b83324ec8dd53a22, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:29.293612 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fe91f-9874-482f-a69c-acaecdca0f05 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:29.391792 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60960bda-d570-44ba-a613-28f294634be1 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:29.397575 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 66/140] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:24:28 2022] PUT /identity/v3/projects/1912f6c229c643cd8d2a4173755bc1ee/users/034095ad77554819b83324ec8dd53a22/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:24:29.438268 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68490d40-ad81-4ca5-b69d-4832155ddb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:29.438969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68490d40-ad81-4ca5-b69d-4832155ddb15 None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:29.439283 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68490d40-ad81-4ca5-b69d-4832155ddb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:29.439599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68490d40-ad81-4ca5-b69d-4832155ddb15 None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:29.440473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68490d40-ad81-4ca5-b69d-4832155ddb15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:29.442333 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68490d40-ad81-4ca5-b69d-4832155ddb15 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:29.575049 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 75/141] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 18:24:29 2022] POST /identity/v3/users => generated 283 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:24:29.706474 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f7d1a-092f-47c4-b49c-1dfb02877550 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:29.707391 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f7d1a-092f-47c4-b49c-1dfb02877550 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:29.707615 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f7d1a-092f-47c4-b49c-1dfb02877550 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:29.709050 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 67/142] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:29.716156 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4bb1c-f095-45ea-8a52-ce81215be763 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:29.716156 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4bb1c-f095-45ea-8a52-ce81215be763 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:29.716156 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4bb1c-f095-45ea-8a52-ce81215be763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:29.736126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-5aa4bb1c-f095-45ea-8a52-ce81215be763 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:29.737351 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5aa4bb1c-f095-45ea-8a52-ce81215be763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:29.793468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:29.814120 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 76/143] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:29.854420 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f7d1a-092f-47c4-b49c-1dfb02877550 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:29.882025 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:29.991180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f7d1a-092f-47c4-b49c-1dfb02877550 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:30.038892 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bfbb0-e9c2-4b91-9f1f-bfb6a91fc3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:30.039638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bfbb0-e9c2-4b91-9f1f-bfb6a91fc3aa None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:30.039926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bfbb0-e9c2-4b91-9f1f-bfb6a91fc3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:30.040255 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bfbb0-e9c2-4b91-9f1f-bfb6a91fc3aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:30.055544 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bfbb0-e9c2-4b91-9f1f-bfb6a91fc3aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:30.061279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-264bfbb0-e9c2-4b91-9f1f-bfb6a91fc3aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:24:30.061279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:30.061279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:30.061279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:30.061279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:30.061279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:30.061279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:30.061279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:30.061279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:30.061279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:30.061279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:30.061279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:30.061279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:30.061279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:30.061279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:30.061279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:30.062119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:30.062119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:30.062119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:30.062119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:30.062119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:30.062119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:30.062119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:30.062119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:30.062119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:30.062119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:30.062119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:30.062119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:30.062119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:30.062119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:30.062119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:30.062119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:30.062904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:30.062904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:30.062904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:30.062904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:30.062904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:30.062904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:30.062904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:30.062904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:30.062904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:30.062904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:30.062904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:24:30.062904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:24:30.062904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 68/144] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:30.069144 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4bb1c-f095-45ea-8a52-ce81215be763 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:30.176709 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4bb1c-f095-45ea-8a52-ce81215be763 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:30.212766 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6f532-55a9-4d4e-b4e8-ca664ff85cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:30.213415 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6f532-55a9-4d4e-b4e8-ca664ff85cca None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:30.213702 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6f532-55a9-4d4e-b4e8-ca664ff85cca None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:30.213982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6f532-55a9-4d4e-b4e8-ca664ff85cca None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:30.214714 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6f532-55a9-4d4e-b4e8-ca664ff85cca None admin] RBAC: Adding query filter params (name=reader) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:30.215021 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6f532-55a9-4d4e-b4e8-ca664ff85cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:30.216450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6f532-55a9-4d4e-b4e8-ca664ff85cca None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:30.225641 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 77/145] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:30.231825 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bfbb0-e9c2-4b91-9f1f-bfb6a91fc3aa None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:30.268848 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80adc5-5cea-48d9-8fbd-76fa0c122e65 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:30.269220 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80adc5-5cea-48d9-8fbd-76fa0c122e65 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:30.269589 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80adc5-5cea-48d9-8fbd-76fa0c122e65 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:30.270852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 78/146] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:24:30.276556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2662f-ca0a-4713-b051-1eb0d3a45b7a None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:30.276842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2662f-ca0a-4713-b051-1eb0d3a45b7a None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:30.277120 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2662f-ca0a-4713-b051-1eb0d3a45b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:30.296575 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-6fb2662f-ca0a-4713-b051-1eb0d3a45b7a None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:30.297802 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-6fb2662f-ca0a-4713-b051-1eb0d3a45b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:30.335254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:30.341586 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:30.368947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bfbb0-e9c2-4b91-9f1f-bfb6a91fc3aa None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:30.394772 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 79/147] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:24:30.426566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72e9a0-9d90-4679-9a89-c77f5db51d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:30.429541 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72e9a0-9d90-4679-9a89-c77f5db51d50 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:30.429981 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72e9a0-9d90-4679-9a89-c77f5db51d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:30.430404 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72e9a0-9d90-4679-9a89-c77f5db51d50 None admin] PATH_INFO: `/v3/users/ff326157b5cc49c597f34a87b4b840f8` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:30.431853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72e9a0-9d90-4679-9a89-c77f5db51d50 None admin] RBAC: Authorizing `identity:get_user(user_id=ff326157b5cc49c597f34a87b4b840f8)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:30.433521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72e9a0-9d90-4679-9a89-c77f5db51d50 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:30.435412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 69/148] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:30 2022] GET /identity/v3/users/ff326157b5cc49c597f34a87b4b840f8 => generated 289 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:30.442009 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2662f-ca0a-4713-b051-1eb0d3a45b7a None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:30.449559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72e9a0-9d90-4679-9a89-c77f5db51d50 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:30.598415 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72e9a0-9d90-4679-9a89-c77f5db51d50 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:30.637642 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e8a27-90c4-400e-9355-1128732ff7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:30.638310 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e8a27-90c4-400e-9355-1128732ff7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:30.638595 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e8a27-90c4-400e-9355-1128732ff7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:30.638873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e8a27-90c4-400e-9355-1128732ff7d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:30.651672 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e8a27-90c4-400e-9355-1128732ff7d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:30.657517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-764e8a27-90c4-400e-9355-1128732ff7d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:30.657517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:30.657517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:30.657517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:30.657517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:30.657517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:30.657517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:30.657517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:30.657517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:30.657517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:30.657517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:30.657517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:30.657517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:30.657517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:30.657517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:30.657517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:30.658429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:30.658429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:30.658429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:30.658429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:30.658429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:30.658429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:30.658429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:30.658429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:30.658429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:30.658429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:30.658429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:30.658429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:30.658429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:30.658429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:30.658429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:30.658429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:30.659563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:30.659563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:30.659563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:30.659563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:30.659563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:30.659563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:30.659563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:30.659563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:30.659563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:30.659563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:30.659563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:30.659563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:24:30.659563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 70/149] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:24:30.664716 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e8a27-90c4-400e-9355-1128732ff7d2 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:30.674203 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:30.718249 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2662f-ca0a-4713-b051-1eb0d3a45b7a None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:30.779990 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e8a27-90c4-400e-9355-1128732ff7d2 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:30.791506 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5c40d-4763-44b5-8f41-4a41d7cb82ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:30.792532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5c40d-4763-44b5-8f41-4a41d7cb82ad None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:30.792817 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5c40d-4763-44b5-8f41-4a41d7cb82ad None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:30.793095 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5c40d-4763-44b5-8f41-4a41d7cb82ad None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:30.800204 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5c40d-4763-44b5-8f41-4a41d7cb82ad None admin] RBAC: Authorizing `identity:get_project(project_id=8067a8a77005444fb4e26dc5e9b19761)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:30.802585 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5c40d-4763-44b5-8f41-4a41d7cb82ad None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:30.804508 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 80/150] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:30 2022] GET /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761 => generated 298 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:30.810238 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5c40d-4763-44b5-8f41-4a41d7cb82ad None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:30.819086 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d93f4-b1b2-4a5d-8caa-446fc655657a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:30.819773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d93f4-b1b2-4a5d-8caa-446fc655657a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:30.820060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d93f4-b1b2-4a5d-8caa-446fc655657a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:30.820337 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d93f4-b1b2-4a5d-8caa-446fc655657a None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:30.821091 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d93f4-b1b2-4a5d-8caa-446fc655657a None admin] RBAC: Adding query filter params (name=member) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:30.821400 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d93f4-b1b2-4a5d-8caa-446fc655657a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:30.822821 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d93f4-b1b2-4a5d-8caa-446fc655657a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:30.832199 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 71/151] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:30.844627 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d93f4-b1b2-4a5d-8caa-446fc655657a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:30.916280 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:30.939682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:30.992310 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d93f4-b1b2-4a5d-8caa-446fc655657a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:30.993886 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5c40d-4763-44b5-8f41-4a41d7cb82ad None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:31.034093 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259ae57-0b18-4d07-b35a-6fbe7689e43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:31.034936 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259ae57-0b18-4d07-b35a-6fbe7689e43b None admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:31.035174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259ae57-0b18-4d07-b35a-6fbe7689e43b None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:31.035433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259ae57-0b18-4d07-b35a-6fbe7689e43b None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761/users/ff326157b5cc49c597f34a87b4b840f8/roles/27bb3ae43da44e3a87a409e5adae712c` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:31.037528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259ae57-0b18-4d07-b35a-6fbe7689e43b None admin] RBAC: Authorizing `identity:create_grant(project_id=8067a8a77005444fb4e26dc5e9b19761, user_id=ff326157b5cc49c597f34a87b4b840f8, role_id=27bb3ae43da44e3a87a409e5adae712c)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:31.038999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259ae57-0b18-4d07-b35a-6fbe7689e43b None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:31.044019 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a4e2d-de57-44e3-8fb0-e29ddf935773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:31.044698 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a4e2d-de57-44e3-8fb0-e29ddf935773 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:31.044993 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a4e2d-de57-44e3-8fb0-e29ddf935773 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:31.045276 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a4e2d-de57-44e3-8fb0-e29ddf935773 None admin] PATH_INFO: `/v3/users/034095ad77554819b83324ec8dd53a22` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:31.047370 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a4e2d-de57-44e3-8fb0-e29ddf935773 None admin] RBAC: Authorizing `identity:get_user(user_id=034095ad77554819b83324ec8dd53a22)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:31.048873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a4e2d-de57-44e3-8fb0-e29ddf935773 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:31.055362 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 72/152] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:30 2022] GET /identity/v3/users/034095ad77554819b83324ec8dd53a22 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:31.056842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a4e2d-de57-44e3-8fb0-e29ddf935773 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:31.132944 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 81/153] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:24:30 2022] PUT /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761/users/ff326157b5cc49c597f34a87b4b840f8/roles/27bb3ae43da44e3a87a409e5adae712c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:31.173629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a4e2d-de57-44e3-8fb0-e29ddf935773 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:31.212743 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0126a6-a284-4707-914c-3e2ce5128c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:31.213443 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0126a6-a284-4707-914c-3e2ce5128c44 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:31.213729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0126a6-a284-4707-914c-3e2ce5128c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:31.214006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0126a6-a284-4707-914c-3e2ce5128c44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:31.218845 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:31.302556 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0126a6-a284-4707-914c-3e2ce5128c44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:31.304135 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0126a6-a284-4707-914c-3e2ce5128c44 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:31.415907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 73/154] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 18:24:31.421636 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259ae57-0b18-4d07-b35a-6fbe7689e43b None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:31.559239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:31.567338 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259ae57-0b18-4d07-b35a-6fbe7689e43b None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:31.609694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06907d37-04b6-400f-a47d-d5bf57ce205d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:31.610504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06907d37-04b6-400f-a47d-d5bf57ce205d None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:31.611200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06907d37-04b6-400f-a47d-d5bf57ce205d None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:31.611569 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06907d37-04b6-400f-a47d-d5bf57ce205d None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:31.613333 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06907d37-04b6-400f-a47d-d5bf57ce205d None admin] RBAC: Authorizing `identity:get_project(project_id=8067a8a77005444fb4e26dc5e9b19761)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:31.614832 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06907d37-04b6-400f-a47d-d5bf57ce205d None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:31.616765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 82/155] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:31 2022] GET /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:31.622581 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0126a6-a284-4707-914c-3e2ce5128c44 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:31.664691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:31.741127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0126a6-a284-4707-914c-3e2ce5128c44 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:31.789099 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c43e6-6d7c-4807-88fa-ff701250e8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:31.789751 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c43e6-6d7c-4807-88fa-ff701250e8ce None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:31.790039 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c43e6-6d7c-4807-88fa-ff701250e8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:31.790318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c43e6-6d7c-4807-88fa-ff701250e8ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:31.791135 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c43e6-6d7c-4807-88fa-ff701250e8ce None admin] RBAC: Adding query filter params (role.id=f105208a21c84d4fa134aa0aeb62f3bb, scope.project.id=8067a8a77005444fb4e26dc5e9b19761, user.id=034095ad77554819b83324ec8dd53a22) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:31.791473 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c43e6-6d7c-4807-88fa-ff701250e8ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:31.792942 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c43e6-6d7c-4807-88fa-ff701250e8ce None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:31.799908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 74/156] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:24:31 2022] GET /identity/v3/role_assignments?user.id=034095ad77554819b83324ec8dd53a22&scope.project.id=8067a8a77005444fb4e26dc5e9b19761&role.id=f105208a21c84d4fa134aa0aeb62f3bb => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:32.303093 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208145e-48fd-4205-a063-438b9edc8aea None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:32.303554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208145e-48fd-4205-a063-438b9edc8aea None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:32.303730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208145e-48fd-4205-a063-438b9edc8aea None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:32.305367 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 83/157] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:32.310334 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c374d-7440-4eb2-8632-204b63aeca94 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:32.310792 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c374d-7440-4eb2-8632-204b63aeca94 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:32.310888 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c374d-7440-4eb2-8632-204b63aeca94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:32.329494 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-ed0c374d-7440-4eb2-8632-204b63aeca94 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:32.330719 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ed0c374d-7440-4eb2-8632-204b63aeca94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:32.426788 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 75/158] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:32.473731 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208145e-48fd-4205-a063-438b9edc8aea None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:32.628068 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208145e-48fd-4205-a063-438b9edc8aea None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:32.669350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610e0e0-7b0e-4088-b5b1-a4dddb7c5d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:32.670009 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610e0e0-7b0e-4088-b5b1-a4dddb7c5d3c None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:32.670294 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610e0e0-7b0e-4088-b5b1-a4dddb7c5d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:32.670571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610e0e0-7b0e-4088-b5b1-a4dddb7c5d3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:32.687628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610e0e0-7b0e-4088-b5b1-a4dddb7c5d3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:32.693196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-6610e0e0-7b0e-4088-b5b1-a4dddb7c5d3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:24:32.693196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:32.693196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:32.693196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:32.693196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:32.693196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:32.693196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:32.693196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:32.693196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:32.693196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:32.693196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:32.693196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:32.693196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:32.693196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:32.693196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:32.693196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:32.694079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:32.694079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:32.694079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:32.694079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:32.694079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:32.694079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:32.694079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:32.694079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:32.694079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:32.694079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:32.694079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:32.694079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:32.694079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:32.694079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:32.694079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:32.694079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:32.694937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:32.694937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:32.694937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:32.694937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:32.694937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:32.694937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:32.694937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:32.694937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:32.694937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:32.694937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:32.694937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:24:32.694937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:24:32.694937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 84/159] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:24:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:32.700228 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c374d-7440-4eb2-8632-204b63aeca94 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:32.735495 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931a3a7-593d-4791-891d-26cd9965a469 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:32.735829 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931a3a7-593d-4791-891d-26cd9965a469 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:32.736064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931a3a7-593d-4791-891d-26cd9965a469 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:32.737442 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 85/160] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:32.750579 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:32.759305 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63c5fd-d4e6-4c08-b610-8b704af60da0 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:32.763132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63c5fd-d4e6-4c08-b610-8b704af60da0 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:32.763132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63c5fd-d4e6-4c08-b610-8b704af60da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:32.794759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-bc63c5fd-d4e6-4c08-b610-8b704af60da0 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:32.795997 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-bc63c5fd-d4e6-4c08-b610-8b704af60da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:32.854985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:32.942855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c374d-7440-4eb2-8632-204b63aeca94 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:32.973686 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 86/161] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:24:33.005418 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d4212-6c29-434d-b5db-b2b0a34d1368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:33.006068 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d4212-6c29-434d-b5db-b2b0a34d1368 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:33.006363 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d4212-6c29-434d-b5db-b2b0a34d1368 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:33.006646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d4212-6c29-434d-b5db-b2b0a34d1368 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:33.007426 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d4212-6c29-434d-b5db-b2b0a34d1368 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:33.011665 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d4212-6c29-434d-b5db-b2b0a34d1368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:33.013046 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63c5fd-d4e6-4c08-b610-8b704af60da0 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:33.022307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d4212-6c29-434d-b5db-b2b0a34d1368 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:33.042799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 76/162] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:33.048700 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d4212-6c29-434d-b5db-b2b0a34d1368 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:33.230272 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63c5fd-d4e6-4c08-b610-8b704af60da0 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:33.252536 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:33.267556 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d4212-6c29-434d-b5db-b2b0a34d1368 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:33.320574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32b139-82d0-47f0-b186-be42e236fca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:33.321241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32b139-82d0-47f0-b186-be42e236fca8 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:33.321526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32b139-82d0-47f0-b186-be42e236fca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:33.321798 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32b139-82d0-47f0-b186-be42e236fca8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:33.335001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1b3b2-456d-4b5d-848a-a8e96b433500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:33.336550 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1b3b2-456d-4b5d-848a-a8e96b433500 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:33.337058 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1b3b2-456d-4b5d-848a-a8e96b433500 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:33.337528 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1b3b2-456d-4b5d-848a-a8e96b433500 None admin] PATH_INFO: `/v3/users/0dc5c37ef1d94f0cacb3f037f735dea7` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:33.341489 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1b3b2-456d-4b5d-848a-a8e96b433500 None admin] RBAC: Authorizing `identity:get_user(user_id=0dc5c37ef1d94f0cacb3f037f735dea7)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:33.343395 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1b3b2-456d-4b5d-848a-a8e96b433500 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:33.345687 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 77/163] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:33 2022] GET /identity/v3/users/0dc5c37ef1d94f0cacb3f037f735dea7 => generated 247 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:33.345814 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32b139-82d0-47f0-b186-be42e236fca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:33.351433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-1e32b139-82d0-47f0-b186-be42e236fca8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:24:33.351433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:33.351433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:33.351433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:33.351433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:33.351433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:33.351433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:33.351433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:33.351433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:33.351433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:33.351433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:33.351433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:33.351433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:33.351433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:33.351433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:33.351433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:33.352297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:33.352297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:33.352297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:33.352297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:33.352297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:33.352297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:33.352297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:33.352297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:33.352297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:33.352297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:33.352297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:33.352297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:33.352297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:33.352297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:33.352297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:33.352297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:33.353168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:33.353168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:33.353168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:33.353168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:33.353168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:33.353168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:33.353168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:33.353168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:33.353168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:33.353168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:33.353168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:24:33.353168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:24:33.359429 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 87/164] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 18:24:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:24:33.360765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1b3b2-456d-4b5d-848a-a8e96b433500 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:33.365503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32b139-82d0-47f0-b186-be42e236fca8 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:33.411361 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:33.575677 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32b139-82d0-47f0-b186-be42e236fca8 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:33.586731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1b3b2-456d-4b5d-848a-a8e96b433500 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:33.650136 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9bbc4-724c-4371-b814-11c5faa41a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:33.651230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9bbc4-724c-4371-b814-11c5faa41a50 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:33.651715 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9bbc4-724c-4371-b814-11c5faa41a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:33.652226 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9bbc4-724c-4371-b814-11c5faa41a50 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:33.653112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9bbc4-724c-4371-b814-11c5faa41a50 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:33.653567 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9bbc4-724c-4371-b814-11c5faa41a50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:33.654851 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05650873-1bfc-4a09-b8d4-5f304b6f353f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:33.655507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9bbc4-724c-4371-b814-11c5faa41a50 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:33.655714 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05650873-1bfc-4a09-b8d4-5f304b6f353f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:33.656095 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05650873-1bfc-4a09-b8d4-5f304b6f353f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:33.656469 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05650873-1bfc-4a09-b8d4-5f304b6f353f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:33.681474 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 88/165] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:24:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:33.687133 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9bbc4-724c-4371-b814-11c5faa41a50 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:33.712999 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:33.782883 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05650873-1bfc-4a09-b8d4-5f304b6f353f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:33.784595 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05650873-1bfc-4a09-b8d4-5f304b6f353f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:33.815619 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:33.865438 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9bbc4-724c-4371-b814-11c5faa41a50 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:33.904812 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5f847-a295-497f-a846-19313f21d139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:33.905464 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5f847-a295-497f-a846-19313f21d139 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:33.905747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5f847-a295-497f-a846-19313f21d139 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:33.906023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5f847-a295-497f-a846-19313f21d139 None admin] PATH_INFO: `/v3/users/034095ad77554819b83324ec8dd53a22` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:33.907307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5f847-a295-497f-a846-19313f21d139 None admin] RBAC: Authorizing `identity:get_user(user_id=034095ad77554819b83324ec8dd53a22)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:33.909068 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5f847-a295-497f-a846-19313f21d139 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:33.912043 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 89/166] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:33 2022] GET /identity/v3/users/034095ad77554819b83324ec8dd53a22 => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:33.919286 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403c26e-b2ad-46d9-a7e4-3ec956349b36 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:33.919286 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403c26e-b2ad-46d9-a7e4-3ec956349b36 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:33.919286 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403c26e-b2ad-46d9-a7e4-3ec956349b36 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:33.919286 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 90/167] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:33.919602 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403c26e-b2ad-46d9-a7e4-3ec956349b36 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:34.003631 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 78/168] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:24:34.007363 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbad5bc-bff6-4491-9df0-ed8a204bdee8 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:34.007649 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbad5bc-bff6-4491-9df0-ed8a204bdee8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:34.007927 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbad5bc-bff6-4491-9df0-ed8a204bdee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:34.051816 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-acbad5bc-bff6-4491-9df0-ed8a204bdee8 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:34.053084 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-acbad5bc-bff6-4491-9df0-ed8a204bdee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:34.112363 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403c26e-b2ad-46d9-a7e4-3ec956349b36 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:34.166741 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:34.181493 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 79/169] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:34.182719 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbad5bc-bff6-4491-9df0-ed8a204bdee8 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:34.187995 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7687d9-d18e-456a-8808-69d97aa4c4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:34.188736 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7687d9-d18e-456a-8808-69d97aa4c4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:34.189098 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7687d9-d18e-456a-8808-69d97aa4c4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:34.189452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7687d9-d18e-456a-8808-69d97aa4c4f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:34.219180 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:34.314895 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbad5bc-bff6-4491-9df0-ed8a204bdee8 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:34.339723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7687d9-d18e-456a-8808-69d97aa4c4f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:34.341226 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7687d9-d18e-456a-8808-69d97aa4c4f9 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:34.377677 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45624ac9-d748-4256-803b-100baa039d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:34.378865 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45624ac9-d748-4256-803b-100baa039d43 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:34.379107 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45624ac9-d748-4256-803b-100baa039d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:34.379363 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45624ac9-d748-4256-803b-100baa039d43 None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:34.380945 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45624ac9-d748-4256-803b-100baa039d43 None admin] RBAC: Authorizing `identity:get_project(project_id=8067a8a77005444fb4e26dc5e9b19761)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:34.385974 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45624ac9-d748-4256-803b-100baa039d43 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:34.387975 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 80/170] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:34 2022] GET /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:34.388994 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dbde6-c2c3-48d2-8ad1-1749d5bbb736 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:34.389322 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dbde6-c2c3-48d2-8ad1-1749d5bbb736 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:34.389548 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dbde6-c2c3-48d2-8ad1-1749d5bbb736 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:34.390911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 81/171] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:34.396330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8dbde6-c2c3-48d2-8ad1-1749d5bbb736 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:34.530992 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:34.548612 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 91/172] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:24:34.550700 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4f819-de66-45f9-9681-5615dbd23405 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:34.551092 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4f819-de66-45f9-9681-5615dbd23405 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:34.553006 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4f819-de66-45f9-9681-5615dbd23405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:34.578355 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-61e4f819-de66-45f9-9681-5615dbd23405 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:34.579569 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-61e4f819-de66-45f9-9681-5615dbd23405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:34.598070 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8dbde6-c2c3-48d2-8ad1-1749d5bbb736 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:34.636555 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:34.643474 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea02d2-745e-42c5-bcc0-7e54123d3c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:34.644830 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea02d2-745e-42c5-bcc0-7e54123d3c50 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:34.650746 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea02d2-745e-42c5-bcc0-7e54123d3c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:34.650746 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea02d2-745e-42c5-bcc0-7e54123d3c50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:34.657698 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea02d2-745e-42c5-bcc0-7e54123d3c50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:34.661493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 92/173] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:34.662451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4f819-de66-45f9-9681-5615dbd23405 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:34.663831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-f2ea02d2-745e-42c5-bcc0-7e54123d3c50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:34.663831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:34.663831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:34.663831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:34.663831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:34.663831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:34.663831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:34.663831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:34.663831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:34.663831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:34.663831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:34.663831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:34.663831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:34.663831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:34.663831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:34.663831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:34.664679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:34.664679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:34.664679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:34.664679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:34.664679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:34.664679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:34.664679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:34.664679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:34.664679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:34.664679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:34.664679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:34.664679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:34.664679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:34.664679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:34.664679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:34.664679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:34.666191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:34.666191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:34.666191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:34.666191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:34.666191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:34.666191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:34.666191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:34.666191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:34.666191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:34.666191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:34.666191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:34.666191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:24:34.666191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 82/174] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:34.666853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d48c1-ee64-47bf-aa3c-1ac52523f500 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:34.666853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d48c1-ee64-47bf-aa3c-1ac52523f500 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:34.666853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d48c1-ee64-47bf-aa3c-1ac52523f500 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:34.668186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 83/175] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:34.668886 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d48c1-ee64-47bf-aa3c-1ac52523f500 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:34.784252 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4f819-de66-45f9-9681-5615dbd23405 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:34.788379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d48c1-ee64-47bf-aa3c-1ac52523f500 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:34.806760 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:34.822910 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49d1e3-ab59-4d5f-9376-45e8e1b9f3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:34.823575 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49d1e3-ab59-4d5f-9376-45e8e1b9f3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:34.823859 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49d1e3-ab59-4d5f-9376-45e8e1b9f3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:34.824137 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49d1e3-ab59-4d5f-9376-45e8e1b9f3b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:34.824449 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514aeca7-a54c-487f-ae3e-fec9b01eb014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:34.824953 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49d1e3-ab59-4d5f-9376-45e8e1b9f3b5 None admin] RBAC: Adding query filter params (role.id=4ae8d11d74f14bcc80117d897ba2f5b6, scope.project.id=8067a8a77005444fb4e26dc5e9b19761, user.id=0dc5c37ef1d94f0cacb3f037f735dea7) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:34.825131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aeca7-a54c-487f-ae3e-fec9b01eb014 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:34.825290 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49d1e3-ab59-4d5f-9376-45e8e1b9f3b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:34.825380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aeca7-a54c-487f-ae3e-fec9b01eb014 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:34.825627 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aeca7-a54c-487f-ae3e-fec9b01eb014 None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:34.826729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49d1e3-ab59-4d5f-9376-45e8e1b9f3b5 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:34.826827 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514aeca7-a54c-487f-ae3e-fec9b01eb014 None admin] RBAC: Authorizing `identity:get_project(project_id=8067a8a77005444fb4e26dc5e9b19761)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:34.828258 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514aeca7-a54c-487f-ae3e-fec9b01eb014 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:34.830147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 84/176] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:34 2022] GET /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:34.834454 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 93/177] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:24:34 2022] GET /identity/v3/role_assignments?user.id=0dc5c37ef1d94f0cacb3f037f735dea7&scope.project.id=8067a8a77005444fb4e26dc5e9b19761&role.id=4ae8d11d74f14bcc80117d897ba2f5b6 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:34.835122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49d1e3-ab59-4d5f-9376-45e8e1b9f3b5 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:34.840827 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25671b-8031-4287-8358-4395283d867b None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:34.841115 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25671b-8031-4287-8358-4395283d867b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:34.841331 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25671b-8031-4287-8358-4395283d867b None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:34.847676 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 85/178] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:34 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:34.847676 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb78bb-a1ff-4355-95d2-8699e3e1ca23 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:34.847676 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb78bb-a1ff-4355-95d2-8699e3e1ca23 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:34.847676 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb78bb-a1ff-4355-95d2-8699e3e1ca23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:34.878997 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5adb78bb-a1ff-4355-95d2-8699e3e1ca23 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:34.880950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5adb78bb-a1ff-4355-95d2-8699e3e1ca23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:34.900858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:34.962289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 86/179] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:34.963519 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb78bb-a1ff-4355-95d2-8699e3e1ca23 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:34.989300 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49d1e3-ab59-4d5f-9376-45e8e1b9f3b5 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:35.030714 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcad3d-919f-4dc3-a103-d13d7f8c16ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:35.031491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcad3d-919f-4dc3-a103-d13d7f8c16ce None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:35.031775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcad3d-919f-4dc3-a103-d13d7f8c16ce None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:35.032052 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcad3d-919f-4dc3-a103-d13d7f8c16ce None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:35.033329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcad3d-919f-4dc3-a103-d13d7f8c16ce None admin] RBAC: Adding query filter params (name=member) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:35.033635 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcad3d-919f-4dc3-a103-d13d7f8c16ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:35.035835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcad3d-919f-4dc3-a103-d13d7f8c16ce None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:35.046134 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 94/180] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:35.046960 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcad3d-919f-4dc3-a103-d13d7f8c16ce None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:35.088152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb78bb-a1ff-4355-95d2-8699e3e1ca23 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:35.106716 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:35.124856 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d467ba-c6be-4dfc-a646-26d7b439ee16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:35.125499 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d467ba-c6be-4dfc-a646-26d7b439ee16 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:35.125776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d467ba-c6be-4dfc-a646-26d7b439ee16 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:35.126053 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d467ba-c6be-4dfc-a646-26d7b439ee16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:35.127467 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d467ba-c6be-4dfc-a646-26d7b439ee16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:35.129084 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d467ba-c6be-4dfc-a646-26d7b439ee16 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:35.130841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 87/181] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:24:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:35.131874 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ba6e8-64f1-473d-b077-ef5f64dda2ad None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:35.132141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ba6e8-64f1-473d-b077-ef5f64dda2ad None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:35.132421 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ba6e8-64f1-473d-b077-ef5f64dda2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:35.149832 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-802ba6e8-64f1-473d-b077-ef5f64dda2ad None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:35.151120 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcad3d-919f-4dc3-a103-d13d7f8c16ce None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:35.151239 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-802ba6e8-64f1-473d-b077-ef5f64dda2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:35.153397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:35.185571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd7d4d-e4bb-494f-ac2f-13414756134e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:35.186389 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd7d4d-e4bb-494f-ac2f-13414756134e None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:35.186877 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd7d4d-e4bb-494f-ac2f-13414756134e None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:35.187167 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd7d4d-e4bb-494f-ac2f-13414756134e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:35.188301 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd7d4d-e4bb-494f-ac2f-13414756134e None admin] RBAC: Adding query filter params (role.id=dd7069600e364802831ce7c375e57fcd, scope.project.id=8067a8a77005444fb4e26dc5e9b19761, user.id=034095ad77554819b83324ec8dd53a22) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:35.188627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd7d4d-e4bb-494f-ac2f-13414756134e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:35.190074 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd7d4d-e4bb-494f-ac2f-13414756134e None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:35.196693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 95/182] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:24:35 2022] GET /identity/v3/role_assignments?user.id=034095ad77554819b83324ec8dd53a22&scope.project.id=8067a8a77005444fb4e26dc5e9b19761&role.id=dd7069600e364802831ce7c375e57fcd => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:35.198098 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fac13-3d6a-4c6b-af60-8ae10058ed7d None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:35.198265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fac13-3d6a-4c6b-af60-8ae10058ed7d None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:35.198532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fac13-3d6a-4c6b-af60-8ae10058ed7d None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:35.203403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 96/183] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:35.203403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fac13-3d6a-4c6b-af60-8ae10058ed7d None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:35.243289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 88/184] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:35.243289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ba6e8-64f1-473d-b077-ef5f64dda2ad None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:35.343907 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fac13-3d6a-4c6b-af60-8ae10058ed7d None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:35.362442 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ba6e8-64f1-473d-b077-ef5f64dda2ad None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:35.380577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:35.386604 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027da5f-865f-4631-b922-0c2cf781793d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:35.387403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027da5f-865f-4631-b922-0c2cf781793d None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:35.388158 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027da5f-865f-4631-b922-0c2cf781793d None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:35.388158 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027da5f-865f-4631-b922-0c2cf781793d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:35.402485 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027da5f-865f-4631-b922-0c2cf781793d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:35.406960 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285e6c9-412a-45f0-ac5e-d27f47600314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:35.407439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-3027da5f-865f-4631-b922-0c2cf781793d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:24:35.407439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:35.407439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:35.407439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:35.407439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:35.407439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:35.407439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:35.407439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:35.407439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:35.407439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:35.407439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:35.407439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:35.407439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:35.407439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:35.407439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:35.407439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:35.414362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:35.414362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:35.414362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:35.414362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:35.414362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:35.414362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:35.414362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:35.414362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:35.414362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:35.414362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:35.414362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:35.414362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:35.414362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:35.414362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:35.414362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:35.414362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:35.415493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:35.415493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:35.415493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:35.415493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:35.415493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:35.415493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:35.415493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:35.415493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:35.415493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:35.415493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:35.415493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:24:35.415493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:24:35.416108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285e6c9-412a-45f0-ac5e-d27f47600314 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:35.416108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285e6c9-412a-45f0-ac5e-d27f47600314 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:35.416108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285e6c9-412a-45f0-ac5e-d27f47600314 None admin] PATH_INFO: `/v3/users/034095ad77554819b83324ec8dd53a22` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:35.416287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 97/185] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:24:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:35.416287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027da5f-865f-4631-b922-0c2cf781793d None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:35.416442 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285e6c9-412a-45f0-ac5e-d27f47600314 None admin] RBAC: Authorizing `identity:get_user(user_id=034095ad77554819b83324ec8dd53a22)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:35.417747 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285e6c9-412a-45f0-ac5e-d27f47600314 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:35.419675 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 89/186] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:35 2022] GET /identity/v3/users/034095ad77554819b83324ec8dd53a22 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:35.425840 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f9b44-bcdf-4f66-a097-507123a04d78 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:35.426337 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f9b44-bcdf-4f66-a097-507123a04d78 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:35.426708 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f9b44-bcdf-4f66-a097-507123a04d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:35.445230 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a85f9b44-bcdf-4f66-a097-507123a04d78 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:35.446418 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a85f9b44-bcdf-4f66-a097-507123a04d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:35.449833 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:35.514510 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 90/187] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:35.515755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f9b44-bcdf-4f66-a097-507123a04d78 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:35.522756 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027da5f-865f-4631-b922-0c2cf781793d None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:35.560393 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65f324-f260-442a-a57b-ef9879a15653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:35.561021 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65f324-f260-442a-a57b-ef9879a15653 None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:35.566293 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65f324-f260-442a-a57b-ef9879a15653 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:35.566293 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65f324-f260-442a-a57b-ef9879a15653 None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:35.566293 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65f324-f260-442a-a57b-ef9879a15653 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:35.566293 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65f324-f260-442a-a57b-ef9879a15653 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:35.621740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f9b44-bcdf-4f66-a097-507123a04d78 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:35.637000 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:35.657623 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04920bcf-8acb-48d5-98ec-a8d72873c7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:35.658200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04920bcf-8acb-48d5-98ec-a8d72873c7bd None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:35.658477 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04920bcf-8acb-48d5-98ec-a8d72873c7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:35.658748 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04920bcf-8acb-48d5-98ec-a8d72873c7bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:35.668463 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04920bcf-8acb-48d5-98ec-a8d72873c7bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:35.673358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-04920bcf-8acb-48d5-98ec-a8d72873c7bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:24:35.673358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:35.673358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:35.673358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:35.673358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:35.673358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:35.673358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:35.673358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:35.673358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:35.673358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:35.673358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:35.673358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:35.673358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:35.673358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:35.673358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:35.673358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:35.674441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:35.674441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:35.674441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:35.674441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:35.674441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:35.674441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:35.674441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:35.674441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:35.674441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:35.674441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:35.674441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:35.674441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:35.674441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:35.674441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:35.674441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:35.674441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:35.675325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:35.675325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:35.675325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:35.675325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:35.675325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:35.675325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:35.675325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:35.675325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:35.675325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:35.675325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:35.675325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:24:35.675325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:24:35.675325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 91/188] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 18:24:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:35.676009 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04920bcf-8acb-48d5-98ec-a8d72873c7bd None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:35.732210 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 98/189] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 18:24:35 2022] POST /identity/v3/users => generated 297 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:35.733045 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65f324-f260-442a-a57b-ef9879a15653 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:35.788559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04920bcf-8acb-48d5-98ec-a8d72873c7bd None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:35.828945 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c965ab-4577-4056-903e-436ba1074c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:35.829587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c965ab-4577-4056-903e-436ba1074c43 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:35.829869 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c965ab-4577-4056-903e-436ba1074c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:35.830145 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c965ab-4577-4056-903e-436ba1074c43 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:35.830883 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c965ab-4577-4056-903e-436ba1074c43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:35.831190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c965ab-4577-4056-903e-436ba1074c43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:35.833439 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c965ab-4577-4056-903e-436ba1074c43 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:35.843751 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 92/190] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:35.844628 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c965ab-4577-4056-903e-436ba1074c43 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:35.852934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:35.872703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65f324-f260-442a-a57b-ef9879a15653 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:35.889733 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:35.922051 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ecf54-5ecd-49cd-9f02-e1886a5beaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:35.922618 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ecf54-5ecd-49cd-9f02-e1886a5beaaf None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:35.922898 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ecf54-5ecd-49cd-9f02-e1886a5beaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:35.923231 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ecf54-5ecd-49cd-9f02-e1886a5beaaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:35.973683 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c965ab-4577-4056-903e-436ba1074c43 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:36.006474 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ecf54-5ecd-49cd-9f02-e1886a5beaaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:36.008350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ecf54-5ecd-49cd-9f02-e1886a5beaaf None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:36.021910 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4f0b7-dc05-476f-b097-d24e764f1ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:36.022691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4f0b7-dc05-476f-b097-d24e764f1ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:36.023055 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4f0b7-dc05-476f-b097-d24e764f1ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:36.023248 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4f0b7-dc05-476f-b097-d24e764f1ad6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:36.038945 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4f0b7-dc05-476f-b097-d24e764f1ad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:36.044861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-c4f4f0b7-dc05-476f-b097-d24e764f1ad6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:24:36.044861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:36.044861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:36.044861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:36.044861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:36.044861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:36.044861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:36.044861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:36.044861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:36.044861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:36.044861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:36.044861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:36.044861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:36.044861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:36.044861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:36.044861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:36.045933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:36.045933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:36.045933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:36.045933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:36.045933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:36.045933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:36.045933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:36.045933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:36.045933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:36.045933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:36.045933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:36.045933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:36.045933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:36.045933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:36.045933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:36.045933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:36.046911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:36.046911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:36.046911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:36.046911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:36.046911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:36.046911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:36.046911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:36.046911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:36.046911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:36.046911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:36.046911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:24:36.046911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:24:36.048737 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 93/191] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:36.049366 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4f0b7-dc05-476f-b097-d24e764f1ad6 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:36.110477 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:36.128412 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 99/192] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:24:36.129640 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ecf54-5ecd-49cd-9f02-e1886a5beaaf None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:36.177858 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:36.187158 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4f0b7-dc05-476f-b097-d24e764f1ad6 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:36.232548 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a7e8a-9426-4097-8ef7-6bb31b9cbb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:36.233710 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a7e8a-9426-4097-8ef7-6bb31b9cbb5c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:36.234522 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a7e8a-9426-4097-8ef7-6bb31b9cbb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:36.235114 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a7e8a-9426-4097-8ef7-6bb31b9cbb5c None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:36.236147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a7e8a-9426-4097-8ef7-6bb31b9cbb5c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:36.236780 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a7e8a-9426-4097-8ef7-6bb31b9cbb5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:36.239585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a7e8a-9426-4097-8ef7-6bb31b9cbb5c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:36.243900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ecf54-5ecd-49cd-9f02-e1886a5beaaf None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:36.250926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 94/193] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:24:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:36.252279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a7e8a-9426-4097-8ef7-6bb31b9cbb5c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:36.287093 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc7931-9099-4e59-adf8-88e8bb361596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:36.287912 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc7931-9099-4e59-adf8-88e8bb361596 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:36.288270 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc7931-9099-4e59-adf8-88e8bb361596 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:36.288624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc7931-9099-4e59-adf8-88e8bb361596 None admin] PATH_INFO: `/v3/users/20ef63cdd331463a8d6aab703d47059c` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:36.305668 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc7931-9099-4e59-adf8-88e8bb361596 None admin] RBAC: Authorizing `identity:get_user(user_id=20ef63cdd331463a8d6aab703d47059c)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:36.306673 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc7931-9099-4e59-adf8-88e8bb361596 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:36.313260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 100/194] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:36 2022] GET /identity/v3/users/20ef63cdd331463a8d6aab703d47059c => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:36.313260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc7931-9099-4e59-adf8-88e8bb361596 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:36.361874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:36.384139 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a7e8a-9426-4097-8ef7-6bb31b9cbb5c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:36.426816 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc7931-9099-4e59-adf8-88e8bb361596 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:36.433713 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762450d-bc62-40ec-ae70-fd650575ac01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:36.434678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762450d-bc62-40ec-ae70-fd650575ac01 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:36.435159 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762450d-bc62-40ec-ae70-fd650575ac01 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:36.436231 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762450d-bc62-40ec-ae70-fd650575ac01 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:36.437193 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762450d-bc62-40ec-ae70-fd650575ac01 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:36.438129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762450d-bc62-40ec-ae70-fd650575ac01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:36.440376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762450d-bc62-40ec-ae70-fd650575ac01 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:36.453075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 95/195] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:36.454196 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762450d-bc62-40ec-ae70-fd650575ac01 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:36.471597 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2220ed-ab9f-436c-a550-3698e3463a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:36.472888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2220ed-ab9f-436c-a550-3698e3463a38 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:36.473242 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2220ed-ab9f-436c-a550-3698e3463a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:36.473591 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2220ed-ab9f-436c-a550-3698e3463a38 None admin] PATH_INFO: `/v3/projects/1912f6c229c643cd8d2a4173755bc1ee` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:36.474961 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2220ed-ab9f-436c-a550-3698e3463a38 None admin] RBAC: Authorizing `identity:get_project(project_id=1912f6c229c643cd8d2a4173755bc1ee)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:36.476681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2220ed-ab9f-436c-a550-3698e3463a38 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:36.478625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 101/196] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:36 2022] GET /identity/v3/projects/1912f6c229c643cd8d2a4173755bc1ee => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:36.479741 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2220ed-ab9f-436c-a550-3698e3463a38 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:36.485440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:36.594529 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762450d-bc62-40ec-ae70-fd650575ac01 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:36.689136 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2220ed-ab9f-436c-a550-3698e3463a38 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:36.692299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf5eb9-dcad-4fea-973c-7c583f40ee0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:36.693874 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf5eb9-dcad-4fea-973c-7c583f40ee0e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:36.694172 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf5eb9-dcad-4fea-973c-7c583f40ee0e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:36.694458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf5eb9-dcad-4fea-973c-7c583f40ee0e None admin] PATH_INFO: `/v3/users/20ef63cdd331463a8d6aab703d47059c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:36.695708 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf5eb9-dcad-4fea-973c-7c583f40ee0e None admin] RBAC: Authorizing `identity:get_user(user_id=20ef63cdd331463a8d6aab703d47059c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:36.697202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf5eb9-dcad-4fea-973c-7c583f40ee0e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:36.698863 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 96/197] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:36 2022] GET /identity/v3/users/20ef63cdd331463a8d6aab703d47059c => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:36.699664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf5eb9-dcad-4fea-973c-7c583f40ee0e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:36.706010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:36.735840 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b4d0f-febc-4991-8466-5d39deeb61c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:36.738107 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b4d0f-febc-4991-8466-5d39deeb61c5 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:36.739032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b4d0f-febc-4991-8466-5d39deeb61c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:36.739589 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b4d0f-febc-4991-8466-5d39deeb61c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:36.814131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:36.829019 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b4d0f-febc-4991-8466-5d39deeb61c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:36.833470 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b4d0f-febc-4991-8466-5d39deeb61c5 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:36.833600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf5eb9-dcad-4fea-973c-7c583f40ee0e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:36.880769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee652c-9b9b-45c7-aa95-0db4ea0c5dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:36.881430 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee652c-9b9b-45c7-aa95-0db4ea0c5dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:36.881716 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee652c-9b9b-45c7-aa95-0db4ea0c5dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:36.881996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee652c-9b9b-45c7-aa95-0db4ea0c5dd4 None admin] PATH_INFO: `/v3/users/ff326157b5cc49c597f34a87b4b840f8` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:36.883233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee652c-9b9b-45c7-aa95-0db4ea0c5dd4 None admin] RBAC: Authorizing `identity:get_user(user_id=ff326157b5cc49c597f34a87b4b840f8)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:36.886343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee652c-9b9b-45c7-aa95-0db4ea0c5dd4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:36.888502 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 97/198] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:36 2022] GET /identity/v3/users/ff326157b5cc49c597f34a87b4b840f8 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:36.889293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee652c-9b9b-45c7-aa95-0db4ea0c5dd4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:36.974472 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 102/199] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:24:36.975698 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b4d0f-febc-4991-8466-5d39deeb61c5 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:36.988351 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:37.020078 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee652c-9b9b-45c7-aa95-0db4ea0c5dd4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:37.058108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daba1d-7824-4d85-b9b7-600bfef6359c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:37.058752 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daba1d-7824-4d85-b9b7-600bfef6359c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:37.059039 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daba1d-7824-4d85-b9b7-600bfef6359c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:37.059351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daba1d-7824-4d85-b9b7-600bfef6359c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:37.060169 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83daba1d-7824-4d85-b9b7-600bfef6359c None admin] RBAC: Adding query filter params (role.id=f105208a21c84d4fa134aa0aeb62f3bb, scope.project.id=1912f6c229c643cd8d2a4173755bc1ee, user.id=034095ad77554819b83324ec8dd53a22) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:37.060488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83daba1d-7824-4d85-b9b7-600bfef6359c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:37.061979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83daba1d-7824-4d85-b9b7-600bfef6359c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:37.069939 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 98/200] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:24:36 2022] GET /identity/v3/role_assignments?user.id=034095ad77554819b83324ec8dd53a22&scope.project.id=1912f6c229c643cd8d2a4173755bc1ee&role.id=f105208a21c84d4fa134aa0aeb62f3bb => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:37.070847 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daba1d-7824-4d85-b9b7-600bfef6359c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:37.093042 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b4d0f-febc-4991-8466-5d39deeb61c5 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:37.099920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:37.140775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fdd59-30d5-4722-a5cb-56165517d0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:37.141860 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fdd59-30d5-4722-a5cb-56165517d0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:37.142337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fdd59-30d5-4722-a5cb-56165517d0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:37.142801 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fdd59-30d5-4722-a5cb-56165517d0b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:37.220015 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daba1d-7824-4d85-b9b7-600bfef6359c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:37.222599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fdd59-30d5-4722-a5cb-56165517d0b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:37.224743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fdd59-30d5-4722-a5cb-56165517d0b5 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:37.237264 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:37.275911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7604dfb-ebb9-4bb0-897e-6cc347b797f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:37.277366 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7604dfb-ebb9-4bb0-897e-6cc347b797f3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:37.277885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7604dfb-ebb9-4bb0-897e-6cc347b797f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:37.278360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7604dfb-ebb9-4bb0-897e-6cc347b797f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:37.360451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 103/201] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:24:37.361328 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fdd59-30d5-4722-a5cb-56165517d0b5 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:37.366850 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7604dfb-ebb9-4bb0-897e-6cc347b797f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:37.368615 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7604dfb-ebb9-4bb0-897e-6cc347b797f3 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:37.392882 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:37.504725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 99/202] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:24:37.505639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7604dfb-ebb9-4bb0-897e-6cc347b797f3 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:37.506642 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fdd59-30d5-4722-a5cb-56165517d0b5 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:37.525132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:37.572617 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bc47c-9ae9-4dee-aa45-47e65777af76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:37.573275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bc47c-9ae9-4dee-aa45-47e65777af76 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:37.573572 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bc47c-9ae9-4dee-aa45-47e65777af76 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:37.574039 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bc47c-9ae9-4dee-aa45-47e65777af76 None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:37.577025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bc47c-9ae9-4dee-aa45-47e65777af76 None admin] RBAC: Authorizing `identity:get_project(project_id=f9f866c53099419c8982f8720259b8bf)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:37.578480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bc47c-9ae9-4dee-aa45-47e65777af76 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:37.580578 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 104/203] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:37 2022] GET /identity/v3/projects/f9f866c53099419c8982f8720259b8bf => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:37.581920 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bc47c-9ae9-4dee-aa45-47e65777af76 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:37.657335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7604dfb-ebb9-4bb0-897e-6cc347b797f3 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:37.678819 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:37.698176 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ac885-d46e-4451-9d75-ce062450caec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:37.699220 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ac885-d46e-4451-9d75-ce062450caec None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:37.699749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ac885-d46e-4451-9d75-ce062450caec None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:37.699853 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bc47c-9ae9-4dee-aa45-47e65777af76 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:37.700316 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ac885-d46e-4451-9d75-ce062450caec None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:37.701829 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ac885-d46e-4451-9d75-ce062450caec None admin] RBAC: Authorizing `identity:get_project(project_id=f9f866c53099419c8982f8720259b8bf)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:37.703634 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ac885-d46e-4451-9d75-ce062450caec None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:37.705566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 100/204] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:37 2022] GET /identity/v3/projects/f9f866c53099419c8982f8720259b8bf => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:37.707462 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ac885-d46e-4451-9d75-ce062450caec None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:37.737003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c11b7e-b2d0-457a-bcd0-1de53c71df21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:37.738320 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c11b7e-b2d0-457a-bcd0-1de53c71df21 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:37.738493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c11b7e-b2d0-457a-bcd0-1de53c71df21 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:37.738724 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c11b7e-b2d0-457a-bcd0-1de53c71df21 None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:37.739997 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c11b7e-b2d0-457a-bcd0-1de53c71df21 None admin] RBAC: Authorizing `identity:get_project(project_id=8067a8a77005444fb4e26dc5e9b19761)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:37.741452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c11b7e-b2d0-457a-bcd0-1de53c71df21 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:37.743458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 105/205] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:37 2022] GET /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:37.744256 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c11b7e-b2d0-457a-bcd0-1de53c71df21 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:37.793717 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:37.826252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ac885-d46e-4451-9d75-ce062450caec None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:37.852901 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c11b7e-b2d0-457a-bcd0-1de53c71df21 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:37.874276 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c2680-7025-42e5-bc9c-ad3e6f218797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:37.874924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c2680-7025-42e5-bc9c-ad3e6f218797 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:37.875364 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c2680-7025-42e5-bc9c-ad3e6f218797 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:37.875470 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c2680-7025-42e5-bc9c-ad3e6f218797 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:37.876249 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c2680-7025-42e5-bc9c-ad3e6f218797 None admin] RBAC: Adding query filter params (role.id=4ae8d11d74f14bcc80117d897ba2f5b6, scope.project.id=f9f866c53099419c8982f8720259b8bf, user.id=20ef63cdd331463a8d6aab703d47059c) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:37.876801 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c2680-7025-42e5-bc9c-ad3e6f218797 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:37.878916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c2680-7025-42e5-bc9c-ad3e6f218797 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:37.885145 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 101/206] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:24:37 2022] GET /identity/v3/role_assignments?user.id=20ef63cdd331463a8d6aab703d47059c&scope.project.id=f9f866c53099419c8982f8720259b8bf&role.id=4ae8d11d74f14bcc80117d897ba2f5b6 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:37.892613 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c2680-7025-42e5-bc9c-ad3e6f218797 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:37.910576 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a272c9c-99f2-46ec-aaf7-78da5926e1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:37.911716 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a272c9c-99f2-46ec-aaf7-78da5926e1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:37.912311 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a272c9c-99f2-46ec-aaf7-78da5926e1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:37.912807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a272c9c-99f2-46ec-aaf7-78da5926e1f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:37.913912 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a272c9c-99f2-46ec-aaf7-78da5926e1f4 None admin] RBAC: Adding query filter params (role.id=dd7069600e364802831ce7c375e57fcd, scope.project.id=f9f866c53099419c8982f8720259b8bf, user.id=20ef63cdd331463a8d6aab703d47059c) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:37.916071 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a272c9c-99f2-46ec-aaf7-78da5926e1f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:37.918829 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a272c9c-99f2-46ec-aaf7-78da5926e1f4 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:37.933792 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 106/207] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:24:37 2022] GET /identity/v3/role_assignments?user.id=20ef63cdd331463a8d6aab703d47059c&scope.project.id=f9f866c53099419c8982f8720259b8bf&role.id=dd7069600e364802831ce7c375e57fcd => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:37.978588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:38.045985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c2680-7025-42e5-bc9c-ad3e6f218797 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:38.067499 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f6144-67b7-41bf-8d74-53f443aa12c9 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:38.068146 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f6144-67b7-41bf-8d74-53f443aa12c9 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:38.068654 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f6144-67b7-41bf-8d74-53f443aa12c9 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:38.070336 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 107/208] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:24:38.076491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a61484-1b46-4667-9206-68887941101d None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:38.077129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a61484-1b46-4667-9206-68887941101d None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:38.077615 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a61484-1b46-4667-9206-68887941101d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:38.119766 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-96a61484-1b46-4667-9206-68887941101d None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:38.122632 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-96a61484-1b46-4667-9206-68887941101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:38.143949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f525c-b0b7-48fb-99b6-2e3231911c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:38.145070 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f525c-b0b7-48fb-99b6-2e3231911c90 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:38.145565 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f525c-b0b7-48fb-99b6-2e3231911c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:38.146073 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f525c-b0b7-48fb-99b6-2e3231911c90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:38.147124 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f525c-b0b7-48fb-99b6-2e3231911c90 None admin] RBAC: Adding query filter params (role.id=27bb3ae43da44e3a87a409e5adae712c, scope.project.id=8067a8a77005444fb4e26dc5e9b19761, user.id=ff326157b5cc49c597f34a87b4b840f8) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:38.149872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f525c-b0b7-48fb-99b6-2e3231911c90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:38.151679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f525c-b0b7-48fb-99b6-2e3231911c90 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:38.168100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 102/209] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:24:37 2022] GET /identity/v3/role_assignments?user.id=ff326157b5cc49c597f34a87b4b840f8&scope.project.id=8067a8a77005444fb4e26dc5e9b19761&role.id=27bb3ae43da44e3a87a409e5adae712c => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:38.169616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc76b8-4e3f-4579-b0dc-ac1ca506cbd2 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:38.169906 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc76b8-4e3f-4579-b0dc-ac1ca506cbd2 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:38.170184 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc76b8-4e3f-4579-b0dc-ac1ca506cbd2 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:38.176964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 103/210] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:38.188955 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed081f-8c2b-4051-a85f-4a35fe26d924 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:38.189615 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed081f-8c2b-4051-a85f-4a35fe26d924 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:38.190105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed081f-8c2b-4051-a85f-4a35fe26d924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:38.210366 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c4ed081f-8c2b-4051-a85f-4a35fe26d924 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:38.212040 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c4ed081f-8c2b-4051-a85f-4a35fe26d924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:38.243240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 108/211] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:24:38.265803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a61484-1b46-4667-9206-68887941101d None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:38.315806 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:38.320188 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 104/212] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:24:38.345636 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed081f-8c2b-4051-a85f-4a35fe26d924 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:38.408100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:38.411059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a61484-1b46-4667-9206-68887941101d None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:38.459026 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2868ff-bb4e-4e91-b3ab-6923034a3a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:38.459737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2868ff-bb4e-4e91-b3ab-6923034a3a71 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:38.460018 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2868ff-bb4e-4e91-b3ab-6923034a3a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:38.460293 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2868ff-bb4e-4e91-b3ab-6923034a3a71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:38.461446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2868ff-bb4e-4e91-b3ab-6923034a3a71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:38.462900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2868ff-bb4e-4e91-b3ab-6923034a3a71 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:38.464745 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 109/213] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:24:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:38.470105 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2868ff-bb4e-4e91-b3ab-6923034a3a71 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:38.501365 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed081f-8c2b-4051-a85f-4a35fe26d924 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:38.549139 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc72f59-92c8-4103-8886-fa758f529db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:38.549914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc72f59-92c8-4103-8886-fa758f529db2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:38.550261 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc72f59-92c8-4103-8886-fa758f529db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:38.550873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc72f59-92c8-4103-8886-fa758f529db2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:38.562804 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc72f59-92c8-4103-8886-fa758f529db2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:38.581491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-1fc72f59-92c8-4103-8886-fa758f529db2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:38.581491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:38.581491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:38.581491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:38.581491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:38.581491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:38.581491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:38.581491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:38.581491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:38.581491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:38.581491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:38.581491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:38.581491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:38.581491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:38.581491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:38.581491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:38.582431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:38.582431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:38.582431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:38.582431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:38.582431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:38.582431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:38.582431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:38.582431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:38.582431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:38.582431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:38.582431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:38.582431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:38.582431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:38.582431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:38.582431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:38.582431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:38.583282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:38.583282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:38.583282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:38.583282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:38.583282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:38.583282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:38.583282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:38.583282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:38.583282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:38.583282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:38.583282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:38.583282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:24:38.583282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 105/214] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:24:38.583282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc72f59-92c8-4103-8886-fa758f529db2 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:38.599710 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2868ff-bb4e-4e91-b3ab-6923034a3a71 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:38.613087 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:38.644507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052d427-693a-49ff-9338-8188a0d64cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:38.645676 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052d427-693a-49ff-9338-8188a0d64cb1 None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:38.645888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052d427-693a-49ff-9338-8188a0d64cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:38.647723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052d427-693a-49ff-9338-8188a0d64cb1 None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:38.648588 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052d427-693a-49ff-9338-8188a0d64cb1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:38.650220 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052d427-693a-49ff-9338-8188a0d64cb1 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:38.711846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc72f59-92c8-4103-8886-fa758f529db2 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:38.715070 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:38.747722 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ac1a2-2270-4d46-a902-7816616670af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:38.748353 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ac1a2-2270-4d46-a902-7816616670af None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:38.748635 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ac1a2-2270-4d46-a902-7816616670af None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:38.748904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ac1a2-2270-4d46-a902-7816616670af None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:38.749616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ac1a2-2270-4d46-a902-7816616670af None admin] RBAC: Adding query filter params (name=member) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:38.749918 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ac1a2-2270-4d46-a902-7816616670af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:38.751345 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ac1a2-2270-4d46-a902-7816616670af None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:38.759850 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 106/215] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:38.765420 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ac1a2-2270-4d46-a902-7816616670af None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:38.774068 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 110/216] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 18:24:38 2022] POST /identity/v3/users => generated 297 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:24:38.895351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ac1a2-2270-4d46-a902-7816616670af None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:38.935123 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cd096-f6ea-4a62-a1dd-8d32a3e44a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:38.936124 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cd096-f6ea-4a62-a1dd-8d32a3e44a9c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:38.936557 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cd096-f6ea-4a62-a1dd-8d32a3e44a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:38.936980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cd096-f6ea-4a62-a1dd-8d32a3e44a9c None admin] PATH_INFO: `/v3/users/b02c8e8e6a344a449b0c643b68da015b` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:38.954321 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6cd096-f6ea-4a62-a1dd-8d32a3e44a9c None admin] RBAC: Authorizing `identity:get_user(user_id=b02c8e8e6a344a449b0c643b68da015b)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:38.956029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6cd096-f6ea-4a62-a1dd-8d32a3e44a9c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:38.958632 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 107/217] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:38 2022] GET /identity/v3/users/b02c8e8e6a344a449b0c643b68da015b => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:38.964787 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052d427-693a-49ff-9338-8188a0d64cb1 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:39.076767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052d427-693a-49ff-9338-8188a0d64cb1 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:39.115627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37456432-e8b9-4235-929b-e3ebb9d738bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:39.116520 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37456432-e8b9-4235-929b-e3ebb9d738bd None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:39.116988 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37456432-e8b9-4235-929b-e3ebb9d738bd None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:39.117414 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37456432-e8b9-4235-929b-e3ebb9d738bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:39.150981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:39.195636 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37456432-e8b9-4235-929b-e3ebb9d738bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:39.197725 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37456432-e8b9-4235-929b-e3ebb9d738bd None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:39.304829 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 111/218] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:24:39.310602 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cd096-f6ea-4a62-a1dd-8d32a3e44a9c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:39.355007 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:39.467385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cd096-f6ea-4a62-a1dd-8d32a3e44a9c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:39.521436 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8e993-a8ed-41c4-b7b6-1c78e7f9d417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:39.522464 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8e993-a8ed-41c4-b7b6-1c78e7f9d417 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:39.522968 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8e993-a8ed-41c4-b7b6-1c78e7f9d417 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:39.523463 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8e993-a8ed-41c4-b7b6-1c78e7f9d417 None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:39.524856 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8e993-a8ed-41c4-b7b6-1c78e7f9d417 None admin] RBAC: Authorizing `identity:get_project(project_id=f9f866c53099419c8982f8720259b8bf)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:39.526527 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8e993-a8ed-41c4-b7b6-1c78e7f9d417 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:39.528435 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 108/219] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:39 2022] GET /identity/v3/projects/f9f866c53099419c8982f8720259b8bf => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:39.534894 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37456432-e8b9-4235-929b-e3ebb9d738bd None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:39.639642 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:39.689649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37456432-e8b9-4235-929b-e3ebb9d738bd None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:39.736302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1c2ad-6aa7-4d2e-bf4d-71ecad535efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:39.736917 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1c2ad-6aa7-4d2e-bf4d-71ecad535efd None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:39.737206 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1c2ad-6aa7-4d2e-bf4d-71ecad535efd None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:39.738097 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1c2ad-6aa7-4d2e-bf4d-71ecad535efd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:39.738914 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1c2ad-6aa7-4d2e-bf4d-71ecad535efd None admin] RBAC: Adding query filter params (role.id=f105208a21c84d4fa134aa0aeb62f3bb, scope.project.id=f9f866c53099419c8982f8720259b8bf, user.id=b02c8e8e6a344a449b0c643b68da015b) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:39.739230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1c2ad-6aa7-4d2e-bf4d-71ecad535efd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:39.740717 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1c2ad-6aa7-4d2e-bf4d-71ecad535efd None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:39.748645 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 112/220] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:24:39 2022] GET /identity/v3/role_assignments?user.id=b02c8e8e6a344a449b0c643b68da015b&scope.project.id=f9f866c53099419c8982f8720259b8bf&role.id=f105208a21c84d4fa134aa0aeb62f3bb => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:40.322730 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcea64f-9a66-4ef3-a604-ceed7eeb098a None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:40.323122 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcea64f-9a66-4ef3-a604-ceed7eeb098a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:40.323329 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcea64f-9a66-4ef3-a604-ceed7eeb098a None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:40.325069 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 109/221] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:40.330436 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541dd22-b6aa-4fe1-8c17-14d683bf6e28 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:40.330924 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541dd22-b6aa-4fe1-8c17-14d683bf6e28 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:40.331038 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541dd22-b6aa-4fe1-8c17-14d683bf6e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:40.360343 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-5541dd22-b6aa-4fe1-8c17-14d683bf6e28 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:40.361570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5541dd22-b6aa-4fe1-8c17-14d683bf6e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:40.387968 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617afff5-9daa-401f-ae6e-616d86f67b26 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:40.388273 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617afff5-9daa-401f-ae6e-616d86f67b26 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:40.388539 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617afff5-9daa-401f-ae6e-616d86f67b26 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:40.390209 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 110/222] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:24:40.397918 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ce6d3-4198-4649-a914-b18f61833f04 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:40.398230 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ce6d3-4198-4649-a914-b18f61833f04 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:40.398481 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ce6d3-4198-4649-a914-b18f61833f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:40.419719 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-769ce6d3-4198-4649-a914-b18f61833f04 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:40.420997 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-769ce6d3-4198-4649-a914-b18f61833f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:40.477789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 113/223] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:40.536908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 111/224] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:24:40.539630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541dd22-b6aa-4fe1-8c17-14d683bf6e28 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:40.564114 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ce6d3-4198-4649-a914-b18f61833f04 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:40.615764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:40.634471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:40.662674 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541dd22-b6aa-4fe1-8c17-14d683bf6e28 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:40.708097 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8659b7-0a8c-4163-ab96-1fa2ac3db61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:40.708767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8659b7-0a8c-4163-ab96-1fa2ac3db61d None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:40.709050 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8659b7-0a8c-4163-ab96-1fa2ac3db61d None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:40.709332 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8659b7-0a8c-4163-ab96-1fa2ac3db61d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:40.730199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8659b7-0a8c-4163-ab96-1fa2ac3db61d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:40.735548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-fe8659b7-0a8c-4163-ab96-1fa2ac3db61d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:24:40.735548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:40.735548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:40.735548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:40.735548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:40.735548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:40.735548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:40.735548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:40.735548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:40.735548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:40.735548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:40.735548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:40.735548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:40.735548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:40.735548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:40.735548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:40.736422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:40.736422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:40.736422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:40.736422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:40.736422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:40.736422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:40.736422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:40.736422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:40.736422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:40.736422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:40.736422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:40.736422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:40.736422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:40.736422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:40.736422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:40.736422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:40.737738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:40.737738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:40.737738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:40.737738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:40.737738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:40.737738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:40.737738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:40.737738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:40.737738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:40.737738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:40.737738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:24:40.737738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:24:40.746684 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 114/225] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:24:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:40.747631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8659b7-0a8c-4163-ab96-1fa2ac3db61d None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:40.811986 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ce6d3-4198-4649-a914-b18f61833f04 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:40.890567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888ae0a-46e6-4029-8de8-5f0e922c8464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:40.891308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888ae0a-46e6-4029-8de8-5f0e922c8464 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:40.891532 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888ae0a-46e6-4029-8de8-5f0e922c8464 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:40.891814 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888ae0a-46e6-4029-8de8-5f0e922c8464 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:40.914790 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888ae0a-46e6-4029-8de8-5f0e922c8464 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:40.926914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-d888ae0a-46e6-4029-8de8-5f0e922c8464 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:24:40.926914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:40.926914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:40.926914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:40.926914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:40.926914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:40.926914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:40.926914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:40.926914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:40.926914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:40.926914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:40.926914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:40.926914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:40.926914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:40.926914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:40.926914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:40.927936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:40.927936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:40.927936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:40.927936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:40.927936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:40.927936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:40.927936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:40.927936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:40.927936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:40.927936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:40.927936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:40.927936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:40.927936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:40.927936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:40.927936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:40.927936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:40.928745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:40.928745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:40.928745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:40.928745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:40.928745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:40.928745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:40.928745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:40.928745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:40.928745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:40.928745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:40.928745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:24:40.928745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:24:40.930164 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8659b7-0a8c-4163-ab96-1fa2ac3db61d None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:40.936057 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 112/226] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 18:24:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:24:40.937658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888ae0a-46e6-4029-8de8-5f0e922c8464 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:40.979698 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:41.013304 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd66a0-d9b9-4486-917a-48bb23f6dba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:41.013943 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd66a0-d9b9-4486-917a-48bb23f6dba8 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:41.014226 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd66a0-d9b9-4486-917a-48bb23f6dba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:41.014505 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd66a0-d9b9-4486-917a-48bb23f6dba8 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:41.015242 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd66a0-d9b9-4486-917a-48bb23f6dba8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:41.015572 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd66a0-d9b9-4486-917a-48bb23f6dba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:41.016985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd66a0-d9b9-4486-917a-48bb23f6dba8 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:41.039793 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 115/227] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:41.045988 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd66a0-d9b9-4486-917a-48bb23f6dba8 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:41.144807 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:41.187180 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd66a0-d9b9-4486-917a-48bb23f6dba8 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:41.188316 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888ae0a-46e6-4029-8de8-5f0e922c8464 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:41.230011 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13de54e-3583-4805-b651-80372e6f0ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:41.230640 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13de54e-3583-4805-b651-80372e6f0ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:41.230928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13de54e-3583-4805-b651-80372e6f0ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:41.231206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13de54e-3583-4805-b651-80372e6f0ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:41.232002 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13de54e-3583-4805-b651-80372e6f0ae7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:41.232741 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13de54e-3583-4805-b651-80372e6f0ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:41.234311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13de54e-3583-4805-b651-80372e6f0ae7 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:41.245261 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 113/228] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:24:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:41.251710 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13de54e-3583-4805-b651-80372e6f0ae7 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:41.260883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a39d3-2072-4b5a-a3d4-e23afd70deb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:41.261557 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a39d3-2072-4b5a-a3d4-e23afd70deb6 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:41.261843 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a39d3-2072-4b5a-a3d4-e23afd70deb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:41.262121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a39d3-2072-4b5a-a3d4-e23afd70deb6 None admin] PATH_INFO: `/v3/users/20ef63cdd331463a8d6aab703d47059c` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:41.263475 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a39d3-2072-4b5a-a3d4-e23afd70deb6 None admin] RBAC: Authorizing `identity:get_user(user_id=20ef63cdd331463a8d6aab703d47059c)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:41.265079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a39d3-2072-4b5a-a3d4-e23afd70deb6 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:41.267004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 116/229] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:41 2022] GET /identity/v3/users/20ef63cdd331463a8d6aab703d47059c => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:41.276291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a39d3-2072-4b5a-a3d4-e23afd70deb6 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:41.369157 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13de54e-3583-4805-b651-80372e6f0ae7 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:41.387830 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:41.415599 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7ce42-4150-46fa-b69b-a0c1f0be7ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:41.416170 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7ce42-4150-46fa-b69b-a0c1f0be7ecd None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:41.416454 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7ce42-4150-46fa-b69b-a0c1f0be7ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:41.417020 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7ce42-4150-46fa-b69b-a0c1f0be7ecd None admin] PATH_INFO: `/v3/users/20ef63cdd331463a8d6aab703d47059c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:41.418843 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7ce42-4150-46fa-b69b-a0c1f0be7ecd None admin] RBAC: Authorizing `identity:get_user(user_id=20ef63cdd331463a8d6aab703d47059c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:41.420932 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7ce42-4150-46fa-b69b-a0c1f0be7ecd None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:41.428880 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 114/230] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:41 2022] GET /identity/v3/users/20ef63cdd331463a8d6aab703d47059c => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:41.430372 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d57c4-e4a7-43af-a303-660e06dd22b1 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:41.430657 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d57c4-e4a7-43af-a303-660e06dd22b1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:41.430941 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d57c4-e4a7-43af-a303-660e06dd22b1 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:41.432958 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 115/231] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:41.438227 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d57c4-e4a7-43af-a303-660e06dd22b1 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:41.457392 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:41.469971 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a39d3-2072-4b5a-a3d4-e23afd70deb6 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:41.524035 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8f5ea-8738-4c79-98bf-63e9ed99aa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:41.524704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8f5ea-8738-4c79-98bf-63e9ed99aa7d None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:41.524990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8f5ea-8738-4c79-98bf-63e9ed99aa7d None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:41.525270 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8f5ea-8738-4c79-98bf-63e9ed99aa7d None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:41.526996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d8f5ea-8738-4c79-98bf-63e9ed99aa7d None admin] RBAC: Authorizing `identity:get_project(project_id=f9f866c53099419c8982f8720259b8bf)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:41.529006 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d8f5ea-8738-4c79-98bf-63e9ed99aa7d None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:41.531592 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 117/232] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:41 2022] GET /identity/v3/projects/f9f866c53099419c8982f8720259b8bf => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:41.532714 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7662d65-5673-45dd-b395-a2b393399ae4 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:41.533023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7662d65-5673-45dd-b395-a2b393399ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:41.533494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7662d65-5673-45dd-b395-a2b393399ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:41.559341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d57c4-e4a7-43af-a303-660e06dd22b1 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:41.562248 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-d7662d65-5673-45dd-b395-a2b393399ae4 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:41.563790 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-d7662d65-5673-45dd-b395-a2b393399ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:41.596342 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b1a26-e683-4fd0-b1cb-1203280d9cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:41.597904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b1a26-e683-4fd0-b1cb-1203280d9cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:41.598492 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b1a26-e683-4fd0-b1cb-1203280d9cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:41.598961 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b1a26-e683-4fd0-b1cb-1203280d9cd3 None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:41.600583 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b1a26-e683-4fd0-b1cb-1203280d9cd3 None admin] RBAC: Authorizing `identity:get_project(project_id=f9f866c53099419c8982f8720259b8bf)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:41.612512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b1a26-e683-4fd0-b1cb-1203280d9cd3 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:41.612512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 116/233] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:41 2022] GET /identity/v3/projects/f9f866c53099419c8982f8720259b8bf => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:41.612512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b1a26-e683-4fd0-b1cb-1203280d9cd3 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:41.667375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 118/234] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:41.667375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7662d65-5673-45dd-b395-a2b393399ae4 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:41.756150 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:41.758451 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:41.779847 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b1a26-e683-4fd0-b1cb-1203280d9cd3 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:41.812856 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7662d65-5673-45dd-b395-a2b393399ae4 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:41.817011 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178bef9-2f24-47cd-9174-74df80eb353c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:41.817700 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178bef9-2f24-47cd-9174-74df80eb353c None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:41.817984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178bef9-2f24-47cd-9174-74df80eb353c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:41.818262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178bef9-2f24-47cd-9174-74df80eb353c None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf/users/20ef63cdd331463a8d6aab703d47059c/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:41.820283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178bef9-2f24-47cd-9174-74df80eb353c None admin] RBAC: Authorizing `identity:create_grant(project_id=f9f866c53099419c8982f8720259b8bf, user_id=20ef63cdd331463a8d6aab703d47059c, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:41.821748 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178bef9-2f24-47cd-9174-74df80eb353c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:41.848860 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209c1fa-42e1-474a-ba4b-3b28761960b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:41.849539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209c1fa-42e1-474a-ba4b-3b28761960b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:41.849828 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209c1fa-42e1-474a-ba4b-3b28761960b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:41.850134 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209c1fa-42e1-474a-ba4b-3b28761960b1 None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf/users/20ef63cdd331463a8d6aab703d47059c/roles/dd7069600e364802831ce7c375e57fcd` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:41.852466 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209c1fa-42e1-474a-ba4b-3b28761960b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f9f866c53099419c8982f8720259b8bf, user_id=20ef63cdd331463a8d6aab703d47059c, role_id=dd7069600e364802831ce7c375e57fcd)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:41.853940 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209c1fa-42e1-474a-ba4b-3b28761960b1 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:41.926741 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 117/235] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:24:41 2022] PUT /identity/v3/projects/f9f866c53099419c8982f8720259b8bf/users/20ef63cdd331463a8d6aab703d47059c/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:41.927547 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178bef9-2f24-47cd-9174-74df80eb353c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:41.960166 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 119/236] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:24:41 2022] PUT /identity/v3/projects/f9f866c53099419c8982f8720259b8bf/users/20ef63cdd331463a8d6aab703d47059c/roles/dd7069600e364802831ce7c375e57fcd => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:41.962071 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67646303-8b51-4aed-beb6-dfcb9cabf71a None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:41.962365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67646303-8b51-4aed-beb6-dfcb9cabf71a None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:41.962827 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67646303-8b51-4aed-beb6-dfcb9cabf71a None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:41.965501 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 120/237] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:41.971770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b5465-b0e6-42d4-a61d-597a60eae857 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:41.972075 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b5465-b0e6-42d4-a61d-597a60eae857 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:41.972338 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b5465-b0e6-42d4-a61d-597a60eae857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:41.993168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-cf3b5465-b0e6-42d4-a61d-597a60eae857 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:41.994392 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-cf3b5465-b0e6-42d4-a61d-597a60eae857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:42.100241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178bef9-2f24-47cd-9174-74df80eb353c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:42.100675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 121/238] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:42.102099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8ce1c-4b0a-464a-9a13-7d42afe2b91e None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:42.102391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8ce1c-4b0a-464a-9a13-7d42afe2b91e None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:42.102671 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8ce1c-4b0a-464a-9a13-7d42afe2b91e None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:42.108541 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 122/239] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:42.110002 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a371b-22f8-42ed-ad2b-a8619ea5f976 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:42.110292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a371b-22f8-42ed-ad2b-a8619ea5f976 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:42.110569 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a371b-22f8-42ed-ad2b-a8619ea5f976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:42.137986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-3a0a371b-22f8-42ed-ad2b-a8619ea5f976 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:42.139730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-3a0a371b-22f8-42ed-ad2b-a8619ea5f976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:42.155969 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30584ee-7603-4dde-bee7-eebe2f1c8b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:42.156628 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30584ee-7603-4dde-bee7-eebe2f1c8b06 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:42.156909 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30584ee-7603-4dde-bee7-eebe2f1c8b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:42.157185 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30584ee-7603-4dde-bee7-eebe2f1c8b06 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:42.167567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:42.172720 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30584ee-7603-4dde-bee7-eebe2f1c8b06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:42.177209 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:42.178523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-e30584ee-7603-4dde-bee7-eebe2f1c8b06 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:24:42.178523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:42.178523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:42.178523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:42.178523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:42.178523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:42.178523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:42.178523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:42.178523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:42.178523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:42.178523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:42.178523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:42.178523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:42.178523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:42.178523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:42.178523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:42.179570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:42.179570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:42.179570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:42.179570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:42.179570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:42.179570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:42.179570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:42.179570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:42.179570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:42.179570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:42.179570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:42.179570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:42.179570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:42.179570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:42.179570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:42.179570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:42.180542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:42.180542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:42.180542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:42.180542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:42.180542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:42.180542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:42.180542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:42.180542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:42.180542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:42.180542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:42.180542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:24:42.180542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:24:42.180542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 118/240] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:42.181214 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30584ee-7603-4dde-bee7-eebe2f1c8b06 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:42.225486 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 123/241] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:42.227501 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a371b-22f8-42ed-ad2b-a8619ea5f976 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:42.312076 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30584ee-7603-4dde-bee7-eebe2f1c8b06 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:42.339391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a371b-22f8-42ed-ad2b-a8619ea5f976 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:42.351913 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3352e3-6d30-46be-803c-5762c58f2bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:42.352756 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3352e3-6d30-46be-803c-5762c58f2bfd None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:42.353109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3352e3-6d30-46be-803c-5762c58f2bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:42.353454 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3352e3-6d30-46be-803c-5762c58f2bfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:42.354806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3352e3-6d30-46be-803c-5762c58f2bfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:42.356470 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3352e3-6d30-46be-803c-5762c58f2bfd None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:42.364214 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 119/242] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:24:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:42.365396 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3352e3-6d30-46be-803c-5762c58f2bfd None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:42.377586 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec47fa3-ebde-4c6e-bfac-352c35ca3bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:42.378764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec47fa3-ebde-4c6e-bfac-352c35ca3bdb None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:42.379043 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec47fa3-ebde-4c6e-bfac-352c35ca3bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:42.379340 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec47fa3-ebde-4c6e-bfac-352c35ca3bdb None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:42.380066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec47fa3-ebde-4c6e-bfac-352c35ca3bdb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:42.380476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec47fa3-ebde-4c6e-bfac-352c35ca3bdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:42.381983 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec47fa3-ebde-4c6e-bfac-352c35ca3bdb None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:42.393998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 124/243] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:42.394634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec47fa3-ebde-4c6e-bfac-352c35ca3bdb None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:42.426104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:42.444139 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:42.483160 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3352e3-6d30-46be-803c-5762c58f2bfd None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:42.521354 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec47fa3-ebde-4c6e-bfac-352c35ca3bdb None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:42.521895 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17560fa8-0f88-4280-83cb-2a0913fd8cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:42.522554 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17560fa8-0f88-4280-83cb-2a0913fd8cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:42.522843 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17560fa8-0f88-4280-83cb-2a0913fd8cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:42.523118 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17560fa8-0f88-4280-83cb-2a0913fd8cf9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:42.534756 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17560fa8-0f88-4280-83cb-2a0913fd8cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:42.543323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-17560fa8-0f88-4280-83cb-2a0913fd8cf9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:42.543323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:42.543323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:42.543323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:42.543323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:42.543323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:42.543323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:42.543323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:42.543323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:42.543323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:42.543323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:42.543323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:42.543323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:42.543323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:42.543323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:42.543323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:42.544266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:42.544266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:42.544266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:42.544266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:42.544266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:42.544266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:42.544266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:42.544266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:42.544266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:42.544266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:42.544266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:42.544266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:42.544266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:42.544266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:42.544266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:42.544266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:42.545059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:42.545059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:42.545059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:42.545059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:42.545059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:42.545059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:42.545059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:42.545059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:42.545059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:42.545059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:42.545059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:42.545059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:24:42.545059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 120/244] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:42.545059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17560fa8-0f88-4280-83cb-2a0913fd8cf9 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:42.565308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ad57f-985d-4981-9296-b182ef83736f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:42.566381 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ad57f-985d-4981-9296-b182ef83736f None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:42.566730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ad57f-985d-4981-9296-b182ef83736f None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:42.574058 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ad57f-985d-4981-9296-b182ef83736f None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:42.574058 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ad57f-985d-4981-9296-b182ef83736f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:42.574058 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ad57f-985d-4981-9296-b182ef83736f None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:42.661408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17560fa8-0f88-4280-83cb-2a0913fd8cf9 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:42.686527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 125/245] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 18:24:42 2022] POST /identity/v3/users => generated 293 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:42.687852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ad57f-985d-4981-9296-b182ef83736f None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:42.704907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:42.728110 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef9924-e0ff-476c-9e5f-ee23aa71b816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:42.728799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef9924-e0ff-476c-9e5f-ee23aa71b816 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:42.729081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef9924-e0ff-476c-9e5f-ee23aa71b816 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:42.729355 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef9924-e0ff-476c-9e5f-ee23aa71b816 None admin] PATH_INFO: `/v3/users/3714b860a81942f980ed6eee1ba7dec1` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:42.768137 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef9924-e0ff-476c-9e5f-ee23aa71b816 None admin] RBAC: Authorizing `identity:get_user(user_id=3714b860a81942f980ed6eee1ba7dec1)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:42.770505 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef9924-e0ff-476c-9e5f-ee23aa71b816 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:42.772723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 121/246] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:42 2022] GET /identity/v3/users/3714b860a81942f980ed6eee1ba7dec1 => generated 297 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:42.779683 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef9924-e0ff-476c-9e5f-ee23aa71b816 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:42.812886 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:42.834676 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ad57f-985d-4981-9296-b182ef83736f None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:42.877403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46239a-29b0-4252-a7ca-14bc9064c991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:42.879644 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46239a-29b0-4252-a7ca-14bc9064c991 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:42.880253 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46239a-29b0-4252-a7ca-14bc9064c991 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:42.880741 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46239a-29b0-4252-a7ca-14bc9064c991 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:42.881738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46239a-29b0-4252-a7ca-14bc9064c991 None admin] RBAC: Adding query filter params (name=member) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:42.882251 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46239a-29b0-4252-a7ca-14bc9064c991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:42.884148 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46239a-29b0-4252-a7ca-14bc9064c991 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:42.895200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 126/247] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:42.901860 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46239a-29b0-4252-a7ca-14bc9064c991 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:42.994835 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef9924-e0ff-476c-9e5f-ee23aa71b816 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:43.034357 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46239a-29b0-4252-a7ca-14bc9064c991 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:43.047780 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa67eaf-df96-40e6-a59c-6183930cfbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:43.048790 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa67eaf-df96-40e6-a59c-6183930cfbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:43.049348 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa67eaf-df96-40e6-a59c-6183930cfbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:43.050513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa67eaf-df96-40e6-a59c-6183930cfbf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:43.070896 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43efe2d-d819-459d-b558-c619f72f0e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:43.071815 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43efe2d-d819-459d-b558-c619f72f0e1b None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:43.071926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43efe2d-d819-459d-b558-c619f72f0e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:43.072123 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43efe2d-d819-459d-b558-c619f72f0e1b None admin] PATH_INFO: `/v3/users/b02c8e8e6a344a449b0c643b68da015b` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:43.073310 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43efe2d-d819-459d-b558-c619f72f0e1b None admin] RBAC: Authorizing `identity:get_user(user_id=b02c8e8e6a344a449b0c643b68da015b)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:43.074783 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43efe2d-d819-459d-b558-c619f72f0e1b None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:43.076739 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 127/248] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:42 2022] GET /identity/v3/users/b02c8e8e6a344a449b0c643b68da015b => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:43.082237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43efe2d-d819-459d-b558-c619f72f0e1b None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:43.100423 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:43.133658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa67eaf-df96-40e6-a59c-6183930cfbf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:43.135731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa67eaf-df96-40e6-a59c-6183930cfbf9 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:43.174362 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:43.194486 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43efe2d-d819-459d-b558-c619f72f0e1b None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:43.241771 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a3d35-8c8d-44ad-a0d5-5e2c86ce7989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:43.242953 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a3d35-8c8d-44ad-a0d5-5e2c86ce7989 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:43.243246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a3d35-8c8d-44ad-a0d5-5e2c86ce7989 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:43.243549 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a3d35-8c8d-44ad-a0d5-5e2c86ce7989 None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:43.244944 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a3d35-8c8d-44ad-a0d5-5e2c86ce7989 None admin] RBAC: Authorizing `identity:get_project(project_id=f9f866c53099419c8982f8720259b8bf)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:43.246457 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a3d35-8c8d-44ad-a0d5-5e2c86ce7989 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:43.249426 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 128/249] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:43 2022] GET /identity/v3/projects/f9f866c53099419c8982f8720259b8bf => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:43.257064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a3d35-8c8d-44ad-a0d5-5e2c86ce7989 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:43.267979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 122/250] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 18:24:43.274032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa67eaf-df96-40e6-a59c-6183930cfbf9 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:43.366005 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:43.387320 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a3d35-8c8d-44ad-a0d5-5e2c86ce7989 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:43.389836 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:43.406616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa67eaf-df96-40e6-a59c-6183930cfbf9 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:43.428714 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101b4d6-eabc-4117-ac3b-09ce6d864d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:43.430080 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101b4d6-eabc-4117-ac3b-09ce6d864d2f None admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:43.430568 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101b4d6-eabc-4117-ac3b-09ce6d864d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:43.431069 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101b4d6-eabc-4117-ac3b-09ce6d864d2f None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf/users/b02c8e8e6a344a449b0c643b68da015b/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:43.434207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101b4d6-eabc-4117-ac3b-09ce6d864d2f None admin] RBAC: Authorizing `identity:create_grant(project_id=f9f866c53099419c8982f8720259b8bf, user_id=b02c8e8e6a344a449b0c643b68da015b, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:43.435933 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101b4d6-eabc-4117-ac3b-09ce6d864d2f None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:43.449855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426bd4a-fc1a-4716-b99c-09469cb7b01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:43.450509 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426bd4a-fc1a-4716-b99c-09469cb7b01c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:43.455360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426bd4a-fc1a-4716-b99c-09469cb7b01c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:43.455360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426bd4a-fc1a-4716-b99c-09469cb7b01c None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:43.455360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426bd4a-fc1a-4716-b99c-09469cb7b01c None admin] RBAC: Authorizing `identity:get_project(project_id=f9f866c53099419c8982f8720259b8bf)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:43.455360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426bd4a-fc1a-4716-b99c-09469cb7b01c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:43.455662 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 123/251] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:43 2022] GET /identity/v3/projects/f9f866c53099419c8982f8720259b8bf => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:43.461512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426bd4a-fc1a-4716-b99c-09469cb7b01c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:43.518876 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 129/252] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:24:43 2022] PUT /identity/v3/projects/f9f866c53099419c8982f8720259b8bf/users/b02c8e8e6a344a449b0c643b68da015b/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:24:43.587944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426bd4a-fc1a-4716-b99c-09469cb7b01c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:43.633217 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a328bd-ef27-4d69-82a1-d975b84818a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:43.633939 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a328bd-ef27-4d69-82a1-d975b84818a7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:43.634225 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a328bd-ef27-4d69-82a1-d975b84818a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:43.634568 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a328bd-ef27-4d69-82a1-d975b84818a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:43.635475 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a328bd-ef27-4d69-82a1-d975b84818a7 None admin] RBAC: Adding query filter params (role.id=27bb3ae43da44e3a87a409e5adae712c, scope.project.id=f9f866c53099419c8982f8720259b8bf, user.id=3714b860a81942f980ed6eee1ba7dec1) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:43.635789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a328bd-ef27-4d69-82a1-d975b84818a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:43.637349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a328bd-ef27-4d69-82a1-d975b84818a7 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:43.645043 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 124/253] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:24:43 2022] GET /identity/v3/role_assignments?user.id=3714b860a81942f980ed6eee1ba7dec1&scope.project.id=f9f866c53099419c8982f8720259b8bf&role.id=27bb3ae43da44e3a87a409e5adae712c => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:44.320218 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f1c05-0493-4668-80c9-3f553bb16f11 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:44.320600 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f1c05-0493-4668-80c9-3f553bb16f11 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:44.320779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f1c05-0493-4668-80c9-3f553bb16f11 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:44.322290 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 130/254] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:44.327603 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fddb45-a50c-4903-8da3-b4153a92e478 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:44.328068 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fddb45-a50c-4903-8da3-b4153a92e478 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:44.328143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fddb45-a50c-4903-8da3-b4153a92e478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:44.356268 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-35fddb45-a50c-4903-8da3-b4153a92e478 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:44.357578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-35fddb45-a50c-4903-8da3-b4153a92e478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:44.373431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:44.438731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 125/255] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:44.490205 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f1c05-0493-4668-80c9-3f553bb16f11 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:44.601587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f1c05-0493-4668-80c9-3f553bb16f11 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:44.643008 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34a9e8-f8a7-49bc-a18b-99c0c4f5a5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:44.644380 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34a9e8-f8a7-49bc-a18b-99c0c4f5a5ec None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:44.644669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34a9e8-f8a7-49bc-a18b-99c0c4f5a5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:44.644947 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34a9e8-f8a7-49bc-a18b-99c0c4f5a5ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:44.656208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34a9e8-f8a7-49bc-a18b-99c0c4f5a5ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:44.661394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-6b34a9e8-f8a7-49bc-a18b-99c0c4f5a5ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:24:44.661394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:44.661394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:44.661394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:44.661394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:44.661394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:44.661394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:44.661394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:44.661394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:44.661394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:44.661394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:44.661394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:44.661394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:44.661394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:44.661394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:44.661394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:44.662298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:44.662298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:44.662298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:44.662298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:44.662298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:44.662298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:44.662298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:44.662298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:44.662298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:44.662298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:44.662298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:44.662298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:44.662298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:44.662298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:44.662298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:44.662298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:44.663528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:44.663528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:44.663528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:44.663528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:44.663528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:44.663528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:44.663528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:44.663528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:44.663528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:44.663528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:44.663528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:24:44.663528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:24:44.663528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 131/256] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 18:24:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:44.668873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fddb45-a50c-4903-8da3-b4153a92e478 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:44.689092 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51169b6-1520-4c9d-9ad2-03e12ee4ef89 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:44.689400 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51169b6-1520-4c9d-9ad2-03e12ee4ef89 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:44.689655 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51169b6-1520-4c9d-9ad2-03e12ee4ef89 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:44.692481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 132/257] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:24:44.697715 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade88fdc-9adf-4073-b76c-dfdde9f7ae8e None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:44.697994 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade88fdc-9adf-4073-b76c-dfdde9f7ae8e None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:44.698274 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade88fdc-9adf-4073-b76c-dfdde9f7ae8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:44.704788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:44.717396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-ade88fdc-9adf-4073-b76c-dfdde9f7ae8e None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:44.718602 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ade88fdc-9adf-4073-b76c-dfdde9f7ae8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:44.793267 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 133/258] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:24:44.820707 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade88fdc-9adf-4073-b76c-dfdde9f7ae8e None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:44.853567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fddb45-a50c-4903-8da3-b4153a92e478 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:44.946828 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade88fdc-9adf-4073-b76c-dfdde9f7ae8e None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:44.980085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f079ba-cb5c-43be-9d1e-561388f62550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:44.980738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f079ba-cb5c-43be-9d1e-561388f62550 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:44.981032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f079ba-cb5c-43be-9d1e-561388f62550 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:44.981297 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f079ba-cb5c-43be-9d1e-561388f62550 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:44.981396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:44.982048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f079ba-cb5c-43be-9d1e-561388f62550 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:44.982350 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f079ba-cb5c-43be-9d1e-561388f62550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:44.983806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f079ba-cb5c-43be-9d1e-561388f62550 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:44.985094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c51360-6061-4896-a9cd-edda5832cf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:44.986154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c51360-6061-4896-a9cd-edda5832cf18 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:44.986624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c51360-6061-4896-a9cd-edda5832cf18 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:44.995468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c51360-6061-4896-a9cd-edda5832cf18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:45.000023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c51360-6061-4896-a9cd-edda5832cf18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:45.006066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-66c51360-6061-4896-a9cd-edda5832cf18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:24:45.006066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:45.006066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:45.006066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:45.006066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:45.006066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:45.006066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:45.006066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:45.006066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:45.006066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:45.006066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:45.006066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:45.006066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:45.006066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:45.006066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:45.006066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:45.006957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:45.006957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:45.006957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:45.006957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:45.006957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:45.006957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:45.006957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:45.006957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:45.006957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:45.006957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:45.006957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:45.006957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:45.006957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:45.006957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:45.006957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:45.006957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:45.007787 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:45.007787 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:45.007787 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:45.007787 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:45.007787 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:45.007787 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:45.007787 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:45.007787 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:45.007787 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:45.007787 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:45.007787 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:24:45.007787 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:24:45.008391 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 126/259] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:24:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:45.010097 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 134/260] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:24:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:24:45.015723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f079ba-cb5c-43be-9d1e-561388f62550 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:45.025372 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c51360-6061-4896-a9cd-edda5832cf18 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:45.039224 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:45.136871 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c51360-6061-4896-a9cd-edda5832cf18 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:45.188055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5fb97-1f14-49da-b7d1-9e8ecc424c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:45.188696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5fb97-1f14-49da-b7d1-9e8ecc424c41 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:45.188979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5fb97-1f14-49da-b7d1-9e8ecc424c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:45.189256 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5fb97-1f14-49da-b7d1-9e8ecc424c41 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:45.189989 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5fb97-1f14-49da-b7d1-9e8ecc424c41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:45.190410 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5fb97-1f14-49da-b7d1-9e8ecc424c41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:45.192034 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5fb97-1f14-49da-b7d1-9e8ecc424c41 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:45.209887 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 135/261] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:45.217286 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5fb97-1f14-49da-b7d1-9e8ecc424c41 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:45.219142 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f079ba-cb5c-43be-9d1e-561388f62550 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:45.299135 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce423c37-a011-47b4-82e9-09c56d2c222a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:45.299870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce423c37-a011-47b4-82e9-09c56d2c222a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:45.300153 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce423c37-a011-47b4-82e9-09c56d2c222a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:45.300518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce423c37-a011-47b4-82e9-09c56d2c222a None admin] PATH_INFO: `/v3/users/20ef63cdd331463a8d6aab703d47059c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:45.306201 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce423c37-a011-47b4-82e9-09c56d2c222a None admin] RBAC: Authorizing `identity:get_user(user_id=20ef63cdd331463a8d6aab703d47059c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:45.309659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce423c37-a011-47b4-82e9-09c56d2c222a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:45.311894 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 127/262] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:45 2022] GET /identity/v3/users/20ef63cdd331463a8d6aab703d47059c => generated 283 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:45.321020 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce423c37-a011-47b4-82e9-09c56d2c222a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:45.332425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:45.429555 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5fb97-1f14-49da-b7d1-9e8ecc424c41 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:45.485489 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:45.496574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251071af-20e0-4ceb-b33d-4ef67d56769f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:45.497229 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251071af-20e0-4ceb-b33d-4ef67d56769f None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:45.497533 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251071af-20e0-4ceb-b33d-4ef67d56769f None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:45.497793 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251071af-20e0-4ceb-b33d-4ef67d56769f None admin] PATH_INFO: `/v3/users/20ef63cdd331463a8d6aab703d47059c` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:45.499914 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251071af-20e0-4ceb-b33d-4ef67d56769f None admin] RBAC: Authorizing `identity:get_user(user_id=20ef63cdd331463a8d6aab703d47059c)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:45.501634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251071af-20e0-4ceb-b33d-4ef67d56769f None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:45.507391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 136/263] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:45 2022] GET /identity/v3/users/20ef63cdd331463a8d6aab703d47059c => generated 283 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:45.510521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251071af-20e0-4ceb-b33d-4ef67d56769f None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:45.530318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce423c37-a011-47b4-82e9-09c56d2c222a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:45.605180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c9d38-d8a3-43af-9f95-635ca6f3bd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:45.605823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c9d38-d8a3-43af-9f95-635ca6f3bd5b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:45.606109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c9d38-d8a3-43af-9f95-635ca6f3bd5b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:45.606432 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c9d38-d8a3-43af-9f95-635ca6f3bd5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:45.689262 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251071af-20e0-4ceb-b33d-4ef67d56769f None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:45.739193 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:45.741535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c9d38-d8a3-43af-9f95-635ca6f3bd5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:45.743045 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c9d38-d8a3-43af-9f95-635ca6f3bd5b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:45.762529 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7ea30-19a0-4fb8-80e4-82e7419c1250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:45.763168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7ea30-19a0-4fb8-80e4-82e7419c1250 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:45.763478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7ea30-19a0-4fb8-80e4-82e7419c1250 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:45.763757 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7ea30-19a0-4fb8-80e4-82e7419c1250 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:45.859590 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7ea30-19a0-4fb8-80e4-82e7419c1250 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:45.861412 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7ea30-19a0-4fb8-80e4-82e7419c1250 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:45.867630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:45.905496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 128/264] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 18:24:45.921004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c9d38-d8a3-43af-9f95-635ca6f3bd5b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:45.977532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 137/265] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:24:45.992586 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7ea30-19a0-4fb8-80e4-82e7419c1250 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:46.017804 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:46.083630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c9d38-d8a3-43af-9f95-635ca6f3bd5b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:46.100676 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7ea30-19a0-4fb8-80e4-82e7419c1250 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:46.148875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60125b-d633-4d62-b8f8-2ba648478e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:46.149914 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60125b-d633-4d62-b8f8-2ba648478e61 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:46.150404 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60125b-d633-4d62-b8f8-2ba648478e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:46.150882 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60125b-d633-4d62-b8f8-2ba648478e61 None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:46.152903 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5265ae1-08d7-4e83-aa9f-7f969292e7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:46.153565 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5265ae1-08d7-4e83-aa9f-7f969292e7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:46.153847 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5265ae1-08d7-4e83-aa9f-7f969292e7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:46.154124 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5265ae1-08d7-4e83-aa9f-7f969292e7f0 None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:46.154434 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60125b-d633-4d62-b8f8-2ba648478e61 None admin] RBAC: Authorizing `identity:get_project(project_id=f9f866c53099419c8982f8720259b8bf)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:46.156135 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60125b-d633-4d62-b8f8-2ba648478e61 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:46.158388 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 138/266] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:45 2022] GET /identity/v3/projects/f9f866c53099419c8982f8720259b8bf => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:46.163048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5265ae1-08d7-4e83-aa9f-7f969292e7f0 None admin] RBAC: Authorizing `identity:get_project(project_id=f9f866c53099419c8982f8720259b8bf)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:46.163048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5265ae1-08d7-4e83-aa9f-7f969292e7f0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:46.163048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 129/267] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:45 2022] GET /identity/v3/projects/f9f866c53099419c8982f8720259b8bf => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:46.173656 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60125b-d633-4d62-b8f8-2ba648478e61 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:46.173865 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5265ae1-08d7-4e83-aa9f-7f969292e7f0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:46.235725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:46.324457 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:46.328180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5265ae1-08d7-4e83-aa9f-7f969292e7f0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:46.334830 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60125b-d633-4d62-b8f8-2ba648478e61 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:46.381399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4be06-5477-4cec-8016-929415ef17ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:46.382046 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4be06-5477-4cec-8016-929415ef17ba None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:46.382336 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4be06-5477-4cec-8016-929415ef17ba None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:46.382615 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4be06-5477-4cec-8016-929415ef17ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:46.383461 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4be06-5477-4cec-8016-929415ef17ba None admin] RBAC: Adding query filter params (role.id=4ae8d11d74f14bcc80117d897ba2f5b6, scope.project.id=f9f866c53099419c8982f8720259b8bf, user.id=20ef63cdd331463a8d6aab703d47059c) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:46.383785 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4be06-5477-4cec-8016-929415ef17ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:46.385259 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4be06-5477-4cec-8016-929415ef17ba None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:46.398117 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 139/268] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:24:46 2022] GET /identity/v3/role_assignments?user.id=20ef63cdd331463a8d6aab703d47059c&scope.project.id=f9f866c53099419c8982f8720259b8bf&role.id=4ae8d11d74f14bcc80117d897ba2f5b6 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:46.416191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acdfb9-aa13-4c8d-9197-96e8589f5532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:46.416847 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acdfb9-aa13-4c8d-9197-96e8589f5532 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:46.417131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acdfb9-aa13-4c8d-9197-96e8589f5532 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:46.417410 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acdfb9-aa13-4c8d-9197-96e8589f5532 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:46.418231 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acdfb9-aa13-4c8d-9197-96e8589f5532 None admin] RBAC: Adding query filter params (role.id=dd7069600e364802831ce7c375e57fcd, scope.project.id=f9f866c53099419c8982f8720259b8bf, user.id=20ef63cdd331463a8d6aab703d47059c) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:46.418543 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acdfb9-aa13-4c8d-9197-96e8589f5532 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:46.420066 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acdfb9-aa13-4c8d-9197-96e8589f5532 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:46.431770 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 130/269] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:24:46 2022] GET /identity/v3/role_assignments?user.id=20ef63cdd331463a8d6aab703d47059c&scope.project.id=f9f866c53099419c8982f8720259b8bf&role.id=dd7069600e364802831ce7c375e57fcd => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:46.490084 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacaee1-9fc5-48b3-b463-dd2673490673 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:46.490381 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacaee1-9fc5-48b3-b463-dd2673490673 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:46.490570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacaee1-9fc5-48b3-b463-dd2673490673 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:46.492435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 140/270] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:46.497933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417c638-9aa4-43cb-94b7-552d4c9452d9 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:46.498420 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417c638-9aa4-43cb-94b7-552d4c9452d9 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:46.498496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417c638-9aa4-43cb-94b7-552d4c9452d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:46.532925 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-2417c638-9aa4-43cb-94b7-552d4c9452d9 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:46.534230 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2417c638-9aa4-43cb-94b7-552d4c9452d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:46.557051 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad68c2-7d55-4ea5-b0a2-05760cbd0ca9 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:46.557579 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad68c2-7d55-4ea5-b0a2-05760cbd0ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:46.557654 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad68c2-7d55-4ea5-b0a2-05760cbd0ca9 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:46.559359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 141/271] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:46.565035 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07714f8a-c42f-4f3a-a4eb-89bd2919c7ae None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:46.565516 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07714f8a-c42f-4f3a-a4eb-89bd2919c7ae None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:46.565818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07714f8a-c42f-4f3a-a4eb-89bd2919c7ae None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:46.567320 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 142/272] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:46.568555 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae460c-e90e-44ac-8e42-35597d049709 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:46.568841 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae460c-e90e-44ac-8e42-35597d049709 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:46.576232 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae460c-e90e-44ac-8e42-35597d049709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:46.609382 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-d0ae460c-e90e-44ac-8e42-35597d049709 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:46.610629 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-d0ae460c-e90e-44ac-8e42-35597d049709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:46.666862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 131/273] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:46.669873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa58a7f-51b4-4580-bfc6-7d76f4e4a839 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:46.670166 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa58a7f-51b4-4580-bfc6-7d76f4e4a839 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:46.670443 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa58a7f-51b4-4580-bfc6-7d76f4e4a839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:46.702911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-bfa58a7f-51b4-4580-bfc6-7d76f4e4a839 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:46.704155 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-bfa58a7f-51b4-4580-bfc6-7d76f4e4a839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:46.745280 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 143/274] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:46.745627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae460c-e90e-44ac-8e42-35597d049709 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:46.751860 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:46.794546 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 132/275] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:46.795755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa58a7f-51b4-4580-bfc6-7d76f4e4a839 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:46.869724 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:46.889047 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae460c-e90e-44ac-8e42-35597d049709 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:46.920334 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa58a7f-51b4-4580-bfc6-7d76f4e4a839 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:46.926445 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c42903-8057-4d9f-8c6e-ee64171b74ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:46.927094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c42903-8057-4d9f-8c6e-ee64171b74ab None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:46.927405 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c42903-8057-4d9f-8c6e-ee64171b74ab None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:46.927681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c42903-8057-4d9f-8c6e-ee64171b74ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:46.940783 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c42903-8057-4d9f-8c6e-ee64171b74ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:46.946421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-46c42903-8057-4d9f-8c6e-ee64171b74ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:46.946421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:46.946421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:46.946421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:46.946421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:46.946421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:46.946421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:46.946421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:46.946421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:46.946421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:46.946421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:46.946421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:46.946421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:46.946421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:46.946421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:46.946421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:46.947560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:46.947560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:46.947560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:46.947560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:46.947560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:46.947560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:46.947560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:46.947560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:46.947560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:46.947560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:46.947560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:46.947560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:46.947560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:46.947560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:46.947560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:46.947560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:46.948366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:46.948366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:46.948366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:46.948366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:46.948366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:46.948366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:46.948366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:46.948366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:46.948366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:46.948366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:46.948366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:46.948366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:24:46.948366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 144/276] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:46.949023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c42903-8057-4d9f-8c6e-ee64171b74ab None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:46.965147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c204d1-8f70-4f1d-8ccd-e1d92983062a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:46.965796 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c204d1-8f70-4f1d-8ccd-e1d92983062a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:46.966084 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c204d1-8f70-4f1d-8ccd-e1d92983062a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:46.966360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c204d1-8f70-4f1d-8ccd-e1d92983062a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:46.978148 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c204d1-8f70-4f1d-8ccd-e1d92983062a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:46.983308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-22c204d1-8f70-4f1d-8ccd-e1d92983062a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:24:46.983308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:46.983308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:46.983308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:46.983308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:46.983308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:46.983308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:46.983308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:46.983308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:46.983308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:46.983308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:46.983308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:46.983308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:46.983308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:46.983308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:46.983308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:46.984226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:46.984226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:46.984226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:46.984226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:46.984226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:46.984226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:46.984226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:46.984226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:46.984226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:46.984226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:46.984226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:46.984226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:46.984226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:46.984226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:46.984226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:46.984226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:46.993425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:46.993425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:46.993425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:46.993425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:46.993425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:46.993425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:46.993425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:46.993425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:46.993425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:46.993425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:46.993425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:24:46.993425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:24:46.993425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 133/277] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:46.993425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c204d1-8f70-4f1d-8ccd-e1d92983062a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:47.025352 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:47.080260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c42903-8057-4d9f-8c6e-ee64171b74ab None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:47.099060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c204d1-8f70-4f1d-8ccd-e1d92983062a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:47.118520 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c66f9-052a-4e27-8140-8b804d878762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:47.119517 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c66f9-052a-4e27-8140-8b804d878762 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:47.119944 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c66f9-052a-4e27-8140-8b804d878762 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:47.120363 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c66f9-052a-4e27-8140-8b804d878762 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:47.121805 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c66f9-052a-4e27-8140-8b804d878762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:47.123598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c66f9-052a-4e27-8140-8b804d878762 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:47.125578 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 145/278] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:24:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:47.126740 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c66f9-052a-4e27-8140-8b804d878762 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:47.135863 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078ae3e-43c1-4b7f-a709-f0d74a2de3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:47.136494 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078ae3e-43c1-4b7f-a709-f0d74a2de3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:47.136779 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078ae3e-43c1-4b7f-a709-f0d74a2de3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:47.137057 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078ae3e-43c1-4b7f-a709-f0d74a2de3c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:47.137786 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078ae3e-43c1-4b7f-a709-f0d74a2de3c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:47.138094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078ae3e-43c1-4b7f-a709-f0d74a2de3c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:47.139521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078ae3e-43c1-4b7f-a709-f0d74a2de3c4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:47.142633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:47.148052 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 134/279] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:47.152246 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfe1be-8c1c-4460-8213-c14eaf974bbe None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:47.152539 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfe1be-8c1c-4460-8213-c14eaf974bbe None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:47.159717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfe1be-8c1c-4460-8213-c14eaf974bbe None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:47.159717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 135/280] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:47.159717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfe1be-8c1c-4460-8213-c14eaf974bbe None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:47.229108 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c66f9-052a-4e27-8140-8b804d878762 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:47.248641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:47.258756 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfe1be-8c1c-4460-8213-c14eaf974bbe None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:47.263888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581c092-e534-4bdc-b410-31f673ca303b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:47.264504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581c092-e534-4bdc-b410-31f673ca303b None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:47.264840 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581c092-e534-4bdc-b410-31f673ca303b None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:47.265055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581c092-e534-4bdc-b410-31f673ca303b None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:47.265779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581c092-e534-4bdc-b410-31f673ca303b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:47.266074 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581c092-e534-4bdc-b410-31f673ca303b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:47.267539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581c092-e534-4bdc-b410-31f673ca303b None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:47.281474 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 146/281] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:47.281474 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581c092-e534-4bdc-b410-31f673ca303b None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:47.293294 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c00e42-6dff-4841-b960-c3f64c09e429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:47.293923 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c00e42-6dff-4841-b960-c3f64c09e429 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:47.294208 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c00e42-6dff-4841-b960-c3f64c09e429 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:47.294483 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c00e42-6dff-4841-b960-c3f64c09e429 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:47.295219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c00e42-6dff-4841-b960-c3f64c09e429 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:47.296766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c00e42-6dff-4841-b960-c3f64c09e429 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:47.352376 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:47.375821 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581c092-e534-4bdc-b410-31f673ca303b None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:47.408579 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633037d-2788-48ed-a428-38fbf57289f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:47.409286 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633037d-2788-48ed-a428-38fbf57289f3 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:47.409566 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633037d-2788-48ed-a428-38fbf57289f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:47.409836 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633037d-2788-48ed-a428-38fbf57289f3 None admin] PATH_INFO: `/v3/users/bf9ed2730b4d47a69b7f88df008d61f2` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:47.420932 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 136/282] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 18:24:47 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:47.422717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2d68f-fe62-485d-8ff3-6c2282ac3ffc None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:47.423011 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2d68f-fe62-485d-8ff3-6c2282ac3ffc None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:47.423300 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2d68f-fe62-485d-8ff3-6c2282ac3ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:47.425303 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633037d-2788-48ed-a428-38fbf57289f3 None admin] RBAC: Authorizing `identity:get_user(user_id=bf9ed2730b4d47a69b7f88df008d61f2)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:47.426811 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633037d-2788-48ed-a428-38fbf57289f3 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:47.429037 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 147/283] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:47 2022] GET /identity/v3/users/bf9ed2730b4d47a69b7f88df008d61f2 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:47.429910 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633037d-2788-48ed-a428-38fbf57289f3 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:47.455643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-52f2d68f-fe62-485d-8ff3-6c2282ac3ffc None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:47.457762 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-52f2d68f-fe62-485d-8ff3-6c2282ac3ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:47.542333 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 137/284] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:47.542990 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2d68f-fe62-485d-8ff3-6c2282ac3ffc None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:47.562919 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633037d-2788-48ed-a428-38fbf57289f3 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:47.605359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:47.611154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38192d08-240b-4f73-9766-8fca043349dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:47.611838 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38192d08-240b-4f73-9766-8fca043349dd None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:47.612381 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38192d08-240b-4f73-9766-8fca043349dd None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:47.612906 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38192d08-240b-4f73-9766-8fca043349dd None admin] PATH_INFO: `/v3/users/3714b860a81942f980ed6eee1ba7dec1` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:47.614429 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38192d08-240b-4f73-9766-8fca043349dd None admin] RBAC: Authorizing `identity:get_user(user_id=3714b860a81942f980ed6eee1ba7dec1)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:47.616483 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38192d08-240b-4f73-9766-8fca043349dd None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:47.619159 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 148/285] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:47 2022] GET /identity/v3/users/3714b860a81942f980ed6eee1ba7dec1 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:47.619159 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38192d08-240b-4f73-9766-8fca043349dd None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:47.649492 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:47.677345 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2d68f-fe62-485d-8ff3-6c2282ac3ffc None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:47.719096 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab45a4-4717-4d87-83ac-910ac3c4bd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:47.719777 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab45a4-4717-4d87-83ac-910ac3c4bd5e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:47.720074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab45a4-4717-4d87-83ac-910ac3c4bd5e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:47.722548 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab45a4-4717-4d87-83ac-910ac3c4bd5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:47.723551 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab45a4-4717-4d87-83ac-910ac3c4bd5e None admin] RBAC: Adding query filter params (role.id=f105208a21c84d4fa134aa0aeb62f3bb, user.id=bf9ed2730b4d47a69b7f88df008d61f2, scope.system=all) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:47.723978 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab45a4-4717-4d87-83ac-910ac3c4bd5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:47.726250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab45a4-4717-4d87-83ac-910ac3c4bd5e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:47.731688 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 138/286] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Jul 27 18:24:47 2022] GET /identity/v3/role_assignments?user.id=bf9ed2730b4d47a69b7f88df008d61f2&scope.system=all&role.id=f105208a21c84d4fa134aa0aeb62f3bb => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:47.732626 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab45a4-4717-4d87-83ac-910ac3c4bd5e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:47.753390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38192d08-240b-4f73-9766-8fca043349dd None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:47.801148 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1112e4-0925-4cb5-8970-df79fae5a9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:47.801894 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1112e4-0925-4cb5-8970-df79fae5a9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:47.802181 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1112e4-0925-4cb5-8970-df79fae5a9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:47.802460 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1112e4-0925-4cb5-8970-df79fae5a9b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:47.815200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1112e4-0925-4cb5-8970-df79fae5a9b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:47.821547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-2a1112e4-0925-4cb5-8970-df79fae5a9b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:47.821547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:47.821547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:47.821547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:47.821547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:47.821547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:47.821547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:47.821547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:47.821547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:47.821547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:47.821547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:47.821547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:47.821547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:47.821547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:47.821547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:47.821547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:47.822455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:47.822455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:47.822455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:47.822455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:47.822455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:47.822455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:47.822455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:47.822455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:47.822455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:47.822455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:47.822455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:47.822455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:47.822455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:47.822455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:47.822455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:47.822455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:47.823317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:47.823317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:47.823317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:47.823317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:47.823317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:47.823317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:47.823317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:47.823317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:47.823317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:47.823317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:47.823317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:47.823317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:24:47.823317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 149/287] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:47.829357 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1112e4-0925-4cb5-8970-df79fae5a9b3 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:47.867388 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab45a4-4717-4d87-83ac-910ac3c4bd5e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:47.915492 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fd999-eb57-4192-bb97-04a5dd1c89bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:47.916173 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fd999-eb57-4192-bb97-04a5dd1c89bb None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:47.916463 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fd999-eb57-4192-bb97-04a5dd1c89bb None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:47.916744 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fd999-eb57-4192-bb97-04a5dd1c89bb None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:47.920769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fd999-eb57-4192-bb97-04a5dd1c89bb None admin] RBAC: Authorizing `identity:get_project(project_id=f9f866c53099419c8982f8720259b8bf)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:47.922281 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fd999-eb57-4192-bb97-04a5dd1c89bb None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:47.929554 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 139/288] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:47 2022] GET /identity/v3/projects/f9f866c53099419c8982f8720259b8bf => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:47.930479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fd999-eb57-4192-bb97-04a5dd1c89bb None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:47.952120 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:47.963683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:48.015328 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1112e4-0925-4cb5-8970-df79fae5a9b3 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:48.065489 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b2c4e-0db7-4ff4-b311-ea2e0f2ae0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:48.066135 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b2c4e-0db7-4ff4-b311-ea2e0f2ae0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:48.066430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b2c4e-0db7-4ff4-b311-ea2e0f2ae0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:48.066707 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b2c4e-0db7-4ff4-b311-ea2e0f2ae0b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:48.067469 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b2c4e-0db7-4ff4-b311-ea2e0f2ae0b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:48.067778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b2c4e-0db7-4ff4-b311-ea2e0f2ae0b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:48.069190 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b2c4e-0db7-4ff4-b311-ea2e0f2ae0b9 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:48.092440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 150/289] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:48.097088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b2c4e-0db7-4ff4-b311-ea2e0f2ae0b9 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:48.151180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fd999-eb57-4192-bb97-04a5dd1c89bb None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:48.202607 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d83c08-870d-4db0-bb42-7e21a3658d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:48.204575 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d83c08-870d-4db0-bb42-7e21a3658d87 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:48.205225 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d83c08-870d-4db0-bb42-7e21a3658d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:48.206727 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d83c08-870d-4db0-bb42-7e21a3658d87 None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf/users/3714b860a81942f980ed6eee1ba7dec1/roles/27bb3ae43da44e3a87a409e5adae712c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:48.210653 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d83c08-870d-4db0-bb42-7e21a3658d87 None admin] RBAC: Authorizing `identity:create_grant(project_id=f9f866c53099419c8982f8720259b8bf, user_id=3714b860a81942f980ed6eee1ba7dec1, role_id=27bb3ae43da44e3a87a409e5adae712c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:48.213205 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d83c08-870d-4db0-bb42-7e21a3658d87 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:48.249758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b2c4e-0db7-4ff4-b311-ea2e0f2ae0b9 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:48.276248 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:48.289383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e41a25-a8bd-44c6-8833-62e36839af45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:48.290507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e41a25-a8bd-44c6-8833-62e36839af45 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:48.291052 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e41a25-a8bd-44c6-8833-62e36839af45 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:48.291588 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e41a25-a8bd-44c6-8833-62e36839af45 None admin] PATH_INFO: `/v3/users/b02c8e8e6a344a449b0c643b68da015b` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:48.293033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e41a25-a8bd-44c6-8833-62e36839af45 None admin] RBAC: Authorizing `identity:get_user(user_id=b02c8e8e6a344a449b0c643b68da015b)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:48.294859 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e41a25-a8bd-44c6-8833-62e36839af45 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:48.297231 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 151/290] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:48 2022] GET /identity/v3/users/b02c8e8e6a344a449b0c643b68da015b => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:48.304613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e41a25-a8bd-44c6-8833-62e36839af45 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:48.329043 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 140/291] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:24:47 2022] PUT /identity/v3/projects/f9f866c53099419c8982f8720259b8bf/users/3714b860a81942f980ed6eee1ba7dec1/roles/27bb3ae43da44e3a87a409e5adae712c => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:48.431969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e41a25-a8bd-44c6-8833-62e36839af45 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:48.469946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3619c43-b7e1-4d19-aaba-562c354fec2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:48.470598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3619c43-b7e1-4d19-aaba-562c354fec2e None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:48.470883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3619c43-b7e1-4d19-aaba-562c354fec2e None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:48.471164 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3619c43-b7e1-4d19-aaba-562c354fec2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:48.548568 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:48.565597 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3619c43-b7e1-4d19-aaba-562c354fec2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:48.567924 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3619c43-b7e1-4d19-aaba-562c354fec2e None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:48.683550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 152/292] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:24:48.688997 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d83c08-870d-4db0-bb42-7e21a3658d87 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:48.795636 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:48.838503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d83c08-870d-4db0-bb42-7e21a3658d87 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:48.895754 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c3977-d61f-4e74-a96f-36ef6febd465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:48.896431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c3977-d61f-4e74-a96f-36ef6febd465 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:48.896756 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c3977-d61f-4e74-a96f-36ef6febd465 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:48.897032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c3977-d61f-4e74-a96f-36ef6febd465 None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:48.903102 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c3977-d61f-4e74-a96f-36ef6febd465 None admin] RBAC: Authorizing `identity:get_project(project_id=f9f866c53099419c8982f8720259b8bf)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:48.904716 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c3977-d61f-4e74-a96f-36ef6febd465 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:48.907017 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 141/293] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:48 2022] GET /identity/v3/projects/f9f866c53099419c8982f8720259b8bf => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:48.913159 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3619c43-b7e1-4d19-aaba-562c354fec2e None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:49.021398 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:49.031125 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3619c43-b7e1-4d19-aaba-562c354fec2e None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:49.069318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1f777-cb91-4093-8e25-3b7d295f7313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:49.069955 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1f777-cb91-4093-8e25-3b7d295f7313 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:49.070243 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1f777-cb91-4093-8e25-3b7d295f7313 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:49.070523 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1f777-cb91-4093-8e25-3b7d295f7313 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:49.071352 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1f777-cb91-4093-8e25-3b7d295f7313 None admin] RBAC: Adding query filter params (role.id=f105208a21c84d4fa134aa0aeb62f3bb, scope.project.id=f9f866c53099419c8982f8720259b8bf, user.id=b02c8e8e6a344a449b0c643b68da015b) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:49.071672 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1f777-cb91-4093-8e25-3b7d295f7313 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:49.073122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1f777-cb91-4093-8e25-3b7d295f7313 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:49.080127 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 153/294] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:24:48 2022] GET /identity/v3/role_assignments?user.id=b02c8e8e6a344a449b0c643b68da015b&scope.project.id=f9f866c53099419c8982f8720259b8bf&role.id=f105208a21c84d4fa134aa0aeb62f3bb => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:49.980629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f9aa2-9677-4b73-b182-9a11f89cb425 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:49.981165 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f9aa2-9677-4b73-b182-9a11f89cb425 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:49.981165 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f9aa2-9677-4b73-b182-9a11f89cb425 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:49.982818 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 142/295] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:49.988866 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b91dc7-4121-447b-81ba-bc7fb8925470 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:49.989315 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b91dc7-4121-447b-81ba-bc7fb8925470 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:49.989392 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b91dc7-4121-447b-81ba-bc7fb8925470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:50.008173 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-f2b91dc7-4121-447b-81ba-bc7fb8925470 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:50.009408 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-f2b91dc7-4121-447b-81ba-bc7fb8925470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:50.013310 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382349d-0f37-4198-aeba-17d78d80414d None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:50.013589 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382349d-0f37-4198-aeba-17d78d80414d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:50.013864 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382349d-0f37-4198-aeba-17d78d80414d None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:50.019220 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 143/296] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:24:50.020443 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6a39f-0053-4d15-b65e-34dc76792799 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:50.021100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6a39f-0053-4d15-b65e-34dc76792799 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:50.021100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6a39f-0053-4d15-b65e-34dc76792799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:50.040237 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-67e6a39f-0053-4d15-b65e-34dc76792799 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:50.041567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-67e6a39f-0053-4d15-b65e-34dc76792799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:50.090179 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 154/297] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:24:50.093247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c509a-084f-4c15-8052-905428422360 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:50.093544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c509a-084f-4c15-8052-905428422360 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:50.093826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c509a-084f-4c15-8052-905428422360 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:50.095294 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 155/298] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:24:50.100619 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d54b8b-48da-4977-9ee2-0ad500e1ce55 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:50.100910 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d54b8b-48da-4977-9ee2-0ad500e1ce55 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:50.101195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d54b8b-48da-4977-9ee2-0ad500e1ce55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:50.114168 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 144/299] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:50.115087 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6a39f-0053-4d15-b65e-34dc76792799 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:50.121751 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-f4d54b8b-48da-4977-9ee2-0ad500e1ce55 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:50.123477 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-f4d54b8b-48da-4977-9ee2-0ad500e1ce55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:50.187453 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:50.200034 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 156/300] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:24:50.200974 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d54b8b-48da-4977-9ee2-0ad500e1ce55 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:50.223539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:50.229837 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6a39f-0053-4d15-b65e-34dc76792799 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:50.267717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406728ed-674b-47d4-b233-4ae627d5b846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:50.268871 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406728ed-674b-47d4-b233-4ae627d5b846 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:50.269157 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406728ed-674b-47d4-b233-4ae627d5b846 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:50.269426 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406728ed-674b-47d4-b233-4ae627d5b846 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:50.270586 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406728ed-674b-47d4-b233-4ae627d5b846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:50.272070 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406728ed-674b-47d4-b233-4ae627d5b846 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:50.273841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 145/301] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:24:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:50.274529 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406728ed-674b-47d4-b233-4ae627d5b846 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:50.323133 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d54b8b-48da-4977-9ee2-0ad500e1ce55 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:50.361220 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530812e-307e-438e-a17a-4a54c299ce7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:50.362527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530812e-307e-438e-a17a-4a54c299ce7e None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:50.362841 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530812e-307e-438e-a17a-4a54c299ce7e None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:50.363117 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530812e-307e-438e-a17a-4a54c299ce7e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:50.374819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530812e-307e-438e-a17a-4a54c299ce7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:50.381235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-9530812e-307e-438e-a17a-4a54c299ce7e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:24:50.381235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:50.381235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:50.381235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:50.381235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:50.381235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:50.381235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:50.381235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:50.381235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:50.381235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:50.381235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:50.381235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:50.381235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:50.381235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:50.381235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:50.381235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:50.382556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:50.382556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:50.382556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:50.382556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:50.382556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:50.382556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:50.382556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:50.382556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:50.382556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:50.382556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:50.382556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:50.382556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:50.382556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:50.382556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:50.382556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:50.382556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:50.383419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:50.383419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:50.383419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:50.383419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:50.383419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:50.383419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:50.383419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:50.383419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:50.383419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:50.383419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:50.383419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:24:50.383419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:24:50.383419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 157/302] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:50.383419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530812e-307e-438e-a17a-4a54c299ce7e None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:50.395695 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406728ed-674b-47d4-b233-4ae627d5b846 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:50.433610 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191893c2-c670-4eda-83cf-ebea63e9d285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:50.434276 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191893c2-c670-4eda-83cf-ebea63e9d285 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:50.434561 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191893c2-c670-4eda-83cf-ebea63e9d285 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:50.434843 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191893c2-c670-4eda-83cf-ebea63e9d285 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:50.438090 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:50.447192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191893c2-c670-4eda-83cf-ebea63e9d285 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:50.452349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-191893c2-c670-4eda-83cf-ebea63e9d285 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:50.452349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:50.452349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:50.452349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:50.452349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:50.452349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:50.452349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:50.452349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:50.452349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:50.452349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:50.452349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:50.452349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:50.452349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:50.452349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:50.452349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:50.452349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:50.456799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:50.456799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:50.456799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:50.456799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:50.456799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:50.456799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:50.456799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:50.456799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:50.456799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:50.456799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:50.456799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:50.456799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:50.456799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:50.456799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:50.456799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:50.456799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:50.457949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:50.457949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:50.457949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:50.457949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:50.457949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:50.457949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:50.457949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:50.457949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:50.457949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:50.457949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:50.457949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:50.457949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:24:50.457949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 146/303] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:50.459104 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191893c2-c670-4eda-83cf-ebea63e9d285 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:50.471738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:50.498571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530812e-307e-438e-a17a-4a54c299ce7e None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:50.536341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406efbc-7595-4e68-acef-f73ba9988af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:50.536888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406efbc-7595-4e68-acef-f73ba9988af0 None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:50.537175 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406efbc-7595-4e68-acef-f73ba9988af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:50.537455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406efbc-7595-4e68-acef-f73ba9988af0 None admin] PATH_INFO: `/v3/groups` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:50.538127 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406efbc-7595-4e68-acef-f73ba9988af0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:50.539649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406efbc-7595-4e68-acef-f73ba9988af0 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:50.576031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191893c2-c670-4eda-83cf-ebea63e9d285 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:50.610322 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d12d1d-57b0-4713-be82-93ef71fde7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:50.610942 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d12d1d-57b0-4713-be82-93ef71fde7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:50.611224 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d12d1d-57b0-4713-be82-93ef71fde7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:50.611529 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d12d1d-57b0-4713-be82-93ef71fde7a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:50.612521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d12d1d-57b0-4713-be82-93ef71fde7a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:50.612892 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d12d1d-57b0-4713-be82-93ef71fde7a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:50.614340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d12d1d-57b0-4713-be82-93ef71fde7a5 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:50.624556 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 147/304] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:50.625389 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d12d1d-57b0-4713-be82-93ef71fde7a5 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:50.657898 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 158/305] 10.222.0.65 () {60 vars in 1134 bytes} [Wed Jul 27 18:24:50 2022] POST /identity/v3/groups => generated 229 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:50.658857 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406efbc-7595-4e68-acef-f73ba9988af0 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:50.709302 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:50.774539 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d12d1d-57b0-4713-be82-93ef71fde7a5 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:50.809206 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406efbc-7595-4e68-acef-f73ba9988af0 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:50.814565 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a0782-9042-4dd2-be30-9b9218a455f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:50.815857 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a0782-9042-4dd2-be30-9b9218a455f8 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:50.816041 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a0782-9042-4dd2-be30-9b9218a455f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:50.816300 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a0782-9042-4dd2-be30-9b9218a455f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:50.817009 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a0782-9042-4dd2-be30-9b9218a455f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:50.817342 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a0782-9042-4dd2-be30-9b9218a455f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:50.818690 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a0782-9042-4dd2-be30-9b9218a455f8 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:50.835295 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 148/306] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:50.835295 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb292e8c-aec4-479f-a8a0-c2e4a298eaa7 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:50.835295 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb292e8c-aec4-479f-a8a0-c2e4a298eaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:50.835295 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb292e8c-aec4-479f-a8a0-c2e4a298eaa7 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:50.835295 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 149/307] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:50.837920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb292e8c-aec4-479f-a8a0-c2e4a298eaa7 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:50.859557 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0c555-3374-49b6-b8cb-48c1d38c6c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:50.860227 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0c555-3374-49b6-b8cb-48c1d38c6c69 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:50.860520 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0c555-3374-49b6-b8cb-48c1d38c6c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:50.860805 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0c555-3374-49b6-b8cb-48c1d38c6c69 None admin] PATH_INFO: `/v3/users/b38b691bd2d7414b8c5969de4d732702` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:50.865206 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:50.878374 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0c555-3374-49b6-b8cb-48c1d38c6c69 None admin] RBAC: Authorizing `identity:get_user(user_id=b38b691bd2d7414b8c5969de4d732702)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:50.880025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0c555-3374-49b6-b8cb-48c1d38c6c69 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:50.882126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 159/308] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:50 2022] GET /identity/v3/users/b38b691bd2d7414b8c5969de4d732702 => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:50.888373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f84e5b-0e59-4760-ac14-b183c541e82c None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:50.888700 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f84e5b-0e59-4760-ac14-b183c541e82c None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:50.888989 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f84e5b-0e59-4760-ac14-b183c541e82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:50.914012 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-29f84e5b-0e59-4760-ac14-b183c541e82c None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:50.914012 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-29f84e5b-0e59-4760-ac14-b183c541e82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:50.965259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb292e8c-aec4-479f-a8a0-c2e4a298eaa7 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:50.986052 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:51.001863 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188bc76-e73c-4f40-8f37-ddc874c6b926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:51.003176 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188bc76-e73c-4f40-8f37-ddc874c6b926 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:51.003503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188bc76-e73c-4f40-8f37-ddc874c6b926 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:51.003768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188bc76-e73c-4f40-8f37-ddc874c6b926 None admin] PATH_INFO: `/v3/users/bf9ed2730b4d47a69b7f88df008d61f2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:51.004554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 160/309] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:51.011392 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188bc76-e73c-4f40-8f37-ddc874c6b926 None admin] RBAC: Authorizing `identity:get_user(user_id=bf9ed2730b4d47a69b7f88df008d61f2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:51.011505 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f84e5b-0e59-4760-ac14-b183c541e82c None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:51.011581 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188bc76-e73c-4f40-8f37-ddc874c6b926 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:51.011581 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 150/310] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:50 2022] GET /identity/v3/users/bf9ed2730b4d47a69b7f88df008d61f2 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:51.013750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188bc76-e73c-4f40-8f37-ddc874c6b926 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:51.118163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f84e5b-0e59-4760-ac14-b183c541e82c None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:51.123846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188bc76-e73c-4f40-8f37-ddc874c6b926 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:51.142006 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:51.154863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91040d49-9ed3-47af-8f76-2202c4fddf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:51.155518 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91040d49-9ed3-47af-8f76-2202c4fddf4d None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:51.162561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91040d49-9ed3-47af-8f76-2202c4fddf4d None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:51.162561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91040d49-9ed3-47af-8f76-2202c4fddf4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:51.162561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91040d49-9ed3-47af-8f76-2202c4fddf4d None admin] RBAC: Adding query filter params (role.id=27bb3ae43da44e3a87a409e5adae712c, user.id=b38b691bd2d7414b8c5969de4d732702, scope.system=all) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:51.162561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91040d49-9ed3-47af-8f76-2202c4fddf4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:51.162561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91040d49-9ed3-47af-8f76-2202c4fddf4d None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:51.162926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5429a0a-b717-4b34-84d6-5c83e150e6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:51.162926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5429a0a-b717-4b34-84d6-5c83e150e6be None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:51.162926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5429a0a-b717-4b34-84d6-5c83e150e6be None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:51.162926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5429a0a-b717-4b34-84d6-5c83e150e6be None admin] PATH_INFO: `/v3/system/users/bf9ed2730b4d47a69b7f88df008d61f2/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:51.171634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 161/311] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Jul 27 18:24:51 2022] GET /identity/v3/role_assignments?user.id=b38b691bd2d7414b8c5969de4d732702&scope.system=all&role.id=27bb3ae43da44e3a87a409e5adae712c => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:51.171860 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5429a0a-b717-4b34-84d6-5c83e150e6be None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bf9ed2730b4d47a69b7f88df008d61f2, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:51.171957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91040d49-9ed3-47af-8f76-2202c4fddf4d None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:51.172041 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5429a0a-b717-4b34-84d6-5c83e150e6be None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:51.266503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 151/312] 10.222.0.65 () {58 vars in 1334 bytes} [Wed Jul 27 18:24:51 2022] PUT /identity/v3/system/users/bf9ed2730b4d47a69b7f88df008d61f2/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:24:51.296884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91040d49-9ed3-47af-8f76-2202c4fddf4d None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:51.348153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5cd8f-6ae0-4032-92b3-b6f71258cb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:51.349216 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5cd8f-6ae0-4032-92b3-b6f71258cb12 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:51.349738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5cd8f-6ae0-4032-92b3-b6f71258cb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:51.350224 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5cd8f-6ae0-4032-92b3-b6f71258cb12 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:51.364051 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5cd8f-6ae0-4032-92b3-b6f71258cb12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:51.370240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-70f5cd8f-6ae0-4032-92b3-b6f71258cb12 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:24:51.370240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:51.370240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:51.370240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:51.370240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:51.370240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:51.370240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:51.370240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:51.370240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:51.370240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:51.370240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:51.370240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:51.370240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:51.370240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:51.370240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:51.370240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:51.371154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:51.371154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:51.371154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:51.371154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:51.371154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:51.371154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:51.371154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:51.371154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:51.371154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:51.371154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:51.371154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:51.371154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:51.371154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:51.371154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:51.371154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:51.371154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:51.372011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:51.372011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:51.372011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:51.372011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:51.372011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:51.372011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:51.372011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:51.372011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:51.372011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:51.372011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:51.372011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:24:51.372011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:24:51.374843 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 162/313] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:51.384477 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5429a0a-b717-4b34-84d6-5c83e150e6be None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:51.453879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:51.505413 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5429a0a-b717-4b34-84d6-5c83e150e6be None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:51.541077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82553e3-3156-4b76-a6af-90ae2f05dc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:51.541714 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82553e3-3156-4b76-a6af-90ae2f05dc1f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:51.541996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82553e3-3156-4b76-a6af-90ae2f05dc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:51.542272 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82553e3-3156-4b76-a6af-90ae2f05dc1f None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:51.543002 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82553e3-3156-4b76-a6af-90ae2f05dc1f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:51.543338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82553e3-3156-4b76-a6af-90ae2f05dc1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:51.544853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82553e3-3156-4b76-a6af-90ae2f05dc1f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:51.555207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 152/314] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:51.561622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5cd8f-6ae0-4032-92b3-b6f71258cb12 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:51.610815 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:51.666539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5cd8f-6ae0-4032-92b3-b6f71258cb12 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:51.714126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6848757-4d38-4ae3-bd6c-a33c937f534d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:51.715181 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6848757-4d38-4ae3-bd6c-a33c937f534d None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:51.715687 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6848757-4d38-4ae3-bd6c-a33c937f534d None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:51.716189 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6848757-4d38-4ae3-bd6c-a33c937f534d None admin] PATH_INFO: `/v3/users/3714b860a81942f980ed6eee1ba7dec1` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:51.717746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6848757-4d38-4ae3-bd6c-a33c937f534d None admin] RBAC: Authorizing `identity:get_user(user_id=3714b860a81942f980ed6eee1ba7dec1)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:51.719553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6848757-4d38-4ae3-bd6c-a33c937f534d None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:51.722552 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 163/315] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:51 2022] GET /identity/v3/users/3714b860a81942f980ed6eee1ba7dec1 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:51.728345 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82553e3-3156-4b76-a6af-90ae2f05dc1f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:51.837369 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82553e3-3156-4b76-a6af-90ae2f05dc1f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:51.863633 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:51.875930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a590fe5-e984-44de-a927-336fe33df44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:51.877165 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a590fe5-e984-44de-a927-336fe33df44e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:51.878316 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a590fe5-e984-44de-a927-336fe33df44e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:51.878812 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a590fe5-e984-44de-a927-336fe33df44e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:51.953537 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a590fe5-e984-44de-a927-336fe33df44e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:51.955465 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a590fe5-e984-44de-a927-336fe33df44e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:52.061153 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 153/316] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:24:52.067544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6848757-4d38-4ae3-bd6c-a33c937f534d None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:52.172052 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6848757-4d38-4ae3-bd6c-a33c937f534d None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:52.195673 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:52.216696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13970de-5600-49e3-a780-11838a4165a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:52.217658 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13970de-5600-49e3-a780-11838a4165a8 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:52.218153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13970de-5600-49e3-a780-11838a4165a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:52.218649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13970de-5600-49e3-a780-11838a4165a8 None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:52.220226 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13970de-5600-49e3-a780-11838a4165a8 None admin] RBAC: Authorizing `identity:get_project(project_id=f9f866c53099419c8982f8720259b8bf)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:52.222422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13970de-5600-49e3-a780-11838a4165a8 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:52.228481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 164/317] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:52 2022] GET /identity/v3/projects/f9f866c53099419c8982f8720259b8bf => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:52.230302 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a590fe5-e984-44de-a927-336fe33df44e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:52.267667 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:52.353563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a590fe5-e984-44de-a927-336fe33df44e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:52.395730 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96d9c5-9228-40c7-94c5-faf4a0f23da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:52.396519 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96d9c5-9228-40c7-94c5-faf4a0f23da7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:52.396914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96d9c5-9228-40c7-94c5-faf4a0f23da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:52.397284 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96d9c5-9228-40c7-94c5-faf4a0f23da7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:52.398185 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96d9c5-9228-40c7-94c5-faf4a0f23da7 None admin] RBAC: Adding query filter params (role.id=27bb3ae43da44e3a87a409e5adae712c, scope.project.id=f9f866c53099419c8982f8720259b8bf, user.id=3714b860a81942f980ed6eee1ba7dec1) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:52.398594 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96d9c5-9228-40c7-94c5-faf4a0f23da7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:52.400188 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96d9c5-9228-40c7-94c5-faf4a0f23da7 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:52.412078 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 154/318] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:24:52 2022] GET /identity/v3/role_assignments?user.id=3714b860a81942f980ed6eee1ba7dec1&scope.project.id=f9f866c53099419c8982f8720259b8bf&role.id=27bb3ae43da44e3a87a409e5adae712c => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:52.944377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e23b34-cb06-4e43-bc18-19a2dd9ec5b6 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:52.944760 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e23b34-cb06-4e43-bc18-19a2dd9ec5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:52.944939 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e23b34-cb06-4e43-bc18-19a2dd9ec5b6 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:52.946466 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 165/319] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:52.951667 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd701da-de74-4cec-b5f5-bf70699f54a1 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:52.951961 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd701da-de74-4cec-b5f5-bf70699f54a1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:52.952238 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd701da-de74-4cec-b5f5-bf70699f54a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:52.970553 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0fd701da-de74-4cec-b5f5-bf70699f54a1 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:52.972338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0fd701da-de74-4cec-b5f5-bf70699f54a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:53.043180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 155/320] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:53.066872 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e23b34-cb06-4e43-bc18-19a2dd9ec5b6 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:53.179764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e23b34-cb06-4e43-bc18-19a2dd9ec5b6 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:53.215962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bd81b-d02e-453f-9182-48e7ee17dd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:53.216542 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bd81b-d02e-453f-9182-48e7ee17dd99 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:53.216825 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bd81b-d02e-453f-9182-48e7ee17dd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:53.217170 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bd81b-d02e-453f-9182-48e7ee17dd99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:53.218384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43bd81b-d02e-453f-9182-48e7ee17dd99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:53.219883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43bd81b-d02e-453f-9182-48e7ee17dd99 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:53.221664 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 166/321] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:24:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:53.227198 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd701da-de74-4cec-b5f5-bf70699f54a1 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:53.238499 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:53.336878 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd701da-de74-4cec-b5f5-bf70699f54a1 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:53.375007 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9739f-2fc3-4c60-9481-ba224f47213c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:53.375666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9739f-2fc3-4c60-9481-ba224f47213c None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:53.376202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9739f-2fc3-4c60-9481-ba224f47213c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:53.376474 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9739f-2fc3-4c60-9481-ba224f47213c None admin] PATH_INFO: `/v3/groups` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:53.377142 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9739f-2fc3-4c60-9481-ba224f47213c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:53.379187 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9739f-2fc3-4c60-9481-ba224f47213c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:53.452926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79fe3c-1073-4fec-b655-218eaa3275d3 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:53.453218 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79fe3c-1073-4fec-b655-218eaa3275d3 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:53.453496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79fe3c-1073-4fec-b655-218eaa3275d3 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:53.454880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 167/322] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:53.460856 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdecd6-bfbc-4527-b7fe-a7a707fed022 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:53.461197 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdecd6-bfbc-4527-b7fe-a7a707fed022 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:53.461484 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdecd6-bfbc-4527-b7fe-a7a707fed022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:53.481877 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-a8bdecd6-bfbc-4527-b7fe-a7a707fed022 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:53.481877 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a8bdecd6-bfbc-4527-b7fe-a7a707fed022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:53.524596 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 156/323] 10.222.0.65 () {60 vars in 1134 bytes} [Wed Jul 27 18:24:53 2022] POST /identity/v3/groups => generated 226 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:53.525736 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adc148-1560-4e95-a85f-e253b783587b None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:53.526032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adc148-1560-4e95-a85f-e253b783587b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:53.526312 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adc148-1560-4e95-a85f-e253b783587b None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:53.527771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 157/324] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:53.532660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:53.533535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace0cfb-3b6f-45be-a5cd-86104151d227 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:53.534146 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace0cfb-3b6f-45be-a5cd-86104151d227 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:53.534439 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace0cfb-3b6f-45be-a5cd-86104151d227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:53.554925 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-dace0cfb-3b6f-45be-a5cd-86104151d227 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:53.556213 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-dace0cfb-3b6f-45be-a5cd-86104151d227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:53.569255 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 168/325] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:24:53.591911 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdecd6-bfbc-4527-b7fe-a7a707fed022 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:53.638335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:53.645397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 158/326] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:24:53.669394 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace0cfb-3b6f-45be-a5cd-86104151d227 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:53.713508 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdecd6-bfbc-4527-b7fe-a7a707fed022 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:53.759136 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8e44d-3b69-4db0-b359-8baefb26eeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:53.759851 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8e44d-3b69-4db0-b359-8baefb26eeac None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:53.760156 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8e44d-3b69-4db0-b359-8baefb26eeac None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:53.760437 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8e44d-3b69-4db0-b359-8baefb26eeac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:53.775466 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8e44d-3b69-4db0-b359-8baefb26eeac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:53.780497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-76a8e44d-3b69-4db0-b359-8baefb26eeac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:24:53.780497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:53.780497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:53.780497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:53.780497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:53.780497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:53.780497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:53.780497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:53.780497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:53.780497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:53.780497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:53.780497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:53.780497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:53.780497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:53.780497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:53.780497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:53.781402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:53.781402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:53.781402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:53.781402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:53.781402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:53.781402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:53.781402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:53.781402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:53.781402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:53.781402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:53.781402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:53.781402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:53.781402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:53.781402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:53.781402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:53.781402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:53.782198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:53.782198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:53.782198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:53.782198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:53.782198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:53.782198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:53.782198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:53.782198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:53.782198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:53.782198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:53.782198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:24:53.782198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:24:53.782198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 169/327] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:24:53.789603 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8e44d-3b69-4db0-b359-8baefb26eeac None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:53.804530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace0cfb-3b6f-45be-a5cd-86104151d227 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:53.845679 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:53.851311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ab7d5-461b-4fb1-af56-0ff732838506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:53.852560 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ab7d5-461b-4fb1-af56-0ff732838506 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:53.856030 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ab7d5-461b-4fb1-af56-0ff732838506 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:53.856030 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ab7d5-461b-4fb1-af56-0ff732838506 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:53.867499 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ab7d5-461b-4fb1-af56-0ff732838506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:53.872651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-106ab7d5-461b-4fb1-af56-0ff732838506 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:53.872651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:53.872651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:53.872651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:53.872651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:53.872651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:53.872651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:53.872651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:53.872651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:53.872651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:53.872651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:53.872651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:53.872651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:53.872651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:53.872651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:53.872651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:53.873771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:53.873771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:53.873771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:53.873771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:53.873771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:53.873771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:53.873771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:53.873771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:53.873771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:53.873771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:53.873771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:53.873771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:53.873771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:53.873771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:53.873771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:53.873771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:53.874577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:53.874577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:53.874577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:53.874577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:53.874577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:53.874577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:53.874577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:53.874577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:53.874577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:53.874577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:53.874577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:53.874577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:24:53.874577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 159/328] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:24:53.882018 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ab7d5-461b-4fb1-af56-0ff732838506 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:53.917771 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8e44d-3b69-4db0-b359-8baefb26eeac None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:53.970979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd82f9-1ca9-4bc8-8d81-3fe2d722deba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:53.972096 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:53.972966 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd82f9-1ca9-4bc8-8d81-3fe2d722deba None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:53.973181 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd82f9-1ca9-4bc8-8d81-3fe2d722deba None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:53.973853 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd82f9-1ca9-4bc8-8d81-3fe2d722deba None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:53.974924 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd82f9-1ca9-4bc8-8d81-3fe2d722deba None admin] RBAC: Adding query filter params (name=reader) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:53.975219 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd82f9-1ca9-4bc8-8d81-3fe2d722deba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:53.988257 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd82f9-1ca9-4bc8-8d81-3fe2d722deba None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:53.991543 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 170/329] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:53.998477 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd82f9-1ca9-4bc8-8d81-3fe2d722deba None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:54.043990 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ab7d5-461b-4fb1-af56-0ff732838506 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:54.085995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4670aa4-5a77-43b1-aae4-763aae0b5be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:54.086904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4670aa4-5a77-43b1-aae4-763aae0b5be9 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:54.087367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4670aa4-5a77-43b1-aae4-763aae0b5be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:54.087859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4670aa4-5a77-43b1-aae4-763aae0b5be9 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:54.088775 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4670aa4-5a77-43b1-aae4-763aae0b5be9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:54.089259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4670aa4-5a77-43b1-aae4-763aae0b5be9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:54.090850 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4670aa4-5a77-43b1-aae4-763aae0b5be9 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:54.101370 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 160/330] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:54.107169 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4670aa4-5a77-43b1-aae4-763aae0b5be9 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:54.141890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd82f9-1ca9-4bc8-8d81-3fe2d722deba None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:54.144612 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:54.189149 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68ecd4-d668-4b48-86f6-b76399666bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:54.190656 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68ecd4-d668-4b48-86f6-b76399666bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:54.191093 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68ecd4-d668-4b48-86f6-b76399666bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:54.191639 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68ecd4-d668-4b48-86f6-b76399666bb0 None admin] PATH_INFO: `/v3/users/b38b691bd2d7414b8c5969de4d732702` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:54.193062 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68ecd4-d668-4b48-86f6-b76399666bb0 None admin] RBAC: Authorizing `identity:get_user(user_id=b38b691bd2d7414b8c5969de4d732702)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:54.194691 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68ecd4-d668-4b48-86f6-b76399666bb0 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:54.196835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 171/331] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:53 2022] GET /identity/v3/users/b38b691bd2d7414b8c5969de4d732702 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:54.203105 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68ecd4-d668-4b48-86f6-b76399666bb0 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:54.240870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4670aa4-5a77-43b1-aae4-763aae0b5be9 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:54.269037 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:54.292634 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88925e-e27d-460b-a943-f090553ee4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:54.293716 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88925e-e27d-460b-a943-f090553ee4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:54.294258 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88925e-e27d-460b-a943-f090553ee4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:54.294737 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88925e-e27d-460b-a943-f090553ee4e8 None admin] PATH_INFO: `/v3/users/bf9ed2730b4d47a69b7f88df008d61f2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:54.296293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88925e-e27d-460b-a943-f090553ee4e8 None admin] RBAC: Authorizing `identity:get_user(user_id=bf9ed2730b4d47a69b7f88df008d61f2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:54.298014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88925e-e27d-460b-a943-f090553ee4e8 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:54.303767 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 161/332] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:54 2022] GET /identity/v3/users/bf9ed2730b4d47a69b7f88df008d61f2 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:54.307081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88925e-e27d-460b-a943-f090553ee4e8 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:54.336085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68ecd4-d668-4b48-86f6-b76399666bb0 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:54.382771 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9c569-6b8d-4fd1-b2ed-f1d9d2a47a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:54.383910 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9c569-6b8d-4fd1-b2ed-f1d9d2a47a84 None admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:54.384200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9c569-6b8d-4fd1-b2ed-f1d9d2a47a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:54.384485 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9c569-6b8d-4fd1-b2ed-f1d9d2a47a84 None admin] PATH_INFO: `/v3/system/users/b38b691bd2d7414b8c5969de4d732702/roles/27bb3ae43da44e3a87a409e5adae712c` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:54.386405 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9c569-6b8d-4fd1-b2ed-f1d9d2a47a84 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b38b691bd2d7414b8c5969de4d732702, role_id=27bb3ae43da44e3a87a409e5adae712c)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:54.389925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9c569-6b8d-4fd1-b2ed-f1d9d2a47a84 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:54.463790 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88925e-e27d-460b-a943-f090553ee4e8 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:54.478006 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 172/333] 10.222.0.65 () {58 vars in 1334 bytes} [Wed Jul 27 18:24:54 2022] PUT /identity/v3/system/users/b38b691bd2d7414b8c5969de4d732702/roles/27bb3ae43da44e3a87a409e5adae712c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:54.513750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b2a6a-751b-4b21-9338-1c81ebc31a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:54.514440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b2a6a-751b-4b21-9338-1c81ebc31a37 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:54.514734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b2a6a-751b-4b21-9338-1c81ebc31a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:54.515015 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b2a6a-751b-4b21-9338-1c81ebc31a37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:54.515917 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b2a6a-751b-4b21-9338-1c81ebc31a37 None admin] RBAC: Adding query filter params (role.id=f105208a21c84d4fa134aa0aeb62f3bb, user.id=bf9ed2730b4d47a69b7f88df008d61f2, scope.system=all) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:54.516235 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b2a6a-751b-4b21-9338-1c81ebc31a37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:54.517791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b2a6a-751b-4b21-9338-1c81ebc31a37 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:54.538864 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 162/334] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Jul 27 18:24:54 2022] GET /identity/v3/role_assignments?user.id=bf9ed2730b4d47a69b7f88df008d61f2&scope.system=all&role.id=f105208a21c84d4fa134aa0aeb62f3bb => generated 510 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:55.869714 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33614ff-c35d-459c-b70b-104e30349d49 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:55.870293 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33614ff-c35d-459c-b70b-104e30349d49 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:55.870293 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33614ff-c35d-459c-b70b-104e30349d49 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:55.871906 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 173/335] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:55.878673 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6403f-cacd-4e0d-9afd-81426c26dc8d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:55.879173 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6403f-cacd-4e0d-9afd-81426c26dc8d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:55.879255 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6403f-cacd-4e0d-9afd-81426c26dc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:55.907584 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-14c6403f-cacd-4e0d-9afd-81426c26dc8d None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:55.908827 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-14c6403f-cacd-4e0d-9afd-81426c26dc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:55.974086 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:56.000521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 163/336] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:56.039058 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33614ff-c35d-459c-b70b-104e30349d49 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:56.077348 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:56.147797 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33614ff-c35d-459c-b70b-104e30349d49 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:56.187564 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197b2f7-0cc2-41a4-99b2-25c6b2788baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:56.188217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197b2f7-0cc2-41a4-99b2-25c6b2788baa None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:56.188502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197b2f7-0cc2-41a4-99b2-25c6b2788baa None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:56.188778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197b2f7-0cc2-41a4-99b2-25c6b2788baa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:56.202092 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197b2f7-0cc2-41a4-99b2-25c6b2788baa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:56.207958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-0197b2f7-0cc2-41a4-99b2-25c6b2788baa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:56.207958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:56.207958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:56.207958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:56.207958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:56.207958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:56.207958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:56.207958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:56.207958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:56.207958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:56.207958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:56.207958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:56.207958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:56.207958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:56.207958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:56.207958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:56.208913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:56.208913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:56.208913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:56.208913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:56.208913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:56.208913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:56.208913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:56.208913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:56.208913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:56.208913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:56.208913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:56.208913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:56.208913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:56.208913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:56.208913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:56.208913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:56.209737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:56.209737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:56.209737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:56.209737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:56.209737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:56.209737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:56.209737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:56.209737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:56.209737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:56.209737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:56.209737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:56.209737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:24:56.209737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 174/337] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:56.216501 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6403f-cacd-4e0d-9afd-81426c26dc8d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:56.341238 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6403f-cacd-4e0d-9afd-81426c26dc8d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:56.379617 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29a8c5-1032-4c36-bfac-97936447a936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:56.380254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29a8c5-1032-4c36-bfac-97936447a936 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:56.380539 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29a8c5-1032-4c36-bfac-97936447a936 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:56.380819 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29a8c5-1032-4c36-bfac-97936447a936 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:56.381551 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29a8c5-1032-4c36-bfac-97936447a936 None admin] RBAC: Adding query filter params (name=member) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:56.381862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29a8c5-1032-4c36-bfac-97936447a936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:56.383282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29a8c5-1032-4c36-bfac-97936447a936 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:56.396504 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 164/338] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:56.402694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197b2f7-0cc2-41a4-99b2-25c6b2788baa None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:56.519107 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:56.525669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197b2f7-0cc2-41a4-99b2-25c6b2788baa None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:56.575977 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3f41c-50a7-4246-adb6-c655e07b9415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:56.576621 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3f41c-50a7-4246-adb6-c655e07b9415 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:56.576907 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3f41c-50a7-4246-adb6-c655e07b9415 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:56.577185 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3f41c-50a7-4246-adb6-c655e07b9415 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:56.668095 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3f41c-50a7-4246-adb6-c655e07b9415 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:56.669571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3f41c-50a7-4246-adb6-c655e07b9415 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:56.804343 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:56.818808 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 175/339] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:24:56.826418 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29a8c5-1032-4c36-bfac-97936447a936 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:56.888379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:56.960621 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29a8c5-1032-4c36-bfac-97936447a936 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:57.007194 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269196d-ec57-413a-bda1-ae9e05ee6516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:57.007876 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269196d-ec57-413a-bda1-ae9e05ee6516 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:57.008163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269196d-ec57-413a-bda1-ae9e05ee6516 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:57.008442 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269196d-ec57-413a-bda1-ae9e05ee6516 None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:57.011989 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269196d-ec57-413a-bda1-ae9e05ee6516 None admin] RBAC: Authorizing `identity:get_project(project_id=8067a8a77005444fb4e26dc5e9b19761)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:57.013477 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269196d-ec57-413a-bda1-ae9e05ee6516 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:57.015208 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 165/340] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:56 2022] GET /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:57.020839 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3f41c-50a7-4246-adb6-c655e07b9415 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:57.125049 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c840a6-b84d-49e6-92f0-8713b6a8fc89 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:57.125556 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c840a6-b84d-49e6-92f0-8713b6a8fc89 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:57.126284 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c840a6-b84d-49e6-92f0-8713b6a8fc89 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:57.128740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 166/341] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:24:57.145790 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b07182-9208-4d79-932b-c12a84c9aa90 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:57.146307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b07182-9208-4d79-932b-c12a84c9aa90 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:57.146757 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b07182-9208-4d79-932b-c12a84c9aa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:57.152395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3f41c-50a7-4246-adb6-c655e07b9415 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:57.194669 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-27b07182-9208-4d79-932b-c12a84c9aa90 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:57.197759 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-27b07182-9208-4d79-932b-c12a84c9aa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:57.244237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90adcb-597b-4d69-93ef-2c10f1aff61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:57.245164 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90adcb-597b-4d69-93ef-2c10f1aff61f None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:57.245606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90adcb-597b-4d69-93ef-2c10f1aff61f None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:57.246046 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90adcb-597b-4d69-93ef-2c10f1aff61f None admin] PATH_INFO: `/v3/groups/f90ca112cd784eb7abd978140243adf2` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:57.262464 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90adcb-597b-4d69-93ef-2c10f1aff61f None admin] RBAC: Authorizing `identity:get_group(group_id=f90ca112cd784eb7abd978140243adf2)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:57.265933 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90adcb-597b-4d69-93ef-2c10f1aff61f None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:57.269617 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 176/342] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 18:24:57 2022] GET /identity/v3/groups/f90ca112cd784eb7abd978140243adf2 => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:57.275947 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90adcb-597b-4d69-93ef-2c10f1aff61f None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:57.372809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:57.417136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 167/343] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:57.478505 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90adcb-597b-4d69-93ef-2c10f1aff61f None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:57.558528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa8cb6-862d-44f1-bdbe-64d56299447e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:57.559453 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa8cb6-862d-44f1-bdbe-64d56299447e None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:57.559795 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa8cb6-862d-44f1-bdbe-64d56299447e None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:57.560257 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa8cb6-862d-44f1-bdbe-64d56299447e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:57.561614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa8cb6-862d-44f1-bdbe-64d56299447e None admin] RBAC: Adding query filter params (group.id=f90ca112cd784eb7abd978140243adf2, role.id=f105208a21c84d4fa134aa0aeb62f3bb, scope.project.id=8067a8a77005444fb4e26dc5e9b19761) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:57.562103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa8cb6-862d-44f1-bdbe-64d56299447e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:57.564080 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa8cb6-862d-44f1-bdbe-64d56299447e None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:57.576298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 177/344] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 18:24:57 2022] GET /identity/v3/role_assignments?group.id=f90ca112cd784eb7abd978140243adf2&scope.project.id=8067a8a77005444fb4e26dc5e9b19761&role.id=f105208a21c84d4fa134aa0aeb62f3bb => generated 260 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:57.582600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b07182-9208-4d79-932b-c12a84c9aa90 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:57.592786 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd9f36-8996-450f-8d32-099113c41985 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:57.593118 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd9f36-8996-450f-8d32-099113c41985 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:57.593357 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd9f36-8996-450f-8d32-099113c41985 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:57.595127 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 178/345] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:57.601447 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905ccb4-c551-436c-aa46-421087c867a6 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:57.601797 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905ccb4-c551-436c-aa46-421087c867a6 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:57.602321 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905ccb4-c551-436c-aa46-421087c867a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:57.643360 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-c905ccb4-c551-436c-aa46-421087c867a6 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:57.644617 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c905ccb4-c551-436c-aa46-421087c867a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:57.708735 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:57.742241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 179/346] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:24:57.768589 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905ccb4-c551-436c-aa46-421087c867a6 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:57.837521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:57.867173 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b07182-9208-4d79-932b-c12a84c9aa90 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:57.910472 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905ccb4-c551-436c-aa46-421087c867a6 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:57.948803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9ed9c-9a70-4310-99cd-680ccb48b5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:57.949467 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9ed9c-9a70-4310-99cd-680ccb48b5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:57.949751 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9ed9c-9a70-4310-99cd-680ccb48b5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:57.950029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9ed9c-9a70-4310-99cd-680ccb48b5f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:57.952420 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b241b34-fb7a-42f8-bd39-4e7ea70bdc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:57.953056 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b241b34-fb7a-42f8-bd39-4e7ea70bdc3d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:57.953336 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b241b34-fb7a-42f8-bd39-4e7ea70bdc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:57.953611 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b241b34-fb7a-42f8-bd39-4e7ea70bdc3d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:57.966485 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9ed9c-9a70-4310-99cd-680ccb48b5f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:57.972430 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b241b34-fb7a-42f8-bd39-4e7ea70bdc3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:57.974308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-47a9ed9c-9a70-4310-99cd-680ccb48b5f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:24:57.974308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:57.974308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:57.974308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:57.974308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:57.974308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:57.974308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:57.974308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:57.974308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:57.974308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:57.974308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:57.974308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:57.974308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:57.974308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:57.974308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:57.974308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:57.975194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:57.975194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:57.975194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:57.975194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:57.975194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:57.975194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:57.975194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:57.975194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:57.975194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:57.975194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:57.975194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:57.975194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:57.975194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:57.975194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:57.975194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:57.975194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:57.976100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:57.976100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:57.976100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:57.976100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:57.976100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:57.976100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:57.976100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:57.976100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:57.976100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:57.976100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:57.976100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:24:57.976100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:24:57.976100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 180/347] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 18:24:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:24:57.977236 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8751785-bfb4-4fc6-ba4d-34dffeee7821 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:57.977435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8751785-bfb4-4fc6-ba4d-34dffeee7821 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:57.977720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8751785-bfb4-4fc6-ba4d-34dffeee7821 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:57.982301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-8b241b34-fb7a-42f8-bd39-4e7ea70bdc3d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:24:57.982301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:57.982301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:57.982301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:57.982301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:57.982301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:57.982301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:57.982301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:57.982301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:57.982301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:57.982301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:57.982301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:57.982301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:57.982301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:57.982301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:57.982301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:57.983215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:57.983215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:57.983215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:57.983215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:57.983215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:57.983215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:57.983215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:57.983215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:57.983215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:57.983215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:57.983215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:57.983215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:57.983215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:57.983215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:57.983215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:57.983215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:57.984074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:57.984074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:57.984074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:57.984074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:57.984074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:57.984074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:57.984074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:57.984074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:57.984074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:57.984074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:57.984074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:24:57.984074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:24:57.984708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 181/348] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:57.984974 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8751785-bfb4-4fc6-ba4d-34dffeee7821 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:57.986733 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 168/349] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 18:24:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:57.989814 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfbac3-af8e-4009-8afa-760d414dafac None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:57.990335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfbac3-af8e-4009-8afa-760d414dafac None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:57.990828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfbac3-af8e-4009-8afa-760d414dafac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:58.015753 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-52bfbac3-af8e-4009-8afa-760d414dafac None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:58.017432 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-52bfbac3-af8e-4009-8afa-760d414dafac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:58.095035 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 169/350] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:58.096846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfbac3-af8e-4009-8afa-760d414dafac None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:58.109163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8751785-bfb4-4fc6-ba4d-34dffeee7821 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:58.124073 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:58.130697 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:58.150283 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c2e9b-07c5-48a3-bb28-8c6fd133c911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:58.150922 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c2e9b-07c5-48a3-bb28-8c6fd133c911 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:58.151210 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c2e9b-07c5-48a3-bb28-8c6fd133c911 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:58.151535 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c2e9b-07c5-48a3-bb28-8c6fd133c911 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:58.152279 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c2e9b-07c5-48a3-bb28-8c6fd133c911 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:58.152588 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c2e9b-07c5-48a3-bb28-8c6fd133c911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:58.154009 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c2e9b-07c5-48a3-bb28-8c6fd133c911 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:58.163882 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 182/351] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:24:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:58.165162 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c92f6d-51b5-4e50-b7a6-0bab84995d25 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:58.165453 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c92f6d-51b5-4e50-b7a6-0bab84995d25 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:58.165733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c92f6d-51b5-4e50-b7a6-0bab84995d25 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:58.167229 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 183/352] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:58.172119 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c92f6d-51b5-4e50-b7a6-0bab84995d25 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:58.218770 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfbac3-af8e-4009-8afa-760d414dafac None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:58.258413 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653c572-a3e3-41a8-b877-6d14b0c62a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:58.259461 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653c572-a3e3-41a8-b877-6d14b0c62a02 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:58.260052 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653c572-a3e3-41a8-b877-6d14b0c62a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:58.260522 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653c572-a3e3-41a8-b877-6d14b0c62a02 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:58.261457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653c572-a3e3-41a8-b877-6d14b0c62a02 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:58.262067 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653c572-a3e3-41a8-b877-6d14b0c62a02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:58.263837 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653c572-a3e3-41a8-b877-6d14b0c62a02 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:58.274445 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 170/353] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:24:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:58.280290 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c04758-86ac-469e-b076-0a97c79849b3 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:58.280920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c04758-86ac-469e-b076-0a97c79849b3 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:58.281429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c04758-86ac-469e-b076-0a97c79849b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:58.288059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c92f6d-51b5-4e50-b7a6-0bab84995d25 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:58.302295 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-89c04758-86ac-469e-b076-0a97c79849b3 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:58.304023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-89c04758-86ac-469e-b076-0a97c79849b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:58.325993 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b555f3-b199-4238-80b6-8c674c0333c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:58.326648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b555f3-b199-4238-80b6-8c674c0333c3 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:58.326933 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b555f3-b199-4238-80b6-8c674c0333c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:58.327210 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b555f3-b199-4238-80b6-8c674c0333c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:58.339926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b555f3-b199-4238-80b6-8c674c0333c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:58.345435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-48b555f3-b199-4238-80b6-8c674c0333c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:58.345435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:58.345435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:58.345435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:58.345435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:58.345435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:58.345435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:58.345435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:58.345435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:58.345435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:58.345435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:58.345435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:58.345435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:58.345435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:58.345435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:58.345435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:58.346888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:58.346888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:58.346888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:58.346888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:58.346888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:58.346888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:58.346888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:58.346888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:58.346888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:58.346888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:58.346888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:58.346888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:58.346888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:58.346888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:58.346888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:58.346888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:58.347905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:58.347905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:58.347905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:58.347905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:58.347905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:58.347905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:58.347905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:58.347905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:58.347905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:58.347905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:58.347905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:24:58.347905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:24:58.348520 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 184/354] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:58.348832 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b555f3-b199-4238-80b6-8c674c0333c3 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:58.388451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:58.389702 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 171/355] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:58.390885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c04758-86ac-469e-b076-0a97c79849b3 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:58.412372 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:58.471715 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b555f3-b199-4238-80b6-8c674c0333c3 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:58.507756 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c04758-86ac-469e-b076-0a97c79849b3 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:58.519365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bbba4-1502-4f33-99e3-17ea0ae79a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:58.520733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bbba4-1502-4f33-99e3-17ea0ae79a9c None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:58.521406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bbba4-1502-4f33-99e3-17ea0ae79a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:58.521989 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bbba4-1502-4f33-99e3-17ea0ae79a9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:58.549699 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79a0f6-a979-4604-b46a-2e795ef1c9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:58.550768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79a0f6-a979-4604-b46a-2e795ef1c9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:58.551239 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79a0f6-a979-4604-b46a-2e795ef1c9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:58.551719 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79a0f6-a979-4604-b46a-2e795ef1c9a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:58.603334 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13bbba4-1502-4f33-99e3-17ea0ae79a9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:58.604911 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13bbba4-1502-4f33-99e3-17ea0ae79a9c None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:58.630552 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79a0f6-a979-4604-b46a-2e795ef1c9a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:58.632566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79a0f6-a979-4604-b46a-2e795ef1c9a9 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:58.645625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:58.661168 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:58.726751 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 185/356] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:24:58.731716 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bbba4-1502-4f33-99e3-17ea0ae79a9c None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:58.748722 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 172/357] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:24:58.754997 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79a0f6-a979-4604-b46a-2e795ef1c9a9 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:58.847304 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bbba4-1502-4f33-99e3-17ea0ae79a9c None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:58.871877 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79a0f6-a979-4604-b46a-2e795ef1c9a9 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:58.884724 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7a891-34d2-44bd-882b-50c10091a0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:58.885352 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7a891-34d2-44bd-882b-50c10091a0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:58.885821 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7a891-34d2-44bd-882b-50c10091a0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:58.886262 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7a891-34d2-44bd-882b-50c10091a0a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:58.887142 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7a891-34d2-44bd-882b-50c10091a0a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:58.887619 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7a891-34d2-44bd-882b-50c10091a0a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:58.889235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7a891-34d2-44bd-882b-50c10091a0a4 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:58.891666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:58.893860 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:58.900017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 186/358] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:58.900689 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7a891-34d2-44bd-882b-50c10091a0a4 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:58.917972 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127ae89-9b49-40fc-9094-04c5c1933d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:58.918901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127ae89-9b49-40fc-9094-04c5c1933d94 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:58.919390 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127ae89-9b49-40fc-9094-04c5c1933d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:58.919831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127ae89-9b49-40fc-9094-04c5c1933d94 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:58.932392 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127ae89-9b49-40fc-9094-04c5c1933d94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:24:58.938385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-8127ae89-9b49-40fc-9094-04c5c1933d94 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:24:58.938385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:24:58.938385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:24:58.938385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:24:58.938385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:24:58.938385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:24:58.938385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:24:58.938385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:24:58.938385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:24:58.938385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:24:58.938385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:24:58.938385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:24:58.938385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:24:58.938385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:24:58.938385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:24:58.938385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:24:58.939411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:24:58.939411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:24:58.939411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:24:58.939411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:24:58.939411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:24:58.939411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:24:58.939411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:24:58.939411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:24:58.939411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:24:58.939411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:24:58.939411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:24:58.939411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:24:58.939411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:24:58.939411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:24:58.939411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:24:58.939411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:24:58.940963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:24:58.940963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:24:58.940963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:24:58.940963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:24:58.940963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:24:58.940963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:24:58.940963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:24:58.940963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:24:58.940963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:24:58.940963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:24:58.940963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:24:58.940963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:24:58.941627 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 173/359] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:24:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:24:58.942367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127ae89-9b49-40fc-9094-04c5c1933d94 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:59.030162 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7a891-34d2-44bd-882b-50c10091a0a4 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:59.081637 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956610a9-0973-4eb7-9d50-66f2def7c94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:59.082779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956610a9-0973-4eb7-9d50-66f2def7c94b None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:59.083366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956610a9-0973-4eb7-9d50-66f2def7c94b None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:59.083849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956610a9-0973-4eb7-9d50-66f2def7c94b None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:59.085307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956610a9-0973-4eb7-9d50-66f2def7c94b None admin] RBAC: Authorizing `identity:get_project(project_id=f9f866c53099419c8982f8720259b8bf)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:59.086982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956610a9-0973-4eb7-9d50-66f2def7c94b None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:59.088943 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 187/360] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:58 2022] GET /identity/v3/projects/f9f866c53099419c8982f8720259b8bf => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:59.090344 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95c164-7e7a-4b25-8db6-cbdfc248f6be None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:59.090588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127ae89-9b49-40fc-9094-04c5c1933d94 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:59.091387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95c164-7e7a-4b25-8db6-cbdfc248f6be None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:59.091846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95c164-7e7a-4b25-8db6-cbdfc248f6be None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:59.093817 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 188/361] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:59.094561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95c164-7e7a-4b25-8db6-cbdfc248f6be None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:59.139227 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3022e-6ba1-4952-a2ae-de5fa8627ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:59.139958 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3022e-6ba1-4952-a2ae-de5fa8627ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:59.140248 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3022e-6ba1-4952-a2ae-de5fa8627ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:59.140521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3022e-6ba1-4952-a2ae-de5fa8627ae1 None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:59.141736 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3022e-6ba1-4952-a2ae-de5fa8627ae1 None admin] RBAC: Authorizing `identity:get_project(project_id=8067a8a77005444fb4e26dc5e9b19761)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:59.143245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3022e-6ba1-4952-a2ae-de5fa8627ae1 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:59.145125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 174/362] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:58 2022] GET /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:59.145912 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3022e-6ba1-4952-a2ae-de5fa8627ae1 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:59.184610 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:59.222547 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:59.241667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95c164-7e7a-4b25-8db6-cbdfc248f6be None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:59.294800 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d429184-6065-4ef0-93a9-3c764f6bc8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:59.295900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d429184-6065-4ef0-93a9-3c764f6bc8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:59.295900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d429184-6065-4ef0-93a9-3c764f6bc8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:59.296147 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d429184-6065-4ef0-93a9-3c764f6bc8d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:59.300530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3022e-6ba1-4952-a2ae-de5fa8627ae1 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:59.344104 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6683b-379e-4034-8d91-adb552afe8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:59.344440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6683b-379e-4034-8d91-adb552afe8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:59.344710 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6683b-379e-4034-8d91-adb552afe8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:59.344985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6683b-379e-4034-8d91-adb552afe8a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:59.346291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6683b-379e-4034-8d91-adb552afe8a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:59.346291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6683b-379e-4034-8d91-adb552afe8a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:59.349867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6683b-379e-4034-8d91-adb552afe8a3 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:59.362994 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 175/363] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:24:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:59.363891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6683b-379e-4034-8d91-adb552afe8a3 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:59.388756 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d429184-6065-4ef0-93a9-3c764f6bc8d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:59.390326 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d429184-6065-4ef0-93a9-3c764f6bc8d4 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:59.471928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:59.512591 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6683b-379e-4034-8d91-adb552afe8a3 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:59.525378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:59.526229 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 189/364] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:24:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:24:59.528041 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375704d-8850-4947-8fdd-3ee8c4bb2d41 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:59.528731 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375704d-8850-4947-8fdd-3ee8c4bb2d41 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:59.529049 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375704d-8850-4947-8fdd-3ee8c4bb2d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:59.558185 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-3375704d-8850-4947-8fdd-3ee8c4bb2d41 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:59.559428 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-3375704d-8850-4947-8fdd-3ee8c4bb2d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:59.576812 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1404e7-4909-4ab5-9db4-377278532e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:59.577812 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1404e7-4909-4ab5-9db4-377278532e65 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:59.578309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1404e7-4909-4ab5-9db4-377278532e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:59.578774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1404e7-4909-4ab5-9db4-377278532e65 None admin] PATH_INFO: `/v3/groups/f90ca112cd784eb7abd978140243adf2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:59.581101 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1404e7-4909-4ab5-9db4-377278532e65 None admin] RBAC: Authorizing `identity:get_group(group_id=f90ca112cd784eb7abd978140243adf2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:59.582793 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1404e7-4909-4ab5-9db4-377278532e65 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:59.584724 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 176/365] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 18:24:59 2022] GET /identity/v3/groups/f90ca112cd784eb7abd978140243adf2 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:59.586752 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1404e7-4909-4ab5-9db4-377278532e65 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:59.651925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 190/366] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:24:59.653277 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375704d-8850-4947-8fdd-3ee8c4bb2d41 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:59.717847 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1404e7-4909-4ab5-9db4-377278532e65 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:59.769865 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b879b2-840e-4a6c-ab11-6d3aef9985a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:59.771053 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b879b2-840e-4a6c-ab11-6d3aef9985a9 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:59.773359 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b879b2-840e-4a6c-ab11-6d3aef9985a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:59.773359 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b879b2-840e-4a6c-ab11-6d3aef9985a9 None admin] PATH_INFO: `/v3/groups/f90ca112cd784eb7abd978140243adf2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:59.773359 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b879b2-840e-4a6c-ab11-6d3aef9985a9 None admin] RBAC: Authorizing `identity:get_group(group_id=f90ca112cd784eb7abd978140243adf2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:59.774711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b879b2-840e-4a6c-ab11-6d3aef9985a9 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:59.777155 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 177/367] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 18:24:59 2022] GET /identity/v3/groups/f90ca112cd784eb7abd978140243adf2 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:59.778362 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b879b2-840e-4a6c-ab11-6d3aef9985a9 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:59.791866 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:59.800140 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375704d-8850-4947-8fdd-3ee8c4bb2d41 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:59.847800 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:59.853643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8ca43-b6fa-4d42-b904-4598e6fca552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:59.854301 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8ca43-b6fa-4d42-b904-4598e6fca552 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:59.854578 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8ca43-b6fa-4d42-b904-4598e6fca552 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:59.854941 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8ca43-b6fa-4d42-b904-4598e6fca552 None admin] PATH_INFO: `/v3/users/b38b691bd2d7414b8c5969de4d732702` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:59.857158 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8ca43-b6fa-4d42-b904-4598e6fca552 None admin] RBAC: Authorizing `identity:get_user(user_id=b38b691bd2d7414b8c5969de4d732702)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:59.861383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8ca43-b6fa-4d42-b904-4598e6fca552 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:59.866567 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 191/368] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:24:59 2022] GET /identity/v3/users/b38b691bd2d7414b8c5969de4d732702 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:59.867608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8ca43-b6fa-4d42-b904-4598e6fca552 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:59.930146 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b879b2-840e-4a6c-ab11-6d3aef9985a9 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:59.982258 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7b79b-c7f2-469e-80c6-664e4e82a8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:59.982988 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7b79b-c7f2-469e-80c6-664e4e82a8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:59.983309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7b79b-c7f2-469e-80c6-664e4e82a8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:59.983601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7b79b-c7f2-469e-80c6-664e4e82a8c2 None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:59.985497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7b79b-c7f2-469e-80c6-664e4e82a8c2 None admin] RBAC: Authorizing `identity:get_project(project_id=f9f866c53099419c8982f8720259b8bf)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:59.988314 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7b79b-c7f2-469e-80c6-664e4e82a8c2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:59.993071 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 178/369] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:24:59 2022] GET /identity/v3/projects/f9f866c53099419c8982f8720259b8bf => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:59.993071 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7b79b-c7f2-469e-80c6-664e4e82a8c2 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:00.001804 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8ca43-b6fa-4d42-b904-4598e6fca552 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:00.043391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467299a-994b-4004-a5e4-f16f4adacf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:00.044064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467299a-994b-4004-a5e4-f16f4adacf7b None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:00.044347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467299a-994b-4004-a5e4-f16f4adacf7b None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:00.044623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467299a-994b-4004-a5e4-f16f4adacf7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:00.046190 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467299a-994b-4004-a5e4-f16f4adacf7b None admin] RBAC: Adding query filter params (group.id=f90ca112cd784eb7abd978140243adf2, role.id=dd7069600e364802831ce7c375e57fcd, scope.project.id=f9f866c53099419c8982f8720259b8bf) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:00.046511 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467299a-994b-4004-a5e4-f16f4adacf7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:00.048369 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467299a-994b-4004-a5e4-f16f4adacf7b None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:00.056423 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 192/370] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 18:24:59 2022] GET /identity/v3/role_assignments?group.id=f90ca112cd784eb7abd978140243adf2&scope.project.id=f9f866c53099419c8982f8720259b8bf&role.id=dd7069600e364802831ce7c375e57fcd => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:00.056423 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467299a-994b-4004-a5e4-f16f4adacf7b None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:00.113757 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:00.145338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7b79b-c7f2-469e-80c6-664e4e82a8c2 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:00.161782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:00.192874 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2c42b-b10d-4352-8135-d76ff67e2779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:00.193983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2c42b-b10d-4352-8135-d76ff67e2779 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:00.194458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2c42b-b10d-4352-8135-d76ff67e2779 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:00.195029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2c42b-b10d-4352-8135-d76ff67e2779 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:00.210486 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2c42b-b10d-4352-8135-d76ff67e2779 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:00.215965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-4fb2c42b-b10d-4352-8135-d76ff67e2779 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:25:00.215965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:00.215965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:00.215965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:00.215965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:00.215965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:00.215965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:00.215965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:00.215965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:00.215965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:00.215965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:00.215965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:00.215965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:00.215965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:00.215965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:00.215965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:00.216936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:00.216936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:00.216936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:00.216936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:00.216936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:00.216936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:00.216936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:00.216936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:00.216936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:00.216936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:00.216936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:00.216936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:00.216936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:00.216936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:00.216936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:00.216936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:00.217806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:00.217806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:00.217806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:00.217806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:00.217806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:00.217806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:00.217806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:00.217806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:00.217806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:00.217806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:00.217806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:25:00.217806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:00.219849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467299a-994b-4004-a5e4-f16f4adacf7b None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:00.222415 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 179/371] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:24:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:00.223255 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2c42b-b10d-4352-8135-d76ff67e2779 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:00.269027 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db5638-6d31-4dfd-a8ef-31447adf045d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:00.269676 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db5638-6d31-4dfd-a8ef-31447adf045d None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:00.269961 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db5638-6d31-4dfd-a8ef-31447adf045d None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:00.270358 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db5638-6d31-4dfd-a8ef-31447adf045d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:00.271300 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db5638-6d31-4dfd-a8ef-31447adf045d None admin] RBAC: Adding query filter params (group.id=f90ca112cd784eb7abd978140243adf2, role.id=dd7069600e364802831ce7c375e57fcd, scope.project.id=8067a8a77005444fb4e26dc5e9b19761) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:00.271619 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db5638-6d31-4dfd-a8ef-31447adf045d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:00.273085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db5638-6d31-4dfd-a8ef-31447adf045d None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:00.280429 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 193/372] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 18:25:00 2022] GET /identity/v3/role_assignments?group.id=f90ca112cd784eb7abd978140243adf2&scope.project.id=8067a8a77005444fb4e26dc5e9b19761&role.id=dd7069600e364802831ce7c375e57fcd => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:00.281285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db5638-6d31-4dfd-a8ef-31447adf045d None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:00.367306 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2c42b-b10d-4352-8135-d76ff67e2779 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:00.416692 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41496c-09e2-4ebe-96f8-3d3bf222075f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:00.417349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41496c-09e2-4ebe-96f8-3d3bf222075f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:00.418851 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41496c-09e2-4ebe-96f8-3d3bf222075f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:00.418851 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41496c-09e2-4ebe-96f8-3d3bf222075f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:00.419458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41496c-09e2-4ebe-96f8-3d3bf222075f None admin] RBAC: Adding query filter params (role.id=27bb3ae43da44e3a87a409e5adae712c, user.id=b38b691bd2d7414b8c5969de4d732702, scope.system=all) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:00.419829 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41496c-09e2-4ebe-96f8-3d3bf222075f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:00.421333 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41496c-09e2-4ebe-96f8-3d3bf222075f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:00.439359 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 180/373] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Jul 27 18:25:00 2022] GET /identity/v3/role_assignments?user.id=b38b691bd2d7414b8c5969de4d732702&scope.system=all&role.id=27bb3ae43da44e3a87a409e5adae712c => generated 510 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:00.439359 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb239d-e25a-4221-9882-d5bfd67371e6 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:00.439630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb239d-e25a-4221-9882-d5bfd67371e6 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:00.439923 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb239d-e25a-4221-9882-d5bfd67371e6 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:00.442230 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 181/374] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:00.447033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb239d-e25a-4221-9882-d5bfd67371e6 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:00.462026 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:00.482195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db5638-6d31-4dfd-a8ef-31447adf045d None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:00.508180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:00.548818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c07d5e-b3f7-4df4-a3ee-6d0af8fbc0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:00.549502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c07d5e-b3f7-4df4-a3ee-6d0af8fbc0bd None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:00.549781 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c07d5e-b3f7-4df4-a3ee-6d0af8fbc0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:00.550106 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c07d5e-b3f7-4df4-a3ee-6d0af8fbc0bd None admin] PATH_INFO: `/v3/groups/f90ca112cd784eb7abd978140243adf2` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:00.553108 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c07d5e-b3f7-4df4-a3ee-6d0af8fbc0bd None admin] RBAC: Authorizing `identity:get_group(group_id=f90ca112cd784eb7abd978140243adf2)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:00.554621 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c07d5e-b3f7-4df4-a3ee-6d0af8fbc0bd None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:00.563298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 194/375] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 18:25:00 2022] GET /identity/v3/groups/f90ca112cd784eb7abd978140243adf2 => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:00.563298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041bed2-8fef-4199-a342-03124c301d20 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:00.563298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041bed2-8fef-4199-a342-03124c301d20 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:00.563298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041bed2-8fef-4199-a342-03124c301d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:00.583148 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-2041bed2-8fef-4199-a342-03124c301d20 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:00.584395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2041bed2-8fef-4199-a342-03124c301d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:00.623405 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb239d-e25a-4221-9882-d5bfd67371e6 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:00.671354 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b967f-5dcb-416c-9f1c-84d57ec48fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:00.672341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b967f-5dcb-416c-9f1c-84d57ec48fbf None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:00.672764 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b967f-5dcb-416c-9f1c-84d57ec48fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:00.673254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b967f-5dcb-416c-9f1c-84d57ec48fbf None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:00.673470 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 195/376] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:00.674988 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041bed2-8fef-4199-a342-03124c301d20 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:00.675455 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b967f-5dcb-416c-9f1c-84d57ec48fbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:00.675914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b967f-5dcb-416c-9f1c-84d57ec48fbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:00.677487 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b967f-5dcb-416c-9f1c-84d57ec48fbf None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:00.691787 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 182/377] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:25:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:00.697432 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b967f-5dcb-416c-9f1c-84d57ec48fbf None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:00.816184 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:00.832417 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:00.838722 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041bed2-8fef-4199-a342-03124c301d20 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:00.846529 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b967f-5dcb-416c-9f1c-84d57ec48fbf None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:00.901320 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd661f2-e374-46d0-aeb7-61544c264025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:00.902317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd661f2-e374-46d0-aeb7-61544c264025 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:00.902741 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0e438-81b7-4179-a097-fe458768382a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:00.902886 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd661f2-e374-46d0-aeb7-61544c264025 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:00.903337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd661f2-e374-46d0-aeb7-61544c264025 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:00.903459 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0e438-81b7-4179-a097-fe458768382a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:00.903677 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0e438-81b7-4179-a097-fe458768382a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:00.903955 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0e438-81b7-4179-a097-fe458768382a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:00.904883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd661f2-e374-46d0-aeb7-61544c264025 None admin] RBAC: Adding query filter params (group.id=f90ca112cd784eb7abd978140243adf2, role.id=f105208a21c84d4fa134aa0aeb62f3bb, scope.project.id=f9f866c53099419c8982f8720259b8bf) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:00.905452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd661f2-e374-46d0-aeb7-61544c264025 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:00.907654 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd661f2-e374-46d0-aeb7-61544c264025 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:00.917804 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 196/378] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 18:25:00 2022] GET /identity/v3/role_assignments?group.id=f90ca112cd784eb7abd978140243adf2&scope.project.id=f9f866c53099419c8982f8720259b8bf&role.id=f105208a21c84d4fa134aa0aeb62f3bb => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:00.919019 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd661f2-e374-46d0-aeb7-61544c264025 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:01.069270 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0e438-81b7-4179-a097-fe458768382a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:01.071523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0e438-81b7-4179-a097-fe458768382a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:01.167308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd661f2-e374-46d0-aeb7-61544c264025 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:01.225761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1bf91-0110-4855-9e95-6e65c51abdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:01.226582 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1bf91-0110-4855-9e95-6e65c51abdc6 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:01.226805 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1bf91-0110-4855-9e95-6e65c51abdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:01.228459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1bf91-0110-4855-9e95-6e65c51abdc6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:01.241042 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:01.245780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1bf91-0110-4855-9e95-6e65c51abdc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:01.251352 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 183/379] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:25:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:25:01.255934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-a4c1bf91-0110-4855-9e95-6e65c51abdc6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:25:01.255934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:01.255934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:01.255934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:01.255934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:01.255934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:01.255934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:01.255934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:01.255934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:01.255934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:01.255934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:01.255934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:01.255934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:01.255934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:01.255934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:01.255934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:01.257386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:01.257386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:01.257386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:01.257386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:01.257386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:01.257386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:01.257386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:01.257386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:01.257386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:01.257386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:01.257386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:01.257386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:01.257386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:01.257386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:01.257386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:01.257386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:01.258580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:01.258580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:01.258580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:01.258580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:01.258580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:01.258580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:01.258580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:01.258580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:01.258580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:01.258580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:01.258580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:25:01.258580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:01.258580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 197/380] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:25:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:01.263286 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0e438-81b7-4179-a097-fe458768382a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:01.280571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1bf91-0110-4855-9e95-6e65c51abdc6 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:01.380560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:01.460680 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1bf91-0110-4855-9e95-6e65c51abdc6 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:01.504896 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0e438-81b7-4179-a097-fe458768382a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:01.508421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a97036-8c11-4e78-b190-a73362a14461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:01.510037 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a97036-8c11-4e78-b190-a73362a14461 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:01.510037 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a97036-8c11-4e78-b190-a73362a14461 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:01.510037 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a97036-8c11-4e78-b190-a73362a14461 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:01.510478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a97036-8c11-4e78-b190-a73362a14461 None admin] RBAC: Adding query filter params (name=member) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:01.511254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a97036-8c11-4e78-b190-a73362a14461 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:01.511254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a97036-8c11-4e78-b190-a73362a14461 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:01.529194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 198/381] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:25:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:01.534941 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a97036-8c11-4e78-b190-a73362a14461 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:01.620298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfcb38-3ed8-4e98-9e26-cc248d3a2e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:01.621223 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfcb38-3ed8-4e98-9e26-cc248d3a2e76 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:01.621579 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfcb38-3ed8-4e98-9e26-cc248d3a2e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:01.622001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfcb38-3ed8-4e98-9e26-cc248d3a2e76 None admin] PATH_INFO: `/v3/projects/940bf108a6364eafb1a69efe7e124464` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:01.628764 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfcb38-3ed8-4e98-9e26-cc248d3a2e76 None admin] RBAC: Authorizing `identity:get_project(project_id=940bf108a6364eafb1a69efe7e124464)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:01.631444 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfcb38-3ed8-4e98-9e26-cc248d3a2e76 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:01.634554 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 184/382] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:25:01 2022] GET /identity/v3/projects/940bf108a6364eafb1a69efe7e124464 => generated 344 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:01.646262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfcb38-3ed8-4e98-9e26-cc248d3a2e76 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:01.695665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:01.753565 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a97036-8c11-4e78-b190-a73362a14461 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:01.806729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30c18b-c716-4d58-8578-4c7cd85c0cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:01.807420 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30c18b-c716-4d58-8578-4c7cd85c0cfc None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:01.807702 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30c18b-c716-4d58-8578-4c7cd85c0cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:01.807979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30c18b-c716-4d58-8578-4c7cd85c0cfc None admin] PATH_INFO: `/v3/groups/f90ca112cd784eb7abd978140243adf2` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:01.809177 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30c18b-c716-4d58-8578-4c7cd85c0cfc None admin] RBAC: Authorizing `identity:get_group(group_id=f90ca112cd784eb7abd978140243adf2)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:01.810634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30c18b-c716-4d58-8578-4c7cd85c0cfc None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:01.821326 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 199/383] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 18:25:01 2022] GET /identity/v3/groups/f90ca112cd784eb7abd978140243adf2 => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:01.823492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30c18b-c716-4d58-8578-4c7cd85c0cfc None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:01.837271 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:01.985983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfcb38-3ed8-4e98-9e26-cc248d3a2e76 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:01.991809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30c18b-c716-4d58-8578-4c7cd85c0cfc None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:02.048063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c79f22-7cd3-41d3-9474-a3a01ae17216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:02.051395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c79f22-7cd3-41d3-9474-a3a01ae17216 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:02.051875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c79f22-7cd3-41d3-9474-a3a01ae17216 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:02.052500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c79f22-7cd3-41d3-9474-a3a01ae17216 None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:02.054511 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c79f22-7cd3-41d3-9474-a3a01ae17216 None admin] RBAC: Authorizing `identity:get_project(project_id=8067a8a77005444fb4e26dc5e9b19761)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:02.056815 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c79f22-7cd3-41d3-9474-a3a01ae17216 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:02.060187 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 200/384] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:25:01 2022] GET /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:02.068760 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c79f22-7cd3-41d3-9474-a3a01ae17216 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:02.090742 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91af55-c503-4f67-a80c-22f28c45f934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:02.092322 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:02.092709 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91af55-c503-4f67-a80c-22f28c45f934 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:02.093335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91af55-c503-4f67-a80c-22f28c45f934 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:02.095279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91af55-c503-4f67-a80c-22f28c45f934 None admin] PATH_INFO: `/v3/groups/c565afc4ece7418e8404c07f56baf136` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:02.115003 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91af55-c503-4f67-a80c-22f28c45f934 None admin] RBAC: Authorizing `identity:get_group(group_id=c565afc4ece7418e8404c07f56baf136)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:02.116965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91af55-c503-4f67-a80c-22f28c45f934 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:02.119089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 185/385] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 18:25:01 2022] GET /identity/v3/groups/c565afc4ece7418e8404c07f56baf136 => generated 229 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:02.135864 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91af55-c503-4f67-a80c-22f28c45f934 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:02.268964 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c79f22-7cd3-41d3-9474-a3a01ae17216 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:02.279593 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91af55-c503-4f67-a80c-22f28c45f934 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:02.305957 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:02.317920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eab4d4-174a-4b0d-ac30-29ae4ff54f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:02.318798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eab4d4-174a-4b0d-ac30-29ae4ff54f18 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:02.319247 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eab4d4-174a-4b0d-ac30-29ae4ff54f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:02.319711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eab4d4-174a-4b0d-ac30-29ae4ff54f18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:02.321563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eab4d4-174a-4b0d-ac30-29ae4ff54f18 None admin] RBAC: Adding query filter params (group.id=c565afc4ece7418e8404c07f56baf136, role.id=4ae8d11d74f14bcc80117d897ba2f5b6, scope.project.id=940bf108a6364eafb1a69efe7e124464) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:02.321563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eab4d4-174a-4b0d-ac30-29ae4ff54f18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:02.322730 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eab4d4-174a-4b0d-ac30-29ae4ff54f18 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:02.333560 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 186/386] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 18:25:02 2022] GET /identity/v3/role_assignments?group.id=c565afc4ece7418e8404c07f56baf136&scope.project.id=940bf108a6364eafb1a69efe7e124464&role.id=4ae8d11d74f14bcc80117d897ba2f5b6 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:02.339493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c279b9-501e-4722-b021-7335a534d31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:02.340206 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c279b9-501e-4722-b021-7335a534d31a None admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:02.340496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c279b9-501e-4722-b021-7335a534d31a None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:02.340778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c279b9-501e-4722-b021-7335a534d31a None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761/groups/f90ca112cd784eb7abd978140243adf2/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:02.347348 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c279b9-501e-4722-b021-7335a534d31a None admin] RBAC: Authorizing `identity:create_grant(project_id=8067a8a77005444fb4e26dc5e9b19761, group_id=f90ca112cd784eb7abd978140243adf2, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:02.348861 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c279b9-501e-4722-b021-7335a534d31a None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:02.434187 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 201/387] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Jul 27 18:25:02 2022] PUT /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761/groups/f90ca112cd784eb7abd978140243adf2/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:02.868348 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fe57a-8cc9-4beb-bbe2-e5f382efacf1 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:02.869117 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fe57a-8cc9-4beb-bbe2-e5f382efacf1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:02.869626 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fe57a-8cc9-4beb-bbe2-e5f382efacf1 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:02.871605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 187/388] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:02.878522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f13c23-91f1-4de8-aed8-caa285d1907e None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:02.879253 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f13c23-91f1-4de8-aed8-caa285d1907e None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:02.879769 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f13c23-91f1-4de8-aed8-caa285d1907e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:02.901669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-f5f13c23-91f1-4de8-aed8-caa285d1907e None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:02.908614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-f5f13c23-91f1-4de8-aed8-caa285d1907e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:03.001291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:03.012645 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 202/389] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:03.056079 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fe57a-8cc9-4beb-bbe2-e5f382efacf1 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:03.172035 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fe57a-8cc9-4beb-bbe2-e5f382efacf1 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:03.209711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce564a-0d82-4f8c-a056-a09ccdead555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:03.210374 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce564a-0d82-4f8c-a056-a09ccdead555 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:03.210661 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce564a-0d82-4f8c-a056-a09ccdead555 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:03.210937 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce564a-0d82-4f8c-a056-a09ccdead555 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:03.223935 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce564a-0d82-4f8c-a056-a09ccdead555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:03.229033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-36ce564a-0d82-4f8c-a056-a09ccdead555 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:25:03.229033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:03.229033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:03.229033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:03.229033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:03.229033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:03.229033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:03.229033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:03.229033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:03.229033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:03.229033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:03.229033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:03.229033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:03.229033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:03.229033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:03.229033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:03.229924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:03.229924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:03.229924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:03.229924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:03.229924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:03.229924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:03.229924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:03.229924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:03.229924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:03.229924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:03.229924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:03.229924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:03.229924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:03.229924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:03.229924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:03.229924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:03.230855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:03.230855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:03.230855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:03.230855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:03.230855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:03.230855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:03.230855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:03.230855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:03.230855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:03.230855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:03.230855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:25:03.230855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:03.230855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 188/390] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 18:25:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:03.240649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f13c23-91f1-4de8-aed8-caa285d1907e None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:03.355666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c76860-dc99-4205-9f76-18267d8458d4 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:03.356343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c76860-dc99-4205-9f76-18267d8458d4 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:03.356343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c76860-dc99-4205-9f76-18267d8458d4 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:03.357564 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 189/391] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:25:03.366247 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04638ccf-f598-4e1f-965b-0bcd4930a93d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:03.366529 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04638ccf-f598-4e1f-965b-0bcd4930a93d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:03.366813 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04638ccf-f598-4e1f-965b-0bcd4930a93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:03.389455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f13c23-91f1-4de8-aed8-caa285d1907e None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:03.395252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-04638ccf-f598-4e1f-965b-0bcd4930a93d None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:03.396509 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-04638ccf-f598-4e1f-965b-0bcd4930a93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:03.445925 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:03.460196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d50cd9-40f0-415b-8347-90aff67ffd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:03.463291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d50cd9-40f0-415b-8347-90aff67ffd11 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:03.463291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d50cd9-40f0-415b-8347-90aff67ffd11 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:03.463291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d50cd9-40f0-415b-8347-90aff67ffd11 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:03.463291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d50cd9-40f0-415b-8347-90aff67ffd11 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:03.463291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d50cd9-40f0-415b-8347-90aff67ffd11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:03.471875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d50cd9-40f0-415b-8347-90aff67ffd11 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:03.472776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 190/392] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 27 18:25:03.489759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 203/393] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:03.496172 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04638ccf-f598-4e1f-965b-0bcd4930a93d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:03.501258 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d50cd9-40f0-415b-8347-90aff67ffd11 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:03.612990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:03.613263 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04638ccf-f598-4e1f-965b-0bcd4930a93d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:03.656950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e0484-d9f7-4575-94e5-14540050adae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:03.657775 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e0484-d9f7-4575-94e5-14540050adae None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:03.658281 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e0484-d9f7-4575-94e5-14540050adae None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:03.658626 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e0484-d9f7-4575-94e5-14540050adae None admin] PATH_INFO: `/v3/groups/f90ca112cd784eb7abd978140243adf2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:03.663306 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e0484-d9f7-4575-94e5-14540050adae None admin] RBAC: Authorizing `identity:get_group(group_id=f90ca112cd784eb7abd978140243adf2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:03.663306 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e0484-d9f7-4575-94e5-14540050adae None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:03.667530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 191/394] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 18:25:03 2022] GET /identity/v3/groups/f90ca112cd784eb7abd978140243adf2 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:03.669660 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e0484-d9f7-4575-94e5-14540050adae None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:03.691723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d50cd9-40f0-415b-8347-90aff67ffd11 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:03.723064 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:03.737687 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207be77-38db-4a0e-ac9d-198b63e57a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:03.738681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207be77-38db-4a0e-ac9d-198b63e57a9c None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:03.739190 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207be77-38db-4a0e-ac9d-198b63e57a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:03.739772 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207be77-38db-4a0e-ac9d-198b63e57a9c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:03.757008 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207be77-38db-4a0e-ac9d-198b63e57a9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:03.764665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-4207be77-38db-4a0e-ac9d-198b63e57a9c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:25:03.764665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:03.764665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:03.764665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:03.764665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:03.764665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:03.764665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:03.764665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:03.764665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:03.764665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:03.764665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:03.764665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:03.764665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:03.764665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:03.764665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:03.764665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:03.765688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:03.765688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:03.765688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:03.765688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:03.765688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:03.765688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:03.765688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:03.765688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:03.765688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:03.765688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:03.765688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:03.765688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:03.765688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:03.765688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:03.765688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:03.765688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:03.766500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:03.766500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:03.766500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:03.766500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:03.766500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:03.766500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:03.766500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:03.766500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:03.766500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:03.766500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:03.766500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:25:03.766500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:03.766500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 204/395] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 18:25:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:03.769288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d25f7-981b-4674-a932-c3ac2c5bbef8 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:03.769751 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d25f7-981b-4674-a932-c3ac2c5bbef8 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:03.771607 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d25f7-981b-4674-a932-c3ac2c5bbef8 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:03.772986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 205/396] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:03.775185 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d25f7-981b-4674-a932-c3ac2c5bbef8 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:03.793350 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e0484-d9f7-4575-94e5-14540050adae None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:03.830494 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d831980-729e-4af3-b869-b89f863ce02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:03.831167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d831980-729e-4af3-b869-b89f863ce02a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:03.831505 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d831980-729e-4af3-b869-b89f863ce02a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:03.831795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d831980-729e-4af3-b869-b89f863ce02a None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:03.833029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d831980-729e-4af3-b869-b89f863ce02a None admin] RBAC: Authorizing `identity:get_project(project_id=f9f866c53099419c8982f8720259b8bf)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:03.834505 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d831980-729e-4af3-b869-b89f863ce02a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:03.836623 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 192/397] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:25:03 2022] GET /identity/v3/projects/f9f866c53099419c8982f8720259b8bf => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:03.837784 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099bbc2-10eb-49af-b006-86b4a9ed3d0c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:03.838070 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099bbc2-10eb-49af-b006-86b4a9ed3d0c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:03.838349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099bbc2-10eb-49af-b006-86b4a9ed3d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:03.858327 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f099bbc2-10eb-49af-b006-86b4a9ed3d0c None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:03.859557 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f099bbc2-10eb-49af-b006-86b4a9ed3d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:03.905038 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d25f7-981b-4674-a932-c3ac2c5bbef8 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:03.935295 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 193/398] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:03.935295 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099bbc2-10eb-49af-b006-86b4a9ed3d0c None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:03.953984 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:03.969723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e8629-37dc-4a5a-9da1-8e5dc291b5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:03.970361 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e8629-37dc-4a5a-9da1-8e5dc291b5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:03.970761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e8629-37dc-4a5a-9da1-8e5dc291b5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:03.971087 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e8629-37dc-4a5a-9da1-8e5dc291b5d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:03.972053 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e8629-37dc-4a5a-9da1-8e5dc291b5d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:03.972367 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e8629-37dc-4a5a-9da1-8e5dc291b5d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:03.973841 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e8629-37dc-4a5a-9da1-8e5dc291b5d3 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:03.982501 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 206/399] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:03.988592 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e8629-37dc-4a5a-9da1-8e5dc291b5d3 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:04.015685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:04.074559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099bbc2-10eb-49af-b006-86b4a9ed3d0c None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:04.098690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e8629-37dc-4a5a-9da1-8e5dc291b5d3 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:04.118984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b5195-ae62-4a4a-a337-37ff02584192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:04.120457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b5195-ae62-4a4a-a337-37ff02584192 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:04.121221 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b5195-ae62-4a4a-a337-37ff02584192 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:04.121884 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b5195-ae62-4a4a-a337-37ff02584192 None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf/groups/f90ca112cd784eb7abd978140243adf2/roles/dd7069600e364802831ce7c375e57fcd` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:04.125709 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b5195-ae62-4a4a-a337-37ff02584192 None admin] RBAC: Authorizing `identity:create_grant(project_id=f9f866c53099419c8982f8720259b8bf, group_id=f90ca112cd784eb7abd978140243adf2, role_id=dd7069600e364802831ce7c375e57fcd)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:04.128698 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b5195-ae62-4a4a-a337-37ff02584192 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:04.135642 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab33074-40d5-440d-b19d-df3df1a8e49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:04.136297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab33074-40d5-440d-b19d-df3df1a8e49c None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:04.136631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab33074-40d5-440d-b19d-df3df1a8e49c None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:04.136909 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab33074-40d5-440d-b19d-df3df1a8e49c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:04.148129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab33074-40d5-440d-b19d-df3df1a8e49c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:04.153696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-fab33074-40d5-440d-b19d-df3df1a8e49c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:25:04.153696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:04.153696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:04.153696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:04.153696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:04.153696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:04.153696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:04.153696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:04.153696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:04.153696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:04.153696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:04.153696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:04.153696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:04.153696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:04.153696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:04.153696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:04.154660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:04.154660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:04.154660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:04.154660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:04.154660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:04.154660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:04.154660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:04.154660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:04.154660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:04.154660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:04.154660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:04.154660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:04.154660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:04.154660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:04.154660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:04.154660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:04.155560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:04.155560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:04.155560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:04.155560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:04.155560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:04.155560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:04.155560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:04.155560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:04.155560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:04.155560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:04.155560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:25:04.155560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:04.155560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 207/400] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:25:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:04.156229 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab33074-40d5-440d-b19d-df3df1a8e49c None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:04.218443 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 194/401] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Jul 27 18:25:03 2022] PUT /identity/v3/projects/f9f866c53099419c8982f8720259b8bf/groups/f90ca112cd784eb7abd978140243adf2/roles/dd7069600e364802831ce7c375e57fcd => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:04.219670 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b5195-ae62-4a4a-a337-37ff02584192 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:04.225362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:04.355236 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab33074-40d5-440d-b19d-df3df1a8e49c None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:04.431350 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b5195-ae62-4a4a-a337-37ff02584192 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:04.433317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208be71a-fdec-4a8c-9b9e-77a455cc8caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:04.434197 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:04.435816 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208be71a-fdec-4a8c-9b9e-77a455cc8caf None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:04.436317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208be71a-fdec-4a8c-9b9e-77a455cc8caf None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:04.436796 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208be71a-fdec-4a8c-9b9e-77a455cc8caf None admin] PATH_INFO: `/v3/groups/f90ca112cd784eb7abd978140243adf2` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:04.438222 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208be71a-fdec-4a8c-9b9e-77a455cc8caf None admin] RBAC: Authorizing `identity:get_group(group_id=f90ca112cd784eb7abd978140243adf2)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:04.440662 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208be71a-fdec-4a8c-9b9e-77a455cc8caf None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:04.442595 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 208/402] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 18:25:04 2022] GET /identity/v3/groups/f90ca112cd784eb7abd978140243adf2 => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:04.448275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208be71a-fdec-4a8c-9b9e-77a455cc8caf None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:04.487853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd158be7-077f-46ea-ac27-6360ebfb7567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:04.487853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd158be7-077f-46ea-ac27-6360ebfb7567 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:04.487853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd158be7-077f-46ea-ac27-6360ebfb7567 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:04.487853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd158be7-077f-46ea-ac27-6360ebfb7567 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:04.488241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd158be7-077f-46ea-ac27-6360ebfb7567 None admin] RBAC: Adding query filter params (name=member) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:04.488241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd158be7-077f-46ea-ac27-6360ebfb7567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:04.488241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd158be7-077f-46ea-ac27-6360ebfb7567 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:04.499501 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 195/403] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:25:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:04.505130 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd158be7-077f-46ea-ac27-6360ebfb7567 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:04.638020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208be71a-fdec-4a8c-9b9e-77a455cc8caf None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:04.665812 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:04.689108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd158be7-077f-46ea-ac27-6360ebfb7567 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:04.707151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6632648-c77f-4e0f-9782-9bf103186929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:04.708196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6632648-c77f-4e0f-9782-9bf103186929 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:04.708798 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6632648-c77f-4e0f-9782-9bf103186929 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:04.709273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6632648-c77f-4e0f-9782-9bf103186929 None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:04.710764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6632648-c77f-4e0f-9782-9bf103186929 None admin] RBAC: Authorizing `identity:get_project(project_id=8067a8a77005444fb4e26dc5e9b19761)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:04.712628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6632648-c77f-4e0f-9782-9bf103186929 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:04.715060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 209/404] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:25:04 2022] GET /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:04.716506 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f233b1-cb80-485f-aa77-a419cbdc3755 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:04.716995 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f233b1-cb80-485f-aa77-a419cbdc3755 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:04.717490 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f233b1-cb80-485f-aa77-a419cbdc3755 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:04.719385 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 210/405] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:04.725221 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fd799-4572-44a0-be7e-be8e1eee9d1f None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:04.725774 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fd799-4572-44a0-be7e-be8e1eee9d1f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:04.726252 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fd799-4572-44a0-be7e-be8e1eee9d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:04.737280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482016c2-29c1-447c-9ad7-e9f5c12dfae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:04.738001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482016c2-29c1-447c-9ad7-e9f5c12dfae9 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:04.738229 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482016c2-29c1-447c-9ad7-e9f5c12dfae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:04.738510 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482016c2-29c1-447c-9ad7-e9f5c12dfae9 None admin] PATH_INFO: `/v3/groups/f90ca112cd784eb7abd978140243adf2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:04.739739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482016c2-29c1-447c-9ad7-e9f5c12dfae9 None admin] RBAC: Authorizing `identity:get_group(group_id=f90ca112cd784eb7abd978140243adf2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:04.741206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482016c2-29c1-447c-9ad7-e9f5c12dfae9 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:04.743168 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 196/406] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 18:25:04 2022] GET /identity/v3/groups/f90ca112cd784eb7abd978140243adf2 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:04.744070 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482016c2-29c1-447c-9ad7-e9f5c12dfae9 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:04.749762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-b07fd799-4572-44a0-be7e-be8e1eee9d1f None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:04.751675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b07fd799-4572-44a0-be7e-be8e1eee9d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:04.780904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:04.835564 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 211/407] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:04.836931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fd799-4572-44a0-be7e-be8e1eee9d1f None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:04.852243 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482016c2-29c1-447c-9ad7-e9f5c12dfae9 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:04.887460 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc95ba-1a0c-491f-a6c4-afd25b99d19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:04.888131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc95ba-1a0c-491f-a6c4-afd25b99d19a None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:04.888433 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc95ba-1a0c-491f-a6c4-afd25b99d19a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:04.888689 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc95ba-1a0c-491f-a6c4-afd25b99d19a None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761/groups/f90ca112cd784eb7abd978140243adf2/roles/dd7069600e364802831ce7c375e57fcd` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:04.891032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc95ba-1a0c-491f-a6c4-afd25b99d19a None admin] RBAC: Authorizing `identity:create_grant(project_id=8067a8a77005444fb4e26dc5e9b19761, group_id=f90ca112cd784eb7abd978140243adf2, role_id=dd7069600e364802831ce7c375e57fcd)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:04.892705 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc95ba-1a0c-491f-a6c4-afd25b99d19a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:04.977449 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fd799-4572-44a0-be7e-be8e1eee9d1f None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:04.989271 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:05.009155 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 197/408] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Jul 27 18:25:04 2022] PUT /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761/groups/f90ca112cd784eb7abd978140243adf2/roles/dd7069600e364802831ce7c375e57fcd => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:05.010048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc95ba-1a0c-491f-a6c4-afd25b99d19a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:05.029103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a8c41-4a6c-464e-b14f-9877f9ffd7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:05.030519 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a8c41-4a6c-464e-b14f-9877f9ffd7da None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:05.031233 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a8c41-4a6c-464e-b14f-9877f9ffd7da None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:05.032229 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a8c41-4a6c-464e-b14f-9877f9ffd7da None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:05.034006 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a8c41-4a6c-464e-b14f-9877f9ffd7da None admin] RBAC: Authorizing `identity:get_project(project_id=f9f866c53099419c8982f8720259b8bf)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:05.036211 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a8c41-4a6c-464e-b14f-9877f9ffd7da None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:05.038268 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 212/409] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:25:04 2022] GET /identity/v3/projects/f9f866c53099419c8982f8720259b8bf => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:05.052540 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a8c41-4a6c-464e-b14f-9877f9ffd7da None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:05.143560 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:05.152967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc95ba-1a0c-491f-a6c4-afd25b99d19a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:05.199425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6406d54-5c4d-458d-9d3f-cf96df07dcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:05.201665 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6406d54-5c4d-458d-9d3f-cf96df07dcc1 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:05.201665 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6406d54-5c4d-458d-9d3f-cf96df07dcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:05.201665 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6406d54-5c4d-458d-9d3f-cf96df07dcc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:05.216423 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6406d54-5c4d-458d-9d3f-cf96df07dcc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:05.223872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-b6406d54-5c4d-458d-9d3f-cf96df07dcc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:25:05.223872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:05.223872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:05.223872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:05.223872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:05.223872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:05.223872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:05.223872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:05.223872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:05.223872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:05.223872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:05.223872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:05.223872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:05.223872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:05.223872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:05.223872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:05.225032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:05.225032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:05.225032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:05.225032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:05.225032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:05.225032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:05.225032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:05.225032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:05.225032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:05.225032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:05.225032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:05.225032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:05.225032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:05.225032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:05.225032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:05.225032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:05.226009 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:05.226009 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:05.226009 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:05.226009 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:05.226009 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:05.226009 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:05.226009 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:05.226009 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:05.226009 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:05.226009 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:05.226009 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:25:05.226009 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:05.229367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 198/410] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:25:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:05.238544 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6406d54-5c4d-458d-9d3f-cf96df07dcc1 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:05.276833 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a8c41-4a6c-464e-b14f-9877f9ffd7da None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:05.313270 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff85727-17bb-4ff8-8bf8-8a384ae3a416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:05.313949 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff85727-17bb-4ff8-8bf8-8a384ae3a416 None admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:05.314257 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff85727-17bb-4ff8-8bf8-8a384ae3a416 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:05.314532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff85727-17bb-4ff8-8bf8-8a384ae3a416 None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf/groups/f90ca112cd784eb7abd978140243adf2/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:05.317672 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff85727-17bb-4ff8-8bf8-8a384ae3a416 None admin] RBAC: Authorizing `identity:create_grant(project_id=f9f866c53099419c8982f8720259b8bf, group_id=f90ca112cd784eb7abd978140243adf2, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:05.320025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff85727-17bb-4ff8-8bf8-8a384ae3a416 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:05.364148 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6406d54-5c4d-458d-9d3f-cf96df07dcc1 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:05.401194 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be78d16-a3d3-4d3d-a97d-b5d21080c5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:05.402458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be78d16-a3d3-4d3d-a97d-b5d21080c5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:05.403233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be78d16-a3d3-4d3d-a97d-b5d21080c5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:05.403786 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be78d16-a3d3-4d3d-a97d-b5d21080c5c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:05.404760 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be78d16-a3d3-4d3d-a97d-b5d21080c5c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:05.405253 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be78d16-a3d3-4d3d-a97d-b5d21080c5c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:05.406432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 213/411] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Jul 27 18:25:05 2022] PUT /identity/v3/projects/f9f866c53099419c8982f8720259b8bf/groups/f90ca112cd784eb7abd978140243adf2/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:05.407339 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be78d16-a3d3-4d3d-a97d-b5d21080c5c3 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:05.408056 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21189dbf-4c6c-404e-81b0-246a7cd50373 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:05.418622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21189dbf-4c6c-404e-81b0-246a7cd50373 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:05.418622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21189dbf-4c6c-404e-81b0-246a7cd50373 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:05.418622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 214/412] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:05.420704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b0e44-52cb-4de0-b224-959bd7692d78 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:05.421081 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b0e44-52cb-4de0-b224-959bd7692d78 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:05.421430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b0e44-52cb-4de0-b224-959bd7692d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:05.426382 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 199/413] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:25:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:05.437101 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be78d16-a3d3-4d3d-a97d-b5d21080c5c3 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:05.459773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:05.465214 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-d37b0e44-52cb-4de0-b224-959bd7692d78 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:05.466133 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-d37b0e44-52cb-4de0-b224-959bd7692d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:05.561677 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:05.565633 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be78d16-a3d3-4d3d-a97d-b5d21080c5c3 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:05.612589 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3827fc-e396-4105-9a1e-33e184291a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:05.613653 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3827fc-e396-4105-9a1e-33e184291a7b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:05.616534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3827fc-e396-4105-9a1e-33e184291a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:05.617058 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3827fc-e396-4105-9a1e-33e184291a7b None admin] PATH_INFO: `/v3/groups/c565afc4ece7418e8404c07f56baf136` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:05.618683 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3827fc-e396-4105-9a1e-33e184291a7b None admin] RBAC: Authorizing `identity:get_group(group_id=c565afc4ece7418e8404c07f56baf136)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:05.620484 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3827fc-e396-4105-9a1e-33e184291a7b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:05.631820 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 200/414] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 18:25:05 2022] GET /identity/v3/groups/c565afc4ece7418e8404c07f56baf136 => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:05.633094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3827fc-e396-4105-9a1e-33e184291a7b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:05.659040 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 215/415] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:05.690328 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b0e44-52cb-4de0-b224-959bd7692d78 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:05.754347 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:05.788493 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3827fc-e396-4105-9a1e-33e184291a7b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:05.858588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbbabe-def4-4797-ab95-67faefecc254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:05.859160 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbbabe-def4-4797-ab95-67faefecc254 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:05.859462 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbbabe-def4-4797-ab95-67faefecc254 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:05.859732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbbabe-def4-4797-ab95-67faefecc254 None admin] PATH_INFO: `/v3/projects/940bf108a6364eafb1a69efe7e124464` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:05.861867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bbbabe-def4-4797-ab95-67faefecc254 None admin] RBAC: Authorizing `identity:get_project(project_id=940bf108a6364eafb1a69efe7e124464)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:05.863496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bbbabe-def4-4797-ab95-67faefecc254 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:05.866725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 201/416] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:25:05 2022] GET /identity/v3/projects/940bf108a6364eafb1a69efe7e124464 => generated 344 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:05.873241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbbabe-def4-4797-ab95-67faefecc254 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:05.884337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b0e44-52cb-4de0-b224-959bd7692d78 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:05.965010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097fbb9-8142-48cd-8649-22b5d6991d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:05.965664 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097fbb9-8142-48cd-8649-22b5d6991d34 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:05.965940 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097fbb9-8142-48cd-8649-22b5d6991d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:05.966212 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097fbb9-8142-48cd-8649-22b5d6991d34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:05.990557 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097fbb9-8142-48cd-8649-22b5d6991d34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:05.995553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-1097fbb9-8142-48cd-8649-22b5d6991d34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:25:05.995553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:05.995553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:05.995553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:05.995553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:05.995553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:05.995553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:05.995553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:05.995553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:05.995553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:05.995553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:05.995553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:05.995553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:05.995553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:05.995553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:05.995553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:05.996440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:05.996440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:05.996440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:05.996440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:05.996440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:05.996440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:05.996440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:05.996440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:05.996440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:05.996440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:05.996440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:05.996440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:05.996440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:05.996440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:05.996440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:05.996440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:05.997237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:05.997237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:05.997237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:05.997237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:05.997237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:05.997237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:05.997237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:05.997237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:05.997237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:05.997237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:05.997237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:25:05.997237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:06.012265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 216/417] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:25:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:06.013189 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097fbb9-8142-48cd-8649-22b5d6991d34 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:06.062812 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbbabe-def4-4797-ab95-67faefecc254 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:06.068121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:06.132508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f9bd2-81b8-439c-b0a1-d88490d9e423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:06.133193 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f9bd2-81b8-439c-b0a1-d88490d9e423 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:06.133472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f9bd2-81b8-439c-b0a1-d88490d9e423 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:06.133744 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f9bd2-81b8-439c-b0a1-d88490d9e423 None admin] PATH_INFO: `/v3/projects/940bf108a6364eafb1a69efe7e124464/groups/c565afc4ece7418e8404c07f56baf136/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:06.137035 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f9bd2-81b8-439c-b0a1-d88490d9e423 None admin] RBAC: Authorizing `identity:create_grant(project_id=940bf108a6364eafb1a69efe7e124464, group_id=c565afc4ece7418e8404c07f56baf136, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:06.138483 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f9bd2-81b8-439c-b0a1-d88490d9e423 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:06.180001 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097fbb9-8142-48cd-8649-22b5d6991d34 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:06.216608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26e909-97d8-40e0-9c4e-b88bccd10886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:06.217324 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26e909-97d8-40e0-9c4e-b88bccd10886 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:06.217609 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26e909-97d8-40e0-9c4e-b88bccd10886 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:06.217882 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26e909-97d8-40e0-9c4e-b88bccd10886 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:06.226069 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 202/418] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Jul 27 18:25:05 2022] PUT /identity/v3/projects/940bf108a6364eafb1a69efe7e124464/groups/c565afc4ece7418e8404c07f56baf136/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:06.226221 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26e909-97d8-40e0-9c4e-b88bccd10886 None admin] RBAC: Adding query filter params (name=member) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:06.226498 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26e909-97d8-40e0-9c4e-b88bccd10886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:06.228109 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26e909-97d8-40e0-9c4e-b88bccd10886 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:06.239508 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 217/419] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:25:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:06.245388 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f9bd2-81b8-439c-b0a1-d88490d9e423 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:06.268157 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:06.363111 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f9bd2-81b8-439c-b0a1-d88490d9e423 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:06.401784 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d17cd-dde0-4426-9d61-7307b47798b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:06.402346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d17cd-dde0-4426-9d61-7307b47798b7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:06.403621 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d17cd-dde0-4426-9d61-7307b47798b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:06.403980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d17cd-dde0-4426-9d61-7307b47798b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:06.479127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d17cd-dde0-4426-9d61-7307b47798b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:06.480715 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d17cd-dde0-4426-9d61-7307b47798b7 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:06.496316 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:06.598006 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf71be-9d99-496f-bdd6-5d2cf28a7718 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:06.598541 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf71be-9d99-496f-bdd6-5d2cf28a7718 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:06.598617 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf71be-9d99-496f-bdd6-5d2cf28a7718 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:06.600500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 218/420] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:25:06.608293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 203/421] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:25:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:25:06.611618 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8b4eb-3006-4af4-8f69-1f492845f48c None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:06.612152 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8b4eb-3006-4af4-8f69-1f492845f48c None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:06.612630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8b4eb-3006-4af4-8f69-1f492845f48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:06.616645 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d17cd-dde0-4426-9d61-7307b47798b7 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:06.641460 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-0dc8b4eb-3006-4af4-8f69-1f492845f48c None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:06.642897 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-0dc8b4eb-3006-4af4-8f69-1f492845f48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:06.746644 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 219/422] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:06.785606 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d17cd-dde0-4426-9d61-7307b47798b7 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:06.805875 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:06.808762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8b4eb-3006-4af4-8f69-1f492845f48c None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:06.827240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8837884-7744-4119-b0a8-c87745d9dc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:06.827936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8837884-7744-4119-b0a8-c87745d9dc43 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:06.828222 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8837884-7744-4119-b0a8-c87745d9dc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:06.828503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8837884-7744-4119-b0a8-c87745d9dc43 None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:06.830249 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8837884-7744-4119-b0a8-c87745d9dc43 None admin] RBAC: Authorizing `identity:get_project(project_id=8067a8a77005444fb4e26dc5e9b19761)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:06.831774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8837884-7744-4119-b0a8-c87745d9dc43 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:06.833943 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 204/423] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:25:06 2022] GET /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:06.839371 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8837884-7744-4119-b0a8-c87745d9dc43 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:06.864223 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:06.977635 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8837884-7744-4119-b0a8-c87745d9dc43 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:07.013900 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63f7de-8299-4675-9373-ed252374e801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:07.014461 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63f7de-8299-4675-9373-ed252374e801 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:07.014811 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63f7de-8299-4675-9373-ed252374e801 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:07.015085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63f7de-8299-4675-9373-ed252374e801 None admin] PATH_INFO: `/v3/groups/f90ca112cd784eb7abd978140243adf2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:07.021768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63f7de-8299-4675-9373-ed252374e801 None admin] RBAC: Authorizing `identity:get_group(group_id=f90ca112cd784eb7abd978140243adf2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:07.023245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63f7de-8299-4675-9373-ed252374e801 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:07.025097 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 205/424] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 18:25:06 2022] GET /identity/v3/groups/f90ca112cd784eb7abd978140243adf2 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:07.032423 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63f7de-8299-4675-9373-ed252374e801 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:07.073824 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8b4eb-3006-4af4-8f69-1f492845f48c None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:07.119701 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:07.150097 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405c3b2-5f33-499e-b9dc-a23ce79b3ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:07.150760 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405c3b2-5f33-499e-b9dc-a23ce79b3ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:07.151043 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405c3b2-5f33-499e-b9dc-a23ce79b3ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:07.152639 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405c3b2-5f33-499e-b9dc-a23ce79b3ee1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:07.174769 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405c3b2-5f33-499e-b9dc-a23ce79b3ee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:07.187685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-f405c3b2-5f33-499e-b9dc-a23ce79b3ee1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:25:07.187685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:07.187685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:07.187685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:07.187685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:07.187685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:07.187685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:07.187685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:07.187685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:07.187685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:07.187685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:07.187685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:07.187685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:07.187685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:07.187685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:07.187685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:07.188803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:07.188803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:07.188803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:07.188803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:07.188803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:07.188803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:07.188803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:07.188803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:07.188803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:07.188803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:07.188803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:07.188803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:07.188803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:07.188803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:07.188803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:07.188803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:07.190023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:07.190023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:07.190023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:07.190023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:07.190023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:07.190023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:07.190023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:07.190023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:07.190023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:07.190023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:07.190023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:25:07.190023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:07.193376 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 220/425] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 18:25:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:25:07.199066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405c3b2-5f33-499e-b9dc-a23ce79b3ee1 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:07.204572 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63f7de-8299-4675-9373-ed252374e801 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:07.261792 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e14744-13d3-4aa1-ab8b-19607f6dcd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:07.262702 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e14744-13d3-4aa1-ab8b-19607f6dcd1d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:07.263124 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e14744-13d3-4aa1-ab8b-19607f6dcd1d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:07.263563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e14744-13d3-4aa1-ab8b-19607f6dcd1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:07.264559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e14744-13d3-4aa1-ab8b-19607f6dcd1d None admin] RBAC: Adding query filter params (group.id=f90ca112cd784eb7abd978140243adf2, role.id=f105208a21c84d4fa134aa0aeb62f3bb, scope.project.id=8067a8a77005444fb4e26dc5e9b19761) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:07.265015 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e14744-13d3-4aa1-ab8b-19607f6dcd1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:07.266618 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e14744-13d3-4aa1-ab8b-19607f6dcd1d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:07.274031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 206/426] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 18:25:07 2022] GET /identity/v3/role_assignments?group.id=f90ca112cd784eb7abd978140243adf2&scope.project.id=8067a8a77005444fb4e26dc5e9b19761&role.id=f105208a21c84d4fa134aa0aeb62f3bb => generated 611 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:07.390391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:07.418672 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405c3b2-5f33-499e-b9dc-a23ce79b3ee1 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:07.471818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e20e75-6fd3-4dea-9117-8c9a744ed4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:07.472826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e20e75-6fd3-4dea-9117-8c9a744ed4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:07.473287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e20e75-6fd3-4dea-9117-8c9a744ed4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:07.473731 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e20e75-6fd3-4dea-9117-8c9a744ed4a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:07.474656 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e20e75-6fd3-4dea-9117-8c9a744ed4a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:07.475164 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e20e75-6fd3-4dea-9117-8c9a744ed4a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:07.477011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e20e75-6fd3-4dea-9117-8c9a744ed4a7 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:07.488922 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 221/427] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:07.495542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e14744-13d3-4aa1-ab8b-19607f6dcd1d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:07.573088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f2eed-ab32-47c7-8d9f-e563ed15e3ee None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:07.573658 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f2eed-ab32-47c7-8d9f-e563ed15e3ee None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:07.574451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f2eed-ab32-47c7-8d9f-e563ed15e3ee None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:07.576907 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 222/428] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:07.583901 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f214c1-8c6f-41a0-9aed-c5a230de3f83 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:07.584624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f214c1-8c6f-41a0-9aed-c5a230de3f83 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:07.585110 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f214c1-8c6f-41a0-9aed-c5a230de3f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:07.616366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-a7f214c1-8c6f-41a0-9aed-c5a230de3f83 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:07.617858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a7f214c1-8c6f-41a0-9aed-c5a230de3f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:07.671089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e14744-13d3-4aa1-ab8b-19607f6dcd1d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:07.687621 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:07.713897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ec0c6-3afd-48d7-9730-c5fdefd4ac3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:07.715109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ec0c6-3afd-48d7-9730-c5fdefd4ac3b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:07.716024 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ec0c6-3afd-48d7-9730-c5fdefd4ac3b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:07.716752 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ec0c6-3afd-48d7-9730-c5fdefd4ac3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:07.727166 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 223/429] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:07.757205 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f214c1-8c6f-41a0-9aed-c5a230de3f83 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:07.816032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ec0c6-3afd-48d7-9730-c5fdefd4ac3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:07.817458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ec0c6-3afd-48d7-9730-c5fdefd4ac3b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:07.883278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:07.924996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f214c1-8c6f-41a0-9aed-c5a230de3f83 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:07.960224 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 207/430] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:25:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 18:25:07.967669 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ec0c6-3afd-48d7-9730-c5fdefd4ac3b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:07.976939 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64909d-3db3-41eb-a902-5c582a01d636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:07.977619 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64909d-3db3-41eb-a902-5c582a01d636 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:07.977905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64909d-3db3-41eb-a902-5c582a01d636 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:07.983293 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64909d-3db3-41eb-a902-5c582a01d636 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:07.986002 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:07.990060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64909d-3db3-41eb-a902-5c582a01d636 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:07.996329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-ec64909d-3db3-41eb-a902-5c582a01d636 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:25:07.996329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:07.996329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:07.996329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:07.996329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:07.996329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:07.996329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:07.996329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:07.996329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:07.996329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:07.996329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:07.996329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:07.996329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:07.996329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:07.996329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:07.996329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:08.014888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:08.014888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:08.014888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:08.014888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:08.014888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:08.014888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:08.014888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:08.014888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:08.014888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:08.014888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:08.014888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:08.014888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:08.014888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:08.014888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:08.014888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:08.014888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:08.015826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:08.015826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:08.015826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:08.015826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:08.015826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:08.015826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:08.015826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:08.015826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:08.015826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:08.015826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:08.015826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:25:08.015826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:08.015826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 224/431] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 18:25:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:08.015826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64909d-3db3-41eb-a902-5c582a01d636 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:08.098345 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ec0c6-3afd-48d7-9730-c5fdefd4ac3b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:08.123503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64909d-3db3-41eb-a902-5c582a01d636 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:08.137169 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8173dde-3fa7-491f-92cb-4500f9ffb5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:08.137823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8173dde-3fa7-491f-92cb-4500f9ffb5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:08.138112 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8173dde-3fa7-491f-92cb-4500f9ffb5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:08.138395 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8173dde-3fa7-491f-92cb-4500f9ffb5f6 None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:08.139640 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8173dde-3fa7-491f-92cb-4500f9ffb5f6 None admin] RBAC: Authorizing `identity:get_project(project_id=f9f866c53099419c8982f8720259b8bf)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:08.141105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8173dde-3fa7-491f-92cb-4500f9ffb5f6 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:08.142827 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 208/432] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:25:07 2022] GET /identity/v3/projects/f9f866c53099419c8982f8720259b8bf => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:08.143990 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a17467-a43a-4626-8c92-c26f08c1b47e None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:08.144276 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a17467-a43a-4626-8c92-c26f08c1b47e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:08.144555 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a17467-a43a-4626-8c92-c26f08c1b47e None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:08.147294 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 209/433] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:08.148707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a17467-a43a-4626-8c92-c26f08c1b47e None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:08.160228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:08.166029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ff07a-33f9-4e3e-9496-376121818d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:08.166663 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ff07a-33f9-4e3e-9496-376121818d97 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:08.166948 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ff07a-33f9-4e3e-9496-376121818d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:08.167228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ff07a-33f9-4e3e-9496-376121818d97 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:08.167984 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ff07a-33f9-4e3e-9496-376121818d97 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:08.168297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ff07a-33f9-4e3e-9496-376121818d97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:08.169690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ff07a-33f9-4e3e-9496-376121818d97 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:08.178499 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 225/434] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:08.179751 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b5275-0386-4c41-822b-3b50245de099 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:08.180041 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b5275-0386-4c41-822b-3b50245de099 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:08.180316 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b5275-0386-4c41-822b-3b50245de099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:08.199804 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-a78b5275-0386-4c41-822b-3b50245de099 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:08.201374 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a78b5275-0386-4c41-822b-3b50245de099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:08.245118 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:08.268621 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a17467-a43a-4626-8c92-c26f08c1b47e None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:08.273732 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 226/435] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:08.274886 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b5275-0386-4c41-822b-3b50245de099 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:08.313098 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259aea1-1a50-4a20-b338-f0ce84556a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:08.313778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259aea1-1a50-4a20-b338-f0ce84556a22 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:08.314610 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259aea1-1a50-4a20-b338-f0ce84556a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:08.314884 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259aea1-1a50-4a20-b338-f0ce84556a22 None admin] PATH_INFO: `/v3/groups/f90ca112cd784eb7abd978140243adf2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:08.316083 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259aea1-1a50-4a20-b338-f0ce84556a22 None admin] RBAC: Authorizing `identity:get_group(group_id=f90ca112cd784eb7abd978140243adf2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:08.317571 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259aea1-1a50-4a20-b338-f0ce84556a22 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:08.319302 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 210/436] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 18:25:08 2022] GET /identity/v3/groups/f90ca112cd784eb7abd978140243adf2 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:08.319968 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259aea1-1a50-4a20-b338-f0ce84556a22 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:08.396396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b5275-0386-4c41-822b-3b50245de099 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:08.424228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:08.430192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259aea1-1a50-4a20-b338-f0ce84556a22 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:08.435137 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f440cb-eb8b-47e5-b561-ac5a56754ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:08.435800 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f440cb-eb8b-47e5-b561-ac5a56754ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:08.436082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f440cb-eb8b-47e5-b561-ac5a56754ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:08.436356 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f440cb-eb8b-47e5-b561-ac5a56754ee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:08.468262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb243e9-6c03-448c-bdaa-fbbfcd3807f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:08.468920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb243e9-6c03-448c-bdaa-fbbfcd3807f2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:08.469201 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb243e9-6c03-448c-bdaa-fbbfcd3807f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:08.469523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb243e9-6c03-448c-bdaa-fbbfcd3807f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:08.480630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb243e9-6c03-448c-bdaa-fbbfcd3807f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:08.485625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-3fb243e9-6c03-448c-bdaa-fbbfcd3807f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:25:08.485625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:08.485625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:08.485625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:08.485625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:08.485625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:08.485625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:08.485625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:08.485625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:08.485625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:08.485625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:08.485625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:08.485625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:08.485625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:08.485625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:08.485625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:08.486725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:08.486725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:08.486725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:08.486725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:08.486725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:08.486725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:08.486725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:08.486725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:08.486725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:08.486725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:08.486725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:08.486725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:08.486725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:08.486725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:08.486725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:08.486725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:08.487682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:08.487682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:08.487682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:08.487682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:08.487682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:08.487682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:08.487682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:08.487682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:08.487682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:08.487682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:08.487682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:25:08.487682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:08.487682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 211/437] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:25:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:08.492495 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb243e9-6c03-448c-bdaa-fbbfcd3807f2 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:08.504698 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:08.515772 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f440cb-eb8b-47e5-b561-ac5a56754ee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:08.517939 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f440cb-eb8b-47e5-b561-ac5a56754ee1 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:08.609024 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb243e9-6c03-448c-bdaa-fbbfcd3807f2 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:08.644877 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 227/438] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:25:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:25:08.646467 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f440cb-eb8b-47e5-b561-ac5a56754ee1 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:08.650988 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c0a52-4292-413d-bc29-748a3308692f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:08.651687 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c0a52-4292-413d-bc29-748a3308692f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:08.651972 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c0a52-4292-413d-bc29-748a3308692f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:08.652287 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c0a52-4292-413d-bc29-748a3308692f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:08.653054 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c0a52-4292-413d-bc29-748a3308692f None admin] RBAC: Adding query filter params (group.id=f90ca112cd784eb7abd978140243adf2, role.id=dd7069600e364802831ce7c375e57fcd, scope.project.id=f9f866c53099419c8982f8720259b8bf) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:08.653367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c0a52-4292-413d-bc29-748a3308692f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:08.654831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c0a52-4292-413d-bc29-748a3308692f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:08.671306 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 212/439] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 18:25:08 2022] GET /identity/v3/role_assignments?group.id=f90ca112cd784eb7abd978140243adf2&scope.project.id=f9f866c53099419c8982f8720259b8bf&role.id=dd7069600e364802831ce7c375e57fcd => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:08.671306 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c0a52-4292-413d-bc29-748a3308692f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:08.686002 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:08.754069 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:08.789366 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c0a52-4292-413d-bc29-748a3308692f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:08.795745 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f440cb-eb8b-47e5-b561-ac5a56754ee1 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:08.829128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20184722-53a3-470e-b0e6-10c8637b4e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:08.829128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20184722-53a3-470e-b0e6-10c8637b4e68 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:08.829623 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20184722-53a3-470e-b0e6-10c8637b4e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:08.829728 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20184722-53a3-470e-b0e6-10c8637b4e68 None admin] PATH_INFO: `/v3/projects/8067a8a77005444fb4e26dc5e9b19761` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:08.830949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20184722-53a3-470e-b0e6-10c8637b4e68 None admin] RBAC: Authorizing `identity:get_project(project_id=8067a8a77005444fb4e26dc5e9b19761)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:08.832465 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20184722-53a3-470e-b0e6-10c8637b4e68 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:08.838731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 213/440] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:25:08 2022] GET /identity/v3/projects/8067a8a77005444fb4e26dc5e9b19761 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:08.838731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41e5c7-5899-4b81-8d30-62f275d6bd02 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:08.838731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41e5c7-5899-4b81-8d30-62f275d6bd02 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:08.838731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41e5c7-5899-4b81-8d30-62f275d6bd02 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:08.838731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 214/441] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:08.839609 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41e5c7-5899-4b81-8d30-62f275d6bd02 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:08.848122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688475d3-3be6-477e-aa1f-c36a972f961e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:08.848517 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688475d3-3be6-477e-aa1f-c36a972f961e None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:08.848805 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688475d3-3be6-477e-aa1f-c36a972f961e None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:08.849683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688475d3-3be6-477e-aa1f-c36a972f961e None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:08.849851 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688475d3-3be6-477e-aa1f-c36a972f961e None admin] RBAC: Adding query filter params (name=member) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:08.850113 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688475d3-3be6-477e-aa1f-c36a972f961e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:08.851600 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688475d3-3be6-477e-aa1f-c36a972f961e None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:08.863002 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 228/442] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:25:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:08.864398 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4409837-29c0-4e20-9c0e-2978624abe34 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:08.864687 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4409837-29c0-4e20-9c0e-2978624abe34 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:08.864968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4409837-29c0-4e20-9c0e-2978624abe34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:08.889662 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-b4409837-29c0-4e20-9c0e-2978624abe34 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:08.890878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b4409837-29c0-4e20-9c0e-2978624abe34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:08.964241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 229/443] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:08.965355 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4409837-29c0-4e20-9c0e-2978624abe34 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:08.966741 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41e5c7-5899-4b81-8d30-62f275d6bd02 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:08.982553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:09.004880 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e8394-6670-472a-86b2-ae8834a11524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:09.005521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e8394-6670-472a-86b2-ae8834a11524 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:09.005801 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e8394-6670-472a-86b2-ae8834a11524 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:09.006075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e8394-6670-472a-86b2-ae8834a11524 None admin] PATH_INFO: `/v3/groups/f90ca112cd784eb7abd978140243adf2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:09.007342 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e8394-6670-472a-86b2-ae8834a11524 None admin] RBAC: Authorizing `identity:get_group(group_id=f90ca112cd784eb7abd978140243adf2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:09.008809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e8394-6670-472a-86b2-ae8834a11524 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:09.010391 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 215/444] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 18:25:08 2022] GET /identity/v3/groups/f90ca112cd784eb7abd978140243adf2 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:09.011309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e8394-6670-472a-86b2-ae8834a11524 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:09.022972 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:09.079052 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4409837-29c0-4e20-9c0e-2978624abe34 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:09.119526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8085f4-ea63-4aa3-a35f-5146b28974a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:09.120147 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8085f4-ea63-4aa3-a35f-5146b28974a2 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:09.120427 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8085f4-ea63-4aa3-a35f-5146b28974a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:09.120701 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8085f4-ea63-4aa3-a35f-5146b28974a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:09.120965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e8394-6670-472a-86b2-ae8834a11524 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:09.156176 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4f548-de29-408c-abe8-d1a087a783b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:09.156828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4f548-de29-408c-abe8-d1a087a783b9 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:09.157111 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4f548-de29-408c-abe8-d1a087a783b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:09.157425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4f548-de29-408c-abe8-d1a087a783b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:09.167996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4f548-de29-408c-abe8-d1a087a783b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:09.174004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-b7a4f548-de29-408c-abe8-d1a087a783b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:25:09.174004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:09.174004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:09.174004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:09.174004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:09.174004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:09.174004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:09.174004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:09.174004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:09.174004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:09.174004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:09.174004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:09.174004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:09.174004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:09.174004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:09.174004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:09.175089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:09.175089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:09.175089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:09.175089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:09.175089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:09.175089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:09.175089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:09.175089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:09.175089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:09.175089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:09.175089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:09.175089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:09.175089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:09.175089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:09.175089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:09.175089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:09.176174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:09.176174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:09.176174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:09.176174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:09.176174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:09.176174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:09.176174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:09.176174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:09.176174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:09.176174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:09.176174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:25:09.176174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:09.176174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 216/445] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:25:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:09.176174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4f548-de29-408c-abe8-d1a087a783b9 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:09.192393 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8085f4-ea63-4aa3-a35f-5146b28974a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:09.193842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8085f4-ea63-4aa3-a35f-5146b28974a2 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:09.210739 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:09.247423 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:09.282282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4f548-de29-408c-abe8-d1a087a783b9 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:09.292996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 230/446] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:25:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:25:09.293841 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8085f4-ea63-4aa3-a35f-5146b28974a2 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:09.318827 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6db68f-7994-4f83-9702-5625bc775712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:09.319481 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6db68f-7994-4f83-9702-5625bc775712 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:09.319762 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6db68f-7994-4f83-9702-5625bc775712 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:09.320033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6db68f-7994-4f83-9702-5625bc775712 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:09.320818 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6db68f-7994-4f83-9702-5625bc775712 None admin] RBAC: Adding query filter params (group.id=f90ca112cd784eb7abd978140243adf2, role.id=dd7069600e364802831ce7c375e57fcd, scope.project.id=8067a8a77005444fb4e26dc5e9b19761) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:09.321124 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6db68f-7994-4f83-9702-5625bc775712 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:09.322567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6db68f-7994-4f83-9702-5625bc775712 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:09.328491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 217/447] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 18:25:09 2022] GET /identity/v3/role_assignments?group.id=f90ca112cd784eb7abd978140243adf2&scope.project.id=8067a8a77005444fb4e26dc5e9b19761&role.id=dd7069600e364802831ce7c375e57fcd => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:09.329176 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6db68f-7994-4f83-9702-5625bc775712 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:09.413689 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8085f4-ea63-4aa3-a35f-5146b28974a2 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:09.433800 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:09.453815 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4a685-b074-4383-bd45-0f7bb06d10ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:09.455176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4a685-b074-4383-bd45-0f7bb06d10ac None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:09.455544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4a685-b074-4383-bd45-0f7bb06d10ac None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:09.455814 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4a685-b074-4383-bd45-0f7bb06d10ac None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:09.456567 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4a685-b074-4383-bd45-0f7bb06d10ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:09.456876 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4a685-b074-4383-bd45-0f7bb06d10ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:09.458620 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4a685-b074-4383-bd45-0f7bb06d10ac None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:09.464344 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6db68f-7994-4f83-9702-5625bc775712 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:09.473422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 231/448] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:25:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:09.474683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4a685-b074-4383-bd45-0f7bb06d10ac None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:09.501248 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:09.508540 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cc0ec-afca-4a15-a81c-e1840c66172e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:09.509198 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cc0ec-afca-4a15-a81c-e1840c66172e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:09.511481 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cc0ec-afca-4a15-a81c-e1840c66172e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:09.511481 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cc0ec-afca-4a15-a81c-e1840c66172e None admin] PATH_INFO: `/v3/projects/f9f866c53099419c8982f8720259b8bf` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:09.511481 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4cc0ec-afca-4a15-a81c-e1840c66172e None admin] RBAC: Authorizing `identity:get_project(project_id=f9f866c53099419c8982f8720259b8bf)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:09.512414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4cc0ec-afca-4a15-a81c-e1840c66172e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:09.514103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 218/449] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:25:09 2022] GET /identity/v3/projects/f9f866c53099419c8982f8720259b8bf => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:09.521019 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cc0ec-afca-4a15-a81c-e1840c66172e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:09.609817 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4a685-b074-4383-bd45-0f7bb06d10ac None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:09.645992 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cc0ec-afca-4a15-a81c-e1840c66172e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:09.655183 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d3597-361f-4436-bac7-39758322cfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:09.655847 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d3597-361f-4436-bac7-39758322cfe3 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:09.656130 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d3597-361f-4436-bac7-39758322cfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:09.656404 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d3597-361f-4436-bac7-39758322cfe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:09.687783 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c6b3d-99ea-43e4-864e-87cd2e2e0574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:09.688440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c6b3d-99ea-43e4-864e-87cd2e2e0574 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:09.688726 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c6b3d-99ea-43e4-864e-87cd2e2e0574 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:09.689037 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c6b3d-99ea-43e4-864e-87cd2e2e0574 None admin] PATH_INFO: `/v3/groups/f90ca112cd784eb7abd978140243adf2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:09.690232 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c6b3d-99ea-43e4-864e-87cd2e2e0574 None admin] RBAC: Authorizing `identity:get_group(group_id=f90ca112cd784eb7abd978140243adf2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:09.691813 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c6b3d-99ea-43e4-864e-87cd2e2e0574 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:09.693431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 219/450] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 18:25:09 2022] GET /identity/v3/groups/f90ca112cd784eb7abd978140243adf2 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:09.700275 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c6b3d-99ea-43e4-864e-87cd2e2e0574 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:09.711657 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:09.733413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d3597-361f-4436-bac7-39758322cfe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:09.735109 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d3597-361f-4436-bac7-39758322cfe3 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:09.768371 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:09.801537 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c6b3d-99ea-43e4-864e-87cd2e2e0574 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:09.836840 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 232/451] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:25:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:25:09.838216 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4390d-a996-40f4-bfe0-473da3d956c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:09.838967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4390d-a996-40f4-bfe0-473da3d956c6 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:09.839350 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4390d-a996-40f4-bfe0-473da3d956c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:09.839694 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4390d-a996-40f4-bfe0-473da3d956c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:09.840561 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4390d-a996-40f4-bfe0-473da3d956c6 None admin] RBAC: Adding query filter params (group.id=f90ca112cd784eb7abd978140243adf2, role.id=f105208a21c84d4fa134aa0aeb62f3bb, scope.project.id=f9f866c53099419c8982f8720259b8bf) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:09.840973 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4390d-a996-40f4-bfe0-473da3d956c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:09.842488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4390d-a996-40f4-bfe0-473da3d956c6 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:09.842596 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d3597-361f-4436-bac7-39758322cfe3 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:09.848698 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 220/452] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 18:25:09 2022] GET /identity/v3/role_assignments?group.id=f90ca112cd784eb7abd978140243adf2&scope.project.id=f9f866c53099419c8982f8720259b8bf&role.id=f105208a21c84d4fa134aa0aeb62f3bb => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:09.927274 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:09.949638 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d3597-361f-4436-bac7-39758322cfe3 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:09.988241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd9f34-9479-40e4-9ac3-efd0c0899183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:09.988895 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd9f34-9479-40e4-9ac3-efd0c0899183 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:09.989179 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd9f34-9479-40e4-9ac3-efd0c0899183 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:09.989459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd9f34-9479-40e4-9ac3-efd0c0899183 None admin] PATH_INFO: `/v3/projects/940bf108a6364eafb1a69efe7e124464` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:09.990670 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd9f34-9479-40e4-9ac3-efd0c0899183 None admin] RBAC: Authorizing `identity:get_project(project_id=940bf108a6364eafb1a69efe7e124464)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:09.992181 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd9f34-9479-40e4-9ac3-efd0c0899183 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:09.993880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 233/453] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:25:09 2022] GET /identity/v3/projects/940bf108a6364eafb1a69efe7e124464 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:09.999679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4390d-a996-40f4-bfe0-473da3d956c6 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:10.111904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4390d-a996-40f4-bfe0-473da3d956c6 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:10.146438 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:10.151523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4f75e-c130-4ed6-9798-0516b5e372b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:10.152180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4f75e-c130-4ed6-9798-0516b5e372b6 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:10.152468 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4f75e-c130-4ed6-9798-0516b5e372b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:10.158312 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4f75e-c130-4ed6-9798-0516b5e372b6 None admin] PATH_INFO: `/v3/groups/c565afc4ece7418e8404c07f56baf136` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:10.158312 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4f75e-c130-4ed6-9798-0516b5e372b6 None admin] RBAC: Authorizing `identity:get_group(group_id=c565afc4ece7418e8404c07f56baf136)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:10.158312 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4f75e-c130-4ed6-9798-0516b5e372b6 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:10.158312 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 221/454] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 18:25:09 2022] GET /identity/v3/groups/c565afc4ece7418e8404c07f56baf136 => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:10.164015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd9f34-9479-40e4-9ac3-efd0c0899183 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:10.269367 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd9f34-9479-40e4-9ac3-efd0c0899183 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:10.305377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06134e-d178-4a4e-bbe2-cc6de4550520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:10.306018 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06134e-d178-4a4e-bbe2-cc6de4550520 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:10.306305 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06134e-d178-4a4e-bbe2-cc6de4550520 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:10.306590 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06134e-d178-4a4e-bbe2-cc6de4550520 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:10.307437 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06134e-d178-4a4e-bbe2-cc6de4550520 None admin] RBAC: Adding query filter params (group.id=c565afc4ece7418e8404c07f56baf136, role.id=4ae8d11d74f14bcc80117d897ba2f5b6, scope.project.id=940bf108a6364eafb1a69efe7e124464) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:10.307836 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06134e-d178-4a4e-bbe2-cc6de4550520 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:10.309209 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06134e-d178-4a4e-bbe2-cc6de4550520 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:10.316286 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 234/455] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 18:25:10 2022] GET /identity/v3/role_assignments?group.id=c565afc4ece7418e8404c07f56baf136&scope.project.id=940bf108a6364eafb1a69efe7e124464&role.id=4ae8d11d74f14bcc80117d897ba2f5b6 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:12.907975 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e9925-5f34-499a-bb6b-8cfb26d4dc7d None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:12.908501 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e9925-5f34-499a-bb6b-8cfb26d4dc7d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:12.908578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e9925-5f34-499a-bb6b-8cfb26d4dc7d None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:12.910303 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 222/456] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:12.915483 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1643244-5f01-4807-8d6f-842146d83944 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:12.915899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1643244-5f01-4807-8d6f-842146d83944 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:12.916087 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1643244-5f01-4807-8d6f-842146d83944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:12.939885 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-f1643244-5f01-4807-8d6f-842146d83944 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:12.941110 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-f1643244-5f01-4807-8d6f-842146d83944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:12.944468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:13.034369 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 235/457] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:13.068337 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8bcec-7589-4473-a82b-54b750493bf0 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:13.068998 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8bcec-7589-4473-a82b-54b750493bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:13.069483 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8bcec-7589-4473-a82b-54b750493bf0 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:13.071359 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 223/458] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:13.074235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1643244-5f01-4807-8d6f-842146d83944 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:13.076895 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be15e9-a59c-4120-a952-475964efe152 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:13.077407 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be15e9-a59c-4120-a952-475964efe152 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:13.077885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be15e9-a59c-4120-a952-475964efe152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:13.107129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-81be15e9-a59c-4120-a952-475964efe152 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:13.108722 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-81be15e9-a59c-4120-a952-475964efe152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:13.202234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1643244-5f01-4807-8d6f-842146d83944 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:13.209907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 224/459] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:25:13.212027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17480005-85b8-4214-a18a-34403461af58 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:13.212331 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17480005-85b8-4214-a18a-34403461af58 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:13.212608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17480005-85b8-4214-a18a-34403461af58 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:13.214584 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 225/460] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:13.221603 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190e995-108b-45d8-9c17-655629f3c8e7 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:13.221931 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190e995-108b-45d8-9c17-655629f3c8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:13.224950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190e995-108b-45d8-9c17-655629f3c8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:13.254210 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-d190e995-108b-45d8-9c17-655629f3c8e7 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:13.255443 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d190e995-108b-45d8-9c17-655629f3c8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:13.257666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137d1a5-acdc-40e1-82e6-15bce609a2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:13.258554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137d1a5-acdc-40e1-82e6-15bce609a2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:13.259060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137d1a5-acdc-40e1-82e6-15bce609a2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:13.259633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137d1a5-acdc-40e1-82e6-15bce609a2f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:13.269532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:13.271749 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137d1a5-acdc-40e1-82e6-15bce609a2f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:13.273535 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137d1a5-acdc-40e1-82e6-15bce609a2f4 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:13.291524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-f137d1a5-acdc-40e1-82e6-15bce609a2f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:13.291524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:13.291524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:13.291524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:13.291524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:13.291524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:13.291524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:13.291524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:13.291524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:13.291524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:13.291524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:13.291524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:13.291524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:13.291524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:13.291524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:13.292560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:13.292560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:13.292560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:13.292560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:13.292560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:13.292560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:13.292560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:13.292560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:13.292560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:13.292560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:13.292560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:13.292560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:13.292560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:13.292560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:13.292560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:13.292560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:13.292560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:13.293415 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:13.293415 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:13.293415 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:13.293415 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:13.295729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 236/461] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:13.296806 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137d1a5-acdc-40e1-82e6-15bce609a2f4 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:13.350461 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 226/462] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:13.351953 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190e995-108b-45d8-9c17-655629f3c8e7 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:13.420757 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137d1a5-acdc-40e1-82e6-15bce609a2f4 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:13.426722 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:13.460230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d2418-ee46-454f-a4a4-e7431a4f5d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:13.461222 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d2418-ee46-454f-a4a4-e7431a4f5d97 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:13.461740 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d2418-ee46-454f-a4a4-e7431a4f5d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:13.462235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d2418-ee46-454f-a4a4-e7431a4f5d97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:13.475806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190e995-108b-45d8-9c17-655629f3c8e7 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:13.481240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d2418-ee46-454f-a4a4-e7431a4f5d97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:13.482849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d2418-ee46-454f-a4a4-e7431a4f5d97 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:13.503767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-454d2418-ee46-454f-a4a4-e7431a4f5d97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:13.503767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:13.503767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:13.503767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:13.503767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:13.503767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:13.503767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:13.503767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:13.503767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:13.503767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:13.503767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:13.503767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:13.503767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:13.503767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:13.503767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:13.504942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:13.504942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:13.504942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:13.504942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:13.504942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:13.504942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:13.504942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:13.504942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:13.504942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:13.504942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:13.504942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:13.504942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:13.504942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:13.504942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:13.504942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:13.504942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:13.504942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:13.505945 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:13.505945 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:13.505945 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:13.505945 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:13.510489 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 237/463] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:13.511862 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d2418-ee46-454f-a4a4-e7431a4f5d97 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:13.525041 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797a499-1ca9-4c38-8720-690dfac43991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:13.526349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797a499-1ca9-4c38-8720-690dfac43991 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:13.526783 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797a499-1ca9-4c38-8720-690dfac43991 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:13.527203 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797a499-1ca9-4c38-8720-690dfac43991 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:13.528439 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797a499-1ca9-4c38-8720-690dfac43991 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:13.528892 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797a499-1ca9-4c38-8720-690dfac43991 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:13.531065 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797a499-1ca9-4c38-8720-690dfac43991 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:13.549810 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 227/464] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:13.554569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797a499-1ca9-4c38-8720-690dfac43991 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:13.584327 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:13.640390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d2418-ee46-454f-a4a4-e7431a4f5d97 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:13.661440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797a499-1ca9-4c38-8720-690dfac43991 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:13.679255 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ede85-3874-43ec-a889-5db2f380214f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:13.679930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ede85-3874-43ec-a889-5db2f380214f None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:13.680216 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ede85-3874-43ec-a889-5db2f380214f None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:13.680495 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ede85-3874-43ec-a889-5db2f380214f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:13.681614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:13.692839 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ede85-3874-43ec-a889-5db2f380214f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:13.694220 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ede85-3874-43ec-a889-5db2f380214f None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:13.696485 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b233aa3-8830-470c-adbd-6d858727612d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:13.697119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b233aa3-8830-470c-adbd-6d858727612d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:13.697403 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b233aa3-8830-470c-adbd-6d858727612d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:13.697683 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b233aa3-8830-470c-adbd-6d858727612d None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:13.698383 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b233aa3-8830-470c-adbd-6d858727612d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:13.698695 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b233aa3-8830-470c-adbd-6d858727612d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:13.700095 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b233aa3-8830-470c-adbd-6d858727612d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:13.711379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-6b1ede85-3874-43ec-a889-5db2f380214f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:13.711379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:13.711379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:13.711379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:13.711379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:13.711379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:13.711379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:13.711379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:13.711379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:13.711379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:13.711379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:13.711379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:13.711379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:13.711379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:13.711379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:13.712260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:13.712260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:13.712260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:13.712260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:13.712260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:13.712260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:13.712260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:13.712260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:13.712260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:13.712260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:13.712260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:13.712260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:13.712260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:13.712260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:13.712260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:13.712260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:13.712260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:13.713168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:13.713168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:13.713168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:13.713168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:13.713168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 238/465] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:13.713447 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ede85-3874-43ec-a889-5db2f380214f None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:13.715619 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 228/466] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:13.716852 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f056779-7138-4980-8f22-18ec8772c017 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:13.717292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f056779-7138-4980-8f22-18ec8772c017 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:13.717715 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f056779-7138-4980-8f22-18ec8772c017 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:13.724015 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 229/467] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:13.725044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f056779-7138-4980-8f22-18ec8772c017 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:13.817336 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:13.824661 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ede85-3874-43ec-a889-5db2f380214f None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:13.839684 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f056779-7138-4980-8f22-18ec8772c017 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:13.861451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce825cc-23ca-4310-b8db-0c35d3a909fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:13.862500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce825cc-23ca-4310-b8db-0c35d3a909fc None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:13.862861 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce825cc-23ca-4310-b8db-0c35d3a909fc None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:13.863148 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce825cc-23ca-4310-b8db-0c35d3a909fc None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:13.864029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce825cc-23ca-4310-b8db-0c35d3a909fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:13.865495 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce825cc-23ca-4310-b8db-0c35d3a909fc None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:13.876616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b21ec9-5aff-49ac-be4a-52a73a3276fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:13.877247 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b21ec9-5aff-49ac-be4a-52a73a3276fe None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:13.877534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b21ec9-5aff-49ac-be4a-52a73a3276fe None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:13.877807 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b21ec9-5aff-49ac-be4a-52a73a3276fe None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:13.878517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b21ec9-5aff-49ac-be4a-52a73a3276fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:13.879970 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b21ec9-5aff-49ac-be4a-52a73a3276fe None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:13.971359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 239/468] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 18:25:13 2022] POST /identity/v3/users => generated 246 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:13.972113 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce825cc-23ca-4310-b8db-0c35d3a909fc None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:13.994520 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 230/469] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 18:25:13 2022] POST /identity/v3/users => generated 248 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:13.996210 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad3b2a-cddc-427e-a3ee-350581acf6e3 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:13.996210 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad3b2a-cddc-427e-a3ee-350581acf6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:13.996831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad3b2a-cddc-427e-a3ee-350581acf6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:14.017757 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-77ad3b2a-cddc-427e-a3ee-350581acf6e3 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:14.018936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-77ad3b2a-cddc-427e-a3ee-350581acf6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:14.063323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:14.101143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce825cc-23ca-4310-b8db-0c35d3a909fc None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:14.119905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 231/470] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:14.144513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad3b2a-cddc-427e-a3ee-350581acf6e3 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:14.149328 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1cfa7-4154-4108-9e8c-372be856b8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:14.150287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1cfa7-4154-4108-9e8c-372be856b8fe None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:14.150757 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1cfa7-4154-4108-9e8c-372be856b8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:14.151245 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1cfa7-4154-4108-9e8c-372be856b8fe None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:14.152179 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1cfa7-4154-4108-9e8c-372be856b8fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:14.152673 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1cfa7-4154-4108-9e8c-372be856b8fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:14.154490 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1cfa7-4154-4108-9e8c-372be856b8fe None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:14.179741 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 240/471] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:14.181621 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d4326-29d0-424f-b45f-986033f14193 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:14.182209 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d4326-29d0-424f-b45f-986033f14193 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:14.182664 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d4326-29d0-424f-b45f-986033f14193 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:14.184643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 241/472] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:14.185806 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d4326-29d0-424f-b45f-986033f14193 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:14.205495 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:14.285659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad3b2a-cddc-427e-a3ee-350581acf6e3 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:14.320541 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d4326-29d0-424f-b45f-986033f14193 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:14.327682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738aa41-e8e5-4865-ad60-5367600f0643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:14.328339 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738aa41-e8e5-4865-ad60-5367600f0643 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:14.328621 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738aa41-e8e5-4865-ad60-5367600f0643 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:14.328896 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738aa41-e8e5-4865-ad60-5367600f0643 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:14.341374 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738aa41-e8e5-4865-ad60-5367600f0643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:14.343095 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738aa41-e8e5-4865-ad60-5367600f0643 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:14.360435 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-5738aa41-e8e5-4865-ad60-5367600f0643 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:14.360435 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:14.360435 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:14.360435 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:14.360435 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:14.360435 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:14.360435 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:14.360435 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:14.360435 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:14.360435 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:14.360435 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:14.360435 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:14.360435 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:14.360435 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:14.360435 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:14.362254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:14.362254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:14.362254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:14.362254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:14.362254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:14.362254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:14.362254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:14.362254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:14.362254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:14.362254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:14.362254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:14.362254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:14.362254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:14.362254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:14.362254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:14.362254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:14.362254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:14.363323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:14.363323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:14.363323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:14.363323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:14.363323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 232/473] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:14.363728 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ad48c-e322-487e-8988-cc0db69b0c8b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:14.364030 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ad48c-e322-487e-8988-cc0db69b0c8b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:14.364308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ad48c-e322-487e-8988-cc0db69b0c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:14.384788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971c8c5-af35-4414-9a31-a2cc4d1e1c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:14.385732 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971c8c5-af35-4414-9a31-a2cc4d1e1c80 None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:14.386019 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971c8c5-af35-4414-9a31-a2cc4d1e1c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:14.386300 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971c8c5-af35-4414-9a31-a2cc4d1e1c80 None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:14.387007 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971c8c5-af35-4414-9a31-a2cc4d1e1c80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:14.388684 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971c8c5-af35-4414-9a31-a2cc4d1e1c80 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:14.389098 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-6f9ad48c-e322-487e-8988-cc0db69b0c8b None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:14.390300 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6f9ad48c-e322-487e-8988-cc0db69b0c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:14.409936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:14.473427 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 233/474] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:14.474298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ad48c-e322-487e-8988-cc0db69b0c8b None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:14.563300 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 242/475] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 18:25:14 2022] POST /identity/v3/users => generated 248 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:14.565847 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971c8c5-af35-4414-9a31-a2cc4d1e1c80 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:14.617676 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ad48c-e322-487e-8988-cc0db69b0c8b None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:14.666365 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399bb32-e38f-4078-98d1-3248c5f93e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:14.667013 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399bb32-e38f-4078-98d1-3248c5f93e27 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:14.667478 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399bb32-e38f-4078-98d1-3248c5f93e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:14.667891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399bb32-e38f-4078-98d1-3248c5f93e27 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:14.668619 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399bb32-e38f-4078-98d1-3248c5f93e27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:14.668933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399bb32-e38f-4078-98d1-3248c5f93e27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:14.674051 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399bb32-e38f-4078-98d1-3248c5f93e27 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:14.686513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 234/476] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:14.699638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399bb32-e38f-4078-98d1-3248c5f93e27 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:14.727705 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:14.730616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:14.830401 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971c8c5-af35-4414-9a31-a2cc4d1e1c80 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:14.830824 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399bb32-e38f-4078-98d1-3248c5f93e27 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:14.871379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408ec41-fc8e-4a28-8667-df90451d5daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:14.872114 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d679490-9193-490b-9d71-13baff39cda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:14.872624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408ec41-fc8e-4a28-8667-df90451d5daa None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:14.872729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d679490-9193-490b-9d71-13baff39cda1 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:14.873013 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d679490-9193-490b-9d71-13baff39cda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:14.873293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d679490-9193-490b-9d71-13baff39cda1 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:14.873656 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408ec41-fc8e-4a28-8667-df90451d5daa None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:14.873986 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d679490-9193-490b-9d71-13baff39cda1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:14.874313 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408ec41-fc8e-4a28-8667-df90451d5daa None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:14.875542 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408ec41-fc8e-4a28-8667-df90451d5daa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:14.875742 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d679490-9193-490b-9d71-13baff39cda1 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:14.877657 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408ec41-fc8e-4a28-8667-df90451d5daa None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:14.925394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.sql.core [None req-c408ec41-fc8e-4a28-8667-df90451d5daa None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 18:25:14.925394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 27 18:25:14.925394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [parameters: {'id': '36dbc9e7076b4083ae32f7a4d139886c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 27 18:25:14.925394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80429) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 18:25:14.944537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-c408ec41-fc8e-4a28-8667-df90451d5daa None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 27 18:25:14.944537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:14.944537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 18:25:14.944537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 18:25:14.944537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 18:25:14.944537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 18:25:14.944537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 18:25:14.944537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 18:25:14.944537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 18:25:14.944537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application conn.query(q) Jul 27 18:25:14.944537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 18:25:14.944537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 18:25:14.944537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 18:25:14.944537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application result.read() Jul 27 18:25:14.944537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 18:25:14.946456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 18:25:14.946456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 18:25:14.946456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 18:25:14.946456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 18:25:14.946456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 18:25:14.946456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 18:25:14.946456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 18:25:14.946456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 18:25:14.946456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:14.946456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 18:25:14.946456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:14.946456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:14.946456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 18:25:14.946456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 18:25:14.946456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 27 18:25:14.946456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return ref.to_dict() Jul 27 18:25:14.946456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 18:25:14.946456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application next(self.gen) Jul 27 18:25:14.948574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 18:25:14.948574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application yield resource Jul 27 18:25:14.948574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 18:25:14.948574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application next(self.gen) Jul 27 18:25:14.948574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 18:25:14.948574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 18:25:14.948574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 18:25:14.948574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 18:25:14.948574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 18:25:14.948574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise self.value Jul 27 18:25:14.948574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 18:25:14.948574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 18:25:14.948574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 18:25:14.948574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application session.commit() Jul 27 18:25:14.948574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 18:25:14.948574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 18:25:14.948574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 18:25:14.950025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 18:25:14.950025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 18:25:14.950025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self.session.flush() Jul 27 18:25:14.950025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 18:25:14.950025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 18:25:14.950025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 18:25:14.950025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 18:25:14.950025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 18:25:14.950025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application compat.raise_( Jul 27 18:25:14.950025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 18:25:14.950025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception Jul 27 18:25:14.950025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 18:25:14.950025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 18:25:14.950025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 18:25:14.950025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 18:25:14.950025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 18:25:14.950025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 18:25:14.951516 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 18:25:14.951516 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 18:25:14.951516 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 18:25:14.951516 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 18:25:14.951516 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 18:25:14.951516 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 18:25:14.951516 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 18:25:14.951516 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 18:25:14.951516 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 18:25:14.951516 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 18:25:14.951516 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 18:25:14.951516 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 18:25:14.951516 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 18:25:14.951516 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 18:25:14.951516 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 18:25:14.951516 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception Jul 27 18:25:14.954010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 18:25:14.954010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 18:25:14.954010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 18:25:14.954010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 18:25:14.954010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 18:25:14.954010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 18:25:14.954010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 18:25:14.954010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application conn.query(q) Jul 27 18:25:14.954010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 18:25:14.954010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 18:25:14.954010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 18:25:14.954010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application result.read() Jul 27 18:25:14.954010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 18:25:14.954010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 18:25:14.954010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 18:25:14.954010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 18:25:14.957100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 18:25:14.957100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 18:25:14.957100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 18:25:14.957100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 18:25:14.957100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 18:25:14.957100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 27 18:25:14.957100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [parameters: {'id': '36dbc9e7076b4083ae32f7a4d139886c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 27 18:25:14.957100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 18:25:14.957100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:14.957100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:25:14.957100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:14.957100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:14.957100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:14.957100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:14.957100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:14.957100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:14.961845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:14.961845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:14.961845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:14.961845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:14.961845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:14.961845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:14.961845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 27 18:25:14.961845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 27 18:25:14.961845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:14.961845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:14.961845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 27 18:25:14.961845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 27 18:25:14.961845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 18:25:14.961845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 18:25:14.961845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 27 18:25:14.961845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:14.964685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 243/477] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Jul 27 18:25:14 2022] POST /identity/v3/roles => generated 144 bytes in 381 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:14.964685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408ec41-fc8e-4a28-8667-df90451d5daa None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:15.006648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 235/478] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 18:25:14 2022] POST /identity/v3/users => generated 249 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:15.093010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408ec41-fc8e-4a28-8667-df90451d5daa None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:15.128336 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:15.134579 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d44ff-d53c-470b-9d58-47b6fa5e3b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:15.135588 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d44ff-d53c-470b-9d58-47b6fa5e3b28 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:15.136050 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d44ff-d53c-470b-9d58-47b6fa5e3b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:15.142556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d44ff-d53c-470b-9d58-47b6fa5e3b28 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:15.148558 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d44ff-d53c-470b-9d58-47b6fa5e3b28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:15.153509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-a61d44ff-d53c-470b-9d58-47b6fa5e3b28 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:25:15.153509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:15.153509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:15.153509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:15.153509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:15.153509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:15.153509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:15.153509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:15.153509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:15.153509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:15.153509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:15.153509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:15.153509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:15.153509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:15.153509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:15.153509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:15.154430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:15.154430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:15.154430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:15.154430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:15.154430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:15.154430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:15.154430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:15.154430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:15.154430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:15.154430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:15.154430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:15.154430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:15.154430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:15.154430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:15.154430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:15.154430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:15.155285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:15.155285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:15.155285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:15.155285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:15.155285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:15.155285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:15.155285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:15.155285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:15.155285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:15.155285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:15.155285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:25:15.155285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:15.155285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 244/479] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 18:25:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:25:15.161451 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d679490-9193-490b-9d71-13baff39cda1 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:15.231300 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:15.296108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d679490-9193-490b-9d71-13baff39cda1 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:15.341552 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47abb6-2d2d-4053-ba95-7f1e7779191a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:15.342497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47abb6-2d2d-4053-ba95-7f1e7779191a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:15.342922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47abb6-2d2d-4053-ba95-7f1e7779191a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:15.343447 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47abb6-2d2d-4053-ba95-7f1e7779191a None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:15.344559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47abb6-2d2d-4053-ba95-7f1e7779191a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:15.345571 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47abb6-2d2d-4053-ba95-7f1e7779191a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:15.347926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47abb6-2d2d-4053-ba95-7f1e7779191a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:15.362633 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 236/480] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:16.419020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bf7fb-85cb-4128-9fb4-1bad36780954 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:16.419613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bf7fb-85cb-4128-9fb4-1bad36780954 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:16.419613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bf7fb-85cb-4128-9fb4-1bad36780954 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:16.421295 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 245/481] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:16.436810 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aba2a0-45d3-470d-b489-241f4b73ec75 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:16.437298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aba2a0-45d3-470d-b489-241f4b73ec75 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:16.437372 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aba2a0-45d3-470d-b489-241f4b73ec75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:16.468304 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-95aba2a0-45d3-470d-b489-241f4b73ec75 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:16.469523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-95aba2a0-45d3-470d-b489-241f4b73ec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:16.563129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 237/482] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:16.598598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bf7fb-85cb-4128-9fb4-1bad36780954 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:16.778017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bf7fb-85cb-4128-9fb4-1bad36780954 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:16.827199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c75177-352e-4e6f-b927-9e4311ee7aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:16.828256 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c75177-352e-4e6f-b927-9e4311ee7aff None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:16.828760 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c75177-352e-4e6f-b927-9e4311ee7aff None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:16.829355 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c75177-352e-4e6f-b927-9e4311ee7aff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:16.848226 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c75177-352e-4e6f-b927-9e4311ee7aff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:16.853577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-07c75177-352e-4e6f-b927-9e4311ee7aff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:16.853577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:16.853577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:16.853577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:16.853577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:16.853577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:16.853577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:16.853577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:16.853577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:16.853577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:16.853577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:16.853577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:16.853577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:16.853577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:16.853577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:16.853577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:16.854476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:16.854476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:16.854476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:16.854476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:16.854476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:16.854476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:16.854476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:16.854476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:16.854476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:16.854476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:16.854476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:16.854476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:16.854476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:16.854476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:16.854476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:16.854476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:16.855395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:16.855395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:16.855395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:16.855395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:16.855395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:16.855395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:16.855395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:16.855395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:16.855395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:16.855395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:16.855395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:16.855395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:16.856974 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a3c64-c85f-4f11-85c1-0df791826cb9 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:16.857358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a3c64-c85f-4f11-85c1-0df791826cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:16.857727 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a3c64-c85f-4f11-85c1-0df791826cb9 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:16.858070 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 246/483] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:25:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:16.863399 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 238/484] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:16.864822 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c75177-352e-4e6f-b927-9e4311ee7aff None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:16.868817 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92501fd-f51e-4024-a5b2-f8f26e72e722 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:16.869108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92501fd-f51e-4024-a5b2-f8f26e72e722 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:16.869389 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92501fd-f51e-4024-a5b2-f8f26e72e722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:16.898623 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-d92501fd-f51e-4024-a5b2-f8f26e72e722 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:16.901607 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d92501fd-f51e-4024-a5b2-f8f26e72e722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:16.965750 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:16.998492 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:17.025079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c75177-352e-4e6f-b927-9e4311ee7aff None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:17.041914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 239/485] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:17.073759 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7d1f2-14fd-472d-85c0-a77f4d22ae02 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:17.074373 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7d1f2-14fd-472d-85c0-a77f4d22ae02 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:17.074925 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7d1f2-14fd-472d-85c0-a77f4d22ae02 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:17.077852 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 240/486] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:25:17.079735 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7d1f2-14fd-472d-85c0-a77f4d22ae02 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:17.081472 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9e6e4-1f67-4a32-8898-8c1d637f658e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:17.082130 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9e6e4-1f67-4a32-8898-8c1d637f658e None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:17.082419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9e6e4-1f67-4a32-8898-8c1d637f658e None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:17.082700 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9e6e4-1f67-4a32-8898-8c1d637f658e None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:17.083518 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9e6e4-1f67-4a32-8898-8c1d637f658e None admin] RBAC: Adding query filter params (name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:17.083828 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9e6e4-1f67-4a32-8898-8c1d637f658e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:17.085280 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9e6e4-1f67-4a32-8898-8c1d637f658e None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:17.094636 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 247/487] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 18:25:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:17.096548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d97355-02d1-4e8b-8018-cc8142cda446 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:17.096839 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d97355-02d1-4e8b-8018-cc8142cda446 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:17.097120 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d97355-02d1-4e8b-8018-cc8142cda446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:17.115997 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-06d97355-02d1-4e8b-8018-cc8142cda446 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:17.117217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-06d97355-02d1-4e8b-8018-cc8142cda446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:17.199284 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 248/488] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:17.199284 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d97355-02d1-4e8b-8018-cc8142cda446 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:17.246535 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:17.248571 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7d1f2-14fd-472d-85c0-a77f4d22ae02 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:17.295148 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6257221-d3bf-4dd7-8031-b29853d30024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:17.296050 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6257221-d3bf-4dd7-8031-b29853d30024 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:17.296719 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6257221-d3bf-4dd7-8031-b29853d30024 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:17.297536 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6257221-d3bf-4dd7-8031-b29853d30024 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:17.315360 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d97355-02d1-4e8b-8018-cc8142cda446 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:17.316504 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6257221-d3bf-4dd7-8031-b29853d30024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:17.322922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-a6257221-d3bf-4dd7-8031-b29853d30024 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:17.322922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:17.322922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:17.322922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:17.322922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:17.322922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:17.322922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:17.322922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:17.322922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:17.322922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:17.322922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:17.322922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:17.322922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:17.322922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:17.322922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:17.322922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:17.324082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:17.324082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:17.324082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:17.324082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:17.324082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:17.324082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:17.324082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:17.324082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:17.324082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:17.324082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:17.324082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:17.324082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:17.324082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:17.324082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:17.324082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:17.324082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:17.325085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:17.325085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:17.325085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:17.325085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:17.325085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:17.325085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:17.325085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:17.325085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:17.325085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:17.325085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:17.325085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:17.325085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:17.327655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 241/489] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:25:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:17.334338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6257221-d3bf-4dd7-8031-b29853d30024 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:17.364204 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe50c94-d589-475f-9fc5-6ea2aace02a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:17.365105 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe50c94-d589-475f-9fc5-6ea2aace02a0 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:17.365814 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe50c94-d589-475f-9fc5-6ea2aace02a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:17.366240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe50c94-d589-475f-9fc5-6ea2aace02a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:17.381678 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe50c94-d589-475f-9fc5-6ea2aace02a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:17.383920 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe50c94-d589-475f-9fc5-6ea2aace02a0 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:17.391356 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:17.415015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-dbe50c94-d589-475f-9fc5-6ea2aace02a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:17.415015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:17.415015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:17.415015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:17.415015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:17.415015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:17.415015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:17.415015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:17.415015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:17.415015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:17.415015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:17.415015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:17.415015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:17.415015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:17.415015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:17.416124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:17.416124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:17.416124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:17.416124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:17.416124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:17.416124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:17.416124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:17.416124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:17.416124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:17.416124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:17.416124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:17.416124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:17.416124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:17.416124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:17.416124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:17.416124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:17.416124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:17.417161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:17.417161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:17.417161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:17.417161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:17.419809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 249/490] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:17.421615 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe50c94-d589-475f-9fc5-6ea2aace02a0 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:17.481859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6257221-d3bf-4dd7-8031-b29853d30024 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:17.528323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81174c-108a-46c1-a7e3-bb86919760ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:17.529159 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81174c-108a-46c1-a7e3-bb86919760ac None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:17.529577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81174c-108a-46c1-a7e3-bb86919760ac None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:17.529968 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81174c-108a-46c1-a7e3-bb86919760ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:17.544929 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81174c-108a-46c1-a7e3-bb86919760ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:17.552189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-3f81174c-108a-46c1-a7e3-bb86919760ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:17.552189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:17.552189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:17.552189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:17.552189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:17.552189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:17.552189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:17.552189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:17.552189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:17.552189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:17.552189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:17.552189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:17.552189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:17.552189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:17.552189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:17.552189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:17.553202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:17.553202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:17.553202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:17.553202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:17.553202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:17.553202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:17.553202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:17.553202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:17.553202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:17.553202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:17.553202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:17.553202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:17.553202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:17.553202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:17.553202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:17.553202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:17.554129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:17.554129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:17.554129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:17.554129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:17.554129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:17.554129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:17.554129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:17.554129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:17.554129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:17.554129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:17.554129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:17.554129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:17.554960 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 242/491] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:25:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:17.556046 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81174c-108a-46c1-a7e3-bb86919760ac None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:17.562031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:17.569984 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe50c94-d589-475f-9fc5-6ea2aace02a0 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:17.622984 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbefd45-1bdb-4ee3-8c77-1785efc9852e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:17.624423 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbefd45-1bdb-4ee3-8c77-1785efc9852e None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:17.625155 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbefd45-1bdb-4ee3-8c77-1785efc9852e None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:17.625636 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbefd45-1bdb-4ee3-8c77-1785efc9852e None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:17.627125 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbefd45-1bdb-4ee3-8c77-1785efc9852e None admin] RBAC: Adding query filter params (name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:17.628267 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbefd45-1bdb-4ee3-8c77-1785efc9852e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:17.630200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbefd45-1bdb-4ee3-8c77-1785efc9852e None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:17.642838 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 250/492] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 18:25:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:17.643782 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbefd45-1bdb-4ee3-8c77-1785efc9852e None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:17.687491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81174c-108a-46c1-a7e3-bb86919760ac None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:17.696538 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:17.728860 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007717f-9928-4e17-8f28-afd7813cd86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:17.729878 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007717f-9928-4e17-8f28-afd7813cd86c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:17.730397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007717f-9928-4e17-8f28-afd7813cd86c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:17.731078 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007717f-9928-4e17-8f28-afd7813cd86c None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:17.732135 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007717f-9928-4e17-8f28-afd7813cd86c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:17.732671 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007717f-9928-4e17-8f28-afd7813cd86c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:17.734566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007717f-9928-4e17-8f28-afd7813cd86c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:17.753405 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbefd45-1bdb-4ee3-8c77-1785efc9852e None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:17.754046 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 243/493] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:17.755459 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007717f-9928-4e17-8f28-afd7813cd86c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:17.792946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ffd68-c743-4ca4-9b30-a230b30d9928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:17.793574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ffd68-c743-4ca4-9b30-a230b30d9928 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:17.793861 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ffd68-c743-4ca4-9b30-a230b30d9928 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:17.794141 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ffd68-c743-4ca4-9b30-a230b30d9928 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:17.794871 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ffd68-c743-4ca4-9b30-a230b30d9928 None admin] RBAC: Adding query filter params (name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:17.795181 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ffd68-c743-4ca4-9b30-a230b30d9928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:17.796856 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ffd68-c743-4ca4-9b30-a230b30d9928 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:17.811050 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 251/494] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 18:25:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:17.811841 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ffd68-c743-4ca4-9b30-a230b30d9928 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:17.838467 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:17.877916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007717f-9928-4e17-8f28-afd7813cd86c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:17.916298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad91857-315c-4def-986d-741ff4baa17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:17.916950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad91857-315c-4def-986d-741ff4baa17b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:17.917237 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad91857-315c-4def-986d-741ff4baa17b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:17.917516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad91857-315c-4def-986d-741ff4baa17b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:17.925982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ffd68-c743-4ca4-9b30-a230b30d9928 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:17.929355 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad91857-315c-4def-986d-741ff4baa17b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:17.930501 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad91857-315c-4def-986d-741ff4baa17b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:17.946008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-8ad91857-315c-4def-986d-741ff4baa17b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:17.946008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:17.946008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:17.946008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:17.946008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:17.946008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:17.946008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:17.946008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:17.946008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:17.946008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:17.946008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:17.946008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:17.946008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:17.946008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:17.946008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:17.946908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:17.946908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:17.946908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:17.946908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:17.946908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:17.946908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:17.946908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:17.946908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:17.946908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:17.946908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:17.946908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:17.946908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:17.946908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:17.946908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:17.946908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:17.946908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:17.946908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:17.947911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:17.947911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:17.947911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:17.947911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:17.947911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 244/495] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:17.949140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46569f63-9541-42b0-9205-647bee85a3ce None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:17.949140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46569f63-9541-42b0-9205-647bee85a3ce None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:17.949140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46569f63-9541-42b0-9205-647bee85a3ce None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:17.954753 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 245/496] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:17.954753 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46569f63-9541-42b0-9205-647bee85a3ce None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:17.971147 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7710a-c0d4-4dc8-9a1f-545b7f2a6b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:17.971839 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7710a-c0d4-4dc8-9a1f-545b7f2a6b7e None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:17.972125 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7710a-c0d4-4dc8-9a1f-545b7f2a6b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:17.972400 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7710a-c0d4-4dc8-9a1f-545b7f2a6b7e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:17.977241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:17.979904 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7710a-c0d4-4dc8-9a1f-545b7f2a6b7e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:17.981414 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7710a-c0d4-4dc8-9a1f-545b7f2a6b7e None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:17.995383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-1ce7710a-c0d4-4dc8-9a1f-545b7f2a6b7e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:25:17.995383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:17.995383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:17.995383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:17.995383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:17.995383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:17.995383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:17.995383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:17.995383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:17.995383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:17.995383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:17.995383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:17.995383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:17.995383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:17.995383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:17.995383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:18.002532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:18.002532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:18.002532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:18.002532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:18.002532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:18.002532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:18.002532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:18.002532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:18.002532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:18.002532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:18.002532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:18.002532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:18.002532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:18.002532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:18.002532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:18.002532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:18.002532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:18.002532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:18.003481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:18.003481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:18.003481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:18.003481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:18.003481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:18.003481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:18.003481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:18.003481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:18.003481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:25:18.003481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:18.003481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 252/497] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:25:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:18.003481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7710a-c0d4-4dc8-9a1f-545b7f2a6b7e None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:18.080307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46569f63-9541-42b0-9205-647bee85a3ce None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:18.088126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:18.107139 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7710a-c0d4-4dc8-9a1f-545b7f2a6b7e None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:18.114970 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489f388-b919-4957-adac-124c769873f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:18.115719 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489f388-b919-4957-adac-124c769873f3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.116041 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489f388-b919-4957-adac-124c769873f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.116205 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489f388-b919-4957-adac-124c769873f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.127712 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489f388-b919-4957-adac-124c769873f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:18.129173 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489f388-b919-4957-adac-124c769873f3 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:18.142660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5cda4-adf1-4da0-89dd-9aa348a82b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:18.143303 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5cda4-adf1-4da0-89dd-9aa348a82b28 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.143593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5cda4-adf1-4da0-89dd-9aa348a82b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.143873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5cda4-adf1-4da0-89dd-9aa348a82b28 None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.144133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-5489f388-b919-4957-adac-124c769873f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:18.144133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:18.144133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:18.144133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:18.144133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:18.144133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:18.144133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:18.144133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:18.144133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:18.144133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:18.144133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:18.144133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:18.144133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:18.144133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:18.144133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:18.144950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:18.144950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:18.144950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:18.144950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:18.144950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:18.144950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:18.144950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:18.144950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:18.144950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:18.144950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:18.144950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:18.144950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:18.144950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:18.144950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:18.144950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:18.144950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:18.144950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:18.145806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:18.145806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:18.145806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:18.145806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:18.146014 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5cda4-adf1-4da0-89dd-9aa348a82b28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:18.146014 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5cda4-adf1-4da0-89dd-9aa348a82b28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:18.146145 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 246/498] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:18.146558 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5cda4-adf1-4da0-89dd-9aa348a82b28 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:18.146652 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e8b3e-1d94-40cc-802c-13cf8d662768 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.146721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e8b3e-1d94-40cc-802c-13cf8d662768 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.146938 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e8b3e-1d94-40cc-802c-13cf8d662768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.158113 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 253/499] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:18.158976 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5cda4-adf1-4da0-89dd-9aa348a82b28 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:18.165979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-888e8b3e-1d94-40cc-802c-13cf8d662768 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:18.167176 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-888e8b3e-1d94-40cc-802c-13cf8d662768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:18.231283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:18.235897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 247/500] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:18.237143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230bd3f-51b1-45da-980b-3aecb45b9f73 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.237501 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230bd3f-51b1-45da-980b-3aecb45b9f73 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.237762 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230bd3f-51b1-45da-980b-3aecb45b9f73 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.239582 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 248/501] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:18.239809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230bd3f-51b1-45da-980b-3aecb45b9f73 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:18.269656 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5cda4-adf1-4da0-89dd-9aa348a82b28 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:18.302872 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976f576-4634-485f-a163-b11c20d84530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:18.303520 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976f576-4634-485f-a163-b11c20d84530 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.303810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976f576-4634-485f-a163-b11c20d84530 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.304091 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976f576-4634-485f-a163-b11c20d84530 None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.304894 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976f576-4634-485f-a163-b11c20d84530 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:18.305212 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976f576-4634-485f-a163-b11c20d84530 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:18.306662 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976f576-4634-485f-a163-b11c20d84530 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:18.332748 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:18.344237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 254/502] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Jul 27 18:25:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:18.345515 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976f576-4634-485f-a163-b11c20d84530 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:18.353244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230bd3f-51b1-45da-980b-3aecb45b9f73 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:18.388959 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87347fb2-3f42-4430-84c8-6de2fe2e09a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:18.389702 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87347fb2-3f42-4430-84c8-6de2fe2e09a4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.389991 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87347fb2-3f42-4430-84c8-6de2fe2e09a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.390261 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87347fb2-3f42-4430-84c8-6de2fe2e09a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.390958 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87347fb2-3f42-4430-84c8-6de2fe2e09a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:18.391289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87347fb2-3f42-4430-84c8-6de2fe2e09a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:18.393447 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87347fb2-3f42-4430-84c8-6de2fe2e09a4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:18.406934 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 249/503] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:18.408422 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574ed54-79f5-464c-8856-3736ecd2e9db None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.408710 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574ed54-79f5-464c-8856-3736ecd2e9db None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.408982 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574ed54-79f5-464c-8856-3736ecd2e9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.427886 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-6574ed54-79f5-464c-8856-3736ecd2e9db None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:18.429115 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6574ed54-79f5-464c-8856-3736ecd2e9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:18.451663 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976f576-4634-485f-a163-b11c20d84530 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:18.487786 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f17add-2440-4487-8bff-b5717dd0f45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:18.487992 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:18.488415 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f17add-2440-4487-8bff-b5717dd0f45f None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.488723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f17add-2440-4487-8bff-b5717dd0f45f None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.488993 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f17add-2440-4487-8bff-b5717dd0f45f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.496369 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f17add-2440-4487-8bff-b5717dd0f45f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:18.497839 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f17add-2440-4487-8bff-b5717dd0f45f None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:18.498927 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 250/504] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:18.499733 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574ed54-79f5-464c-8856-3736ecd2e9db None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:18.511302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-73f17add-2440-4487-8bff-b5717dd0f45f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:25:18.511302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:18.511302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:18.511302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:18.511302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:18.511302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:18.511302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:18.511302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:18.511302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:18.511302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:18.511302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:18.511302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:18.511302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:18.511302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:18.511302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:18.511302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:18.512230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:18.512230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:18.512230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:18.512230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:18.512230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:18.512230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:18.512230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:18.512230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:18.512230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:18.512230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:18.512230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:18.512230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:18.512230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:18.512230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:18.512230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:18.512230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:18.512230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:18.512230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:18.513218 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:18.513218 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:18.513218 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:18.513218 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:18.513218 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:18.513218 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:18.513218 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:18.513218 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:18.513218 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:25:18.513218 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:18.513755 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 255/505] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 18:25:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:18.516100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f17add-2440-4487-8bff-b5717dd0f45f None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:18.582674 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:18.604884 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574ed54-79f5-464c-8856-3736ecd2e9db None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:18.627002 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f17add-2440-4487-8bff-b5717dd0f45f None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:18.641018 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370d666-760a-4a40-bf56-501f18da28a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:18.641744 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370d666-760a-4a40-bf56-501f18da28a9 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.642088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370d666-760a-4a40-bf56-501f18da28a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.642367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370d666-760a-4a40-bf56-501f18da28a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.662764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b37df-6a0b-4ab8-9757-b33c85337992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:18.663372 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b37df-6a0b-4ab8-9757-b33c85337992 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.663661 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b37df-6a0b-4ab8-9757-b33c85337992 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.663942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b37df-6a0b-4ab8-9757-b33c85337992 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.664933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370d666-760a-4a40-bf56-501f18da28a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:18.669885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-b370d666-760a-4a40-bf56-501f18da28a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:18.669885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:18.669885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:18.669885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:18.669885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:18.669885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:18.669885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:18.669885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:18.669885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:18.669885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:18.669885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:18.669885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:18.669885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:18.669885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:18.669885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:18.669885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:18.670791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:18.670791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:18.670791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:18.670791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:18.670791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:18.670791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:18.670791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:18.670791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:18.670791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:18.670791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:18.670791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:18.670791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:18.670791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:18.670791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:18.670791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:18.670791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:18.671629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:18.671629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:18.671629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:18.671629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:18.671629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:18.671629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:18.671629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:18.671629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:18.671629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:18.671629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:18.671629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:18.671629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:18.671629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 251/506] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:25:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:18.672298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370d666-760a-4a40-bf56-501f18da28a9 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:18.726617 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:18.733478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b37df-6a0b-4ab8-9757-b33c85337992 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:18.734952 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b37df-6a0b-4ab8-9757-b33c85337992 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:18.775701 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370d666-760a-4a40-bf56-501f18da28a9 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:18.791778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:18.810827 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc119bee-2e4e-451a-9011-91caa88c39da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:18.811494 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc119bee-2e4e-451a-9011-91caa88c39da None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.811877 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc119bee-2e4e-451a-9011-91caa88c39da None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.812161 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc119bee-2e4e-451a-9011-91caa88c39da None admin] PATH_INFO: `/v3/users/glance` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.819959 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc119bee-2e4e-451a-9011-91caa88c39da None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:18.821413 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc119bee-2e4e-451a-9011-91caa88c39da None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:18.834346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-dc119bee-2e4e-451a-9011-91caa88c39da None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 18:25:18.834346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:18.834346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:18.834346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:18.834346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:18.834346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:18.834346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:18.834346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:18.834346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:18.834346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:18.834346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:18.834346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:18.834346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:18.834346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:18.834346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:18.834346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:18.835244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:18.835244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:18.835244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:18.835244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:18.835244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:18.835244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:18.835244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:18.835244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:18.835244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:18.835244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:18.835244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:18.835244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:18.835244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:18.835244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:18.835244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:18.835244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:18.835244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:18.835244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:18.836440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:18.836440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:18.836440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:18.836440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:18.836440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:18.836440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:18.836440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:18.836440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:18.836440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 18:25:18.836440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:18.836958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 256/507] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:25:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:25:18.836958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b37df-6a0b-4ab8-9757-b33c85337992 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:18.837088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 252/508] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:25:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:18.837088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc119bee-2e4e-451a-9011-91caa88c39da None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:18.953028 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc119bee-2e4e-451a-9011-91caa88c39da None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:18.962172 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b37df-6a0b-4ab8-9757-b33c85337992 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:18.966860 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:18.994983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691b88f-e02a-42ec-9fab-0f9249506c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:18.995692 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691b88f-e02a-42ec-9fab-0f9249506c63 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.995982 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691b88f-e02a-42ec-9fab-0f9249506c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.996260 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691b88f-e02a-42ec-9fab-0f9249506c63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.004809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1553a-43bf-492e-bcd6-7b29d4d2fb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:19.006472 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1553a-43bf-492e-bcd6-7b29d4d2fb43 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:19.006701 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1553a-43bf-492e-bcd6-7b29d4d2fb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:19.006979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1553a-43bf-492e-bcd6-7b29d4d2fb43 None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.007825 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1553a-43bf-492e-bcd6-7b29d4d2fb43 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:19.008135 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1553a-43bf-492e-bcd6-7b29d4d2fb43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:19.009314 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691b88f-e02a-42ec-9fab-0f9249506c63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:19.009585 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1553a-43bf-492e-bcd6-7b29d4d2fb43 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:19.010791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691b88f-e02a-42ec-9fab-0f9249506c63 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:19.027048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-6691b88f-e02a-42ec-9fab-0f9249506c63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:19.027048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:19.027048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:19.027048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:19.027048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:19.027048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:19.027048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:19.027048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:19.027048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:19.027048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:19.027048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:19.027048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:19.027048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:19.027048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:19.027048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:19.028125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:19.028125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:19.028125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:19.028125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:19.028125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:19.028125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:19.028125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:19.028125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:19.028125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:19.028125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:19.028125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:19.028125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:19.028125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:19.028125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:19.028125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:19.028125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:19.028125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:19.029225 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:19.029225 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:19.029225 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:19.029225 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:19.029225 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 253/509] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:19.029511 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 257/510] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 18:25:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:19.029724 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691b88f-e02a-42ec-9fab-0f9249506c63 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:19.029808 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1553a-43bf-492e-bcd6-7b29d4d2fb43 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:19.050183 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:19.143149 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1553a-43bf-492e-bcd6-7b29d4d2fb43 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:19.147394 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691b88f-e02a-42ec-9fab-0f9249506c63 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:19.185056 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c7f9f-8a96-4097-b6dc-c9c331a92caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:19.185703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c7f9f-8a96-4097-b6dc-c9c331a92caf None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:19.185993 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c7f9f-8a96-4097-b6dc-c9c331a92caf None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:19.186284 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c7f9f-8a96-4097-b6dc-c9c331a92caf None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.187084 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c7f9f-8a96-4097-b6dc-c9c331a92caf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:19.187436 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c7f9f-8a96-4097-b6dc-c9c331a92caf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:19.187967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415bc34-737c-420b-a20d-51f94d3d53c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:19.188661 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415bc34-737c-420b-a20d-51f94d3d53c7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:19.188943 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415bc34-737c-420b-a20d-51f94d3d53c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:19.189216 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415bc34-737c-420b-a20d-51f94d3d53c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.189310 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c7f9f-8a96-4097-b6dc-c9c331a92caf None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:19.189935 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415bc34-737c-420b-a20d-51f94d3d53c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:19.190243 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415bc34-737c-420b-a20d-51f94d3d53c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:19.191679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415bc34-737c-420b-a20d-51f94d3d53c7 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:19.205247 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 254/511] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 18:25:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:19.205247 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415bc34-737c-420b-a20d-51f94d3d53c7 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:19.209695 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 258/512] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Jul 27 18:25:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:19.210618 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c7f9f-8a96-4097-b6dc-c9c331a92caf None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:19.231640 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:19.291050 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:19.316039 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415bc34-737c-420b-a20d-51f94d3d53c7 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:19.316890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c7f9f-8a96-4097-b6dc-c9c331a92caf None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:19.349602 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292974d-ed93-4d34-a409-40742519e321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:19.350178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d74e7-56bf-4038-8933-f278037fca33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:19.350293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292974d-ed93-4d34-a409-40742519e321 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:19.350497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292974d-ed93-4d34-a409-40742519e321 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:19.350766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292974d-ed93-4d34-a409-40742519e321 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.350856 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d74e7-56bf-4038-8933-f278037fca33 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:19.351075 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d74e7-56bf-4038-8933-f278037fca33 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:19.351392 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d74e7-56bf-4038-8933-f278037fca33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.361950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292974d-ed93-4d34-a409-40742519e321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:19.363451 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292974d-ed93-4d34-a409-40742519e321 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:19.379479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-e292974d-ed93-4d34-a409-40742519e321 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:19.379479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:19.379479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:19.379479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:19.379479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:19.379479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:19.379479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:19.379479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:19.379479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:19.379479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:19.379479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:19.379479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:19.379479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:19.379479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:19.379479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:19.380534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:19.380534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:19.380534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:19.380534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:19.380534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:19.380534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:19.380534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:19.380534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:19.380534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:19.380534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:19.380534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:19.380534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:19.380534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:19.380534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:19.380534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:19.380534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:19.380534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:19.381411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:19.381411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:19.381411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:19.381411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:19.381411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 255/513] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:19.381411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292974d-ed93-4d34-a409-40742519e321 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:19.424927 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d74e7-56bf-4038-8933-f278037fca33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:19.426430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d74e7-56bf-4038-8933-f278037fca33 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:19.462582 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:19.485680 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292974d-ed93-4d34-a409-40742519e321 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:19.503375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:19.520862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae7e0-5e17-4ce4-9e89-4eb8d4a004f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:19.521484 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae7e0-5e17-4ce4-9e89-4eb8d4a004f2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:19.521776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae7e0-5e17-4ce4-9e89-4eb8d4a004f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:19.522053 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae7e0-5e17-4ce4-9e89-4eb8d4a004f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.522750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ae7e0-5e17-4ce4-9e89-4eb8d4a004f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:19.523058 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ae7e0-5e17-4ce4-9e89-4eb8d4a004f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:19.524562 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ae7e0-5e17-4ce4-9e89-4eb8d4a004f2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:19.529868 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 259/514] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:25:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:25:19.530690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d74e7-56bf-4038-8933-f278037fca33 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:19.542307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 256/515] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:19.542307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae7e0-5e17-4ce4-9e89-4eb8d4a004f2 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:19.635513 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d74e7-56bf-4038-8933-f278037fca33 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:19.645044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae7e0-5e17-4ce4-9e89-4eb8d4a004f2 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:19.669541 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1672484-48a6-4d28-9055-b7d5e0509ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:19.670186 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1672484-48a6-4d28-9055-b7d5e0509ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:19.670474 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1672484-48a6-4d28-9055-b7d5e0509ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:19.670753 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1672484-48a6-4d28-9055-b7d5e0509ac7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.680579 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e3267-fd0e-4f01-8228-b6ea185e97af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:19.681196 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e3267-fd0e-4f01-8228-b6ea185e97af None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:19.681479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e3267-fd0e-4f01-8228-b6ea185e97af None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:19.681570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1672484-48a6-4d28-9055-b7d5e0509ac7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:19.681757 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e3267-fd0e-4f01-8228-b6ea185e97af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.682999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1672484-48a6-4d28-9055-b7d5e0509ac7 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:19.685272 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:19.697999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-d1672484-48a6-4d28-9055-b7d5e0509ac7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:19.697999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:19.697999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:19.697999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:19.697999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:19.697999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:19.697999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:19.697999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:19.697999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:19.697999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:19.697999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:19.697999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:19.697999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:19.697999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:19.697999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:19.698928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:19.698928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:19.698928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:19.698928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:19.698928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:19.698928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:19.698928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:19.698928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:19.698928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:19.698928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:19.698928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:19.698928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:19.698928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:19.698928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:19.698928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:19.698928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:19.698928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:19.699829 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:19.699829 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:19.699829 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:19.699829 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:19.703879 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 260/516] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:19.705046 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1672484-48a6-4d28-9055-b7d5e0509ac7 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:19.732178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:19.750928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e3267-fd0e-4f01-8228-b6ea185e97af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:19.752437 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e3267-fd0e-4f01-8228-b6ea185e97af None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:19.811486 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1672484-48a6-4d28-9055-b7d5e0509ac7 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:19.846644 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc6f69-abd0-40f2-ba9f-37b4a75dd45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:19.847288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc6f69-abd0-40f2-ba9f-37b4a75dd45b None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:19.847579 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc6f69-abd0-40f2-ba9f-37b4a75dd45b None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:19.847856 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc6f69-abd0-40f2-ba9f-37b4a75dd45b None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.848558 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc6f69-abd0-40f2-ba9f-37b4a75dd45b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:19.848861 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc6f69-abd0-40f2-ba9f-37b4a75dd45b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:19.850256 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc6f69-abd0-40f2-ba9f-37b4a75dd45b None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:19.858633 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 257/517] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:25:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:25:19.859325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e3267-fd0e-4f01-8228-b6ea185e97af None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:19.862871 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 261/518] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:19.863848 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc6f69-abd0-40f2-ba9f-37b4a75dd45b None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:19.899131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:19.951160 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:19.966144 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e3267-fd0e-4f01-8228-b6ea185e97af None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:19.966339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc6f69-abd0-40f2-ba9f-37b4a75dd45b None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:20.002698 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e4659-8177-469a-81d3-487baca74547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:20.002898 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d569a-a2e5-49a7-b108-887a7da6dd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:20.003215 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e4659-8177-469a-81d3-487baca74547 None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:20.003340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d569a-a2e5-49a7-b108-887a7da6dd44 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:20.003619 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e4659-8177-469a-81d3-487baca74547 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:20.003862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d569a-a2e5-49a7-b108-887a7da6dd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:20.003862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d569a-a2e5-49a7-b108-887a7da6dd44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:20.004160 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e4659-8177-469a-81d3-487baca74547 None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:20.004526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e4659-8177-469a-81d3-487baca74547 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:20.006019 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e4659-8177-469a-81d3-487baca74547 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:20.014320 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d569a-a2e5-49a7-b108-887a7da6dd44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:20.015814 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d569a-a2e5-49a7-b108-887a7da6dd44 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:20.031531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-072d569a-a2e5-49a7-b108-887a7da6dd44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:20.031531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:20.031531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:20.031531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:20.031531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:20.031531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:20.031531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:20.031531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:20.031531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:20.031531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:20.031531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:20.031531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:20.031531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:20.031531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:20.031531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:20.032707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:20.032707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:20.032707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:20.032707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:20.032707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:20.032707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:20.032707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:20.032707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:20.032707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:20.032707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:20.032707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:20.032707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:20.032707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:20.032707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:20.032707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:20.032707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:20.032707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:20.033633 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:20.033633 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:20.033633 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:20.033633 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:20.033633 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 258/519] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:20.034062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d569a-a2e5-49a7-b108-887a7da6dd44 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:20.098919 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 262/520] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 18:25:19 2022] POST /identity/v3/users => generated 247 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:20.099820 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e4659-8177-469a-81d3-487baca74547 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:20.134082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:20.152280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d569a-a2e5-49a7-b108-887a7da6dd44 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:20.192951 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009f8ca-c6fb-47bb-b9f3-ff92005aec76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:20.193973 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009f8ca-c6fb-47bb-b9f3-ff92005aec76 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:20.194506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009f8ca-c6fb-47bb-b9f3-ff92005aec76 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:20.195113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009f8ca-c6fb-47bb-b9f3-ff92005aec76 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:20.196233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009f8ca-c6fb-47bb-b9f3-ff92005aec76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:20.196618 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009f8ca-c6fb-47bb-b9f3-ff92005aec76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:20.198057 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009f8ca-c6fb-47bb-b9f3-ff92005aec76 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:20.217056 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 259/521] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:20.218059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009f8ca-c6fb-47bb-b9f3-ff92005aec76 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:20.231646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e4659-8177-469a-81d3-487baca74547 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:20.276115 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead240e-6ff1-44a6-9e79-c4b79598f2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:20.277293 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead240e-6ff1-44a6-9e79-c4b79598f2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:20.277293 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead240e-6ff1-44a6-9e79-c4b79598f2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:20.277293 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead240e-6ff1-44a6-9e79-c4b79598f2c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:20.291103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead240e-6ff1-44a6-9e79-c4b79598f2c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:20.292080 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead240e-6ff1-44a6-9e79-c4b79598f2c8 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:20.296283 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:20.313265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-4ead240e-6ff1-44a6-9e79-c4b79598f2c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:20.313265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:20.313265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:20.313265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:20.313265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:20.313265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:20.313265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:20.313265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:20.313265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:20.313265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:20.313265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:20.313265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:20.313265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:20.313265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:20.313265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:20.314373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:20.314373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:20.314373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:20.314373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:20.314373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:20.314373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:20.314373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:20.314373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:20.314373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:20.314373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:20.314373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:20.314373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:20.314373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:20.314373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:20.314373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:20.314373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:20.314373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:20.315229 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:20.315229 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:20.315229 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:20.315229 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:20.315229 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 263/522] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:20.316035 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead240e-6ff1-44a6-9e79-c4b79598f2c8 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:20.343718 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009f8ca-c6fb-47bb-b9f3-ff92005aec76 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:20.381212 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc0f2d-08a8-4f3d-aff0-b129faa0599b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:20.382159 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc0f2d-08a8-4f3d-aff0-b129faa0599b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:20.382639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc0f2d-08a8-4f3d-aff0-b129faa0599b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:20.383108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc0f2d-08a8-4f3d-aff0-b129faa0599b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:20.390984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc0f2d-08a8-4f3d-aff0-b129faa0599b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:20.393409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc0f2d-08a8-4f3d-aff0-b129faa0599b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:20.408920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-0bdc0f2d-08a8-4f3d-aff0-b129faa0599b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:20.408920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:20.408920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:20.408920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:20.408920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:20.408920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:20.408920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:20.408920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:20.408920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:20.408920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:20.408920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:20.408920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:20.408920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:20.408920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:20.408920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:20.409985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:20.409985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:20.409985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:20.409985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:20.409985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:20.409985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:20.409985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:20.409985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:20.409985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:20.409985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:20.409985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:20.409985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:20.409985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:20.409985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:20.409985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:20.409985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:20.409985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:20.410845 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:20.410845 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:20.410845 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:20.410845 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:20.410845 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:20.410845 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:20.410845 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:20.410845 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:20.415423 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 260/523] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:20.416597 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc0f2d-08a8-4f3d-aff0-b129faa0599b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:20.429291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:20.436252 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead240e-6ff1-44a6-9e79-c4b79598f2c8 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:20.475016 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafde61d-0bdb-4ae5-982e-6896741aa44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:20.475673 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafde61d-0bdb-4ae5-982e-6896741aa44e None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:20.475953 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafde61d-0bdb-4ae5-982e-6896741aa44e None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:20.476228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafde61d-0bdb-4ae5-982e-6896741aa44e None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:20.476928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafde61d-0bdb-4ae5-982e-6896741aa44e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:20.477231 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafde61d-0bdb-4ae5-982e-6896741aa44e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:20.478631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafde61d-0bdb-4ae5-982e-6896741aa44e None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:20.496059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 264/524] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:20.496059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafde61d-0bdb-4ae5-982e-6896741aa44e None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:20.535842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc0f2d-08a8-4f3d-aff0-b129faa0599b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:20.565630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:20.575189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d7ef6-5ca2-4ad0-850d-f696e3083150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:20.580186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d7ef6-5ca2-4ad0-850d-f696e3083150 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:20.580186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d7ef6-5ca2-4ad0-850d-f696e3083150 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:20.580186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d7ef6-5ca2-4ad0-850d-f696e3083150 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:20.584341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d7ef6-5ca2-4ad0-850d-f696e3083150 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:20.585836 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d7ef6-5ca2-4ad0-850d-f696e3083150 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:20.598517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-b39d7ef6-5ca2-4ad0-850d-f696e3083150 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 18:25:20.598517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:20.598517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:20.598517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:20.598517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:20.598517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:20.598517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:20.598517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:20.598517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:20.598517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:20.598517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:20.598517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:20.598517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:20.598517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:20.598517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:20.598517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:20.599518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:20.599518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:20.599518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:20.599518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:20.599518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:20.599518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:20.599518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:20.599518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:20.599518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:20.599518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:20.599518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:20.599518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:20.599518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:20.599518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:20.599518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:20.599518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:20.599518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:20.599518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:20.600515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:20.600515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:20.600515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:20.600515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:20.600515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:20.600515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:20.600515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:20.600515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:20.600515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 18:25:20.600515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:20.604275 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 261/525] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:25:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:20.605239 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d7ef6-5ca2-4ad0-850d-f696e3083150 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:20.617357 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafde61d-0bdb-4ae5-982e-6896741aa44e None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:20.653004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1ba87-9575-4e69-88c7-510c0fff70ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:20.653628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1ba87-9575-4e69-88c7-510c0fff70ab None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:20.653913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1ba87-9575-4e69-88c7-510c0fff70ab None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:20.654201 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1ba87-9575-4e69-88c7-510c0fff70ab None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:20.654909 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1ba87-9575-4e69-88c7-510c0fff70ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:20.655222 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1ba87-9575-4e69-88c7-510c0fff70ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:20.656647 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1ba87-9575-4e69-88c7-510c0fff70ab None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:20.671431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 265/526] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:20.672296 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1ba87-9575-4e69-88c7-510c0fff70ab None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:20.686245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:20.724292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d7ef6-5ca2-4ad0-850d-f696e3083150 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:20.761334 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414781d-5db1-417e-a0a5-94d8a98f15b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:20.761958 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414781d-5db1-417e-a0a5-94d8a98f15b8 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:20.762244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414781d-5db1-417e-a0a5-94d8a98f15b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:20.762524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414781d-5db1-417e-a0a5-94d8a98f15b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:20.763313 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414781d-5db1-417e-a0a5-94d8a98f15b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:20.763656 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414781d-5db1-417e-a0a5-94d8a98f15b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:20.765091 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414781d-5db1-417e-a0a5-94d8a98f15b8 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:20.785026 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 262/527] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:20.785776 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1ba87-9575-4e69-88c7-510c0fff70ab None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:20.785962 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414781d-5db1-417e-a0a5-94d8a98f15b8 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:20.805734 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:20.829400 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4af3a-08d7-4095-9f51-2dd5c9e0529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:20.830352 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4af3a-08d7-4095-9f51-2dd5c9e0529b None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:20.831248 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4af3a-08d7-4095-9f51-2dd5c9e0529b None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:20.831735 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4af3a-08d7-4095-9f51-2dd5c9e0529b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:20.840102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4af3a-08d7-4095-9f51-2dd5c9e0529b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:20.841849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4af3a-08d7-4095-9f51-2dd5c9e0529b None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:20.855132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-53c4af3a-08d7-4095-9f51-2dd5c9e0529b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:20.855132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:20.855132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:20.855132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:20.855132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:20.855132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:20.855132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:20.855132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:20.855132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:20.855132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:20.855132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:20.855132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:20.855132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:20.855132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:20.855132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:20.856082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:20.856082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:20.856082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:20.856082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:20.856082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:20.856082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:20.856082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:20.856082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:20.856082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:20.856082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:20.856082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:20.856082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:20.856082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:20.856082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:20.856082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:20.856082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:20.856082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:20.856929 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:20.856929 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:20.856929 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:20.856929 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:20.856929 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:20.856929 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:20.856929 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:20.856929 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:20.859150 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 266/528] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:20.860783 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4af3a-08d7-4095-9f51-2dd5c9e0529b None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:20.901798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414781d-5db1-417e-a0a5-94d8a98f15b8 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:20.931801 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:20.942871 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4932e9-c719-40ab-93cc-47aba92a1886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:20.943534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4932e9-c719-40ab-93cc-47aba92a1886 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:20.943824 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4932e9-c719-40ab-93cc-47aba92a1886 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:20.944094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4932e9-c719-40ab-93cc-47aba92a1886 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:20.944977 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4932e9-c719-40ab-93cc-47aba92a1886 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:20.945311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4932e9-c719-40ab-93cc-47aba92a1886 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:20.947209 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4932e9-c719-40ab-93cc-47aba92a1886 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:20.973179 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4af3a-08d7-4095-9f51-2dd5c9e0529b None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:20.993983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 263/529] 10.222.0.65 () {56 vars in 1139 bytes} [Wed Jul 27 18:25:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:20.994840 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4932e9-c719-40ab-93cc-47aba92a1886 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:21.009587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d6be4-2866-4671-a1d2-5650199e7e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:21.010235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d6be4-2866-4671-a1d2-5650199e7e6d None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:21.010527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d6be4-2866-4671-a1d2-5650199e7e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:21.010804 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d6be4-2866-4671-a1d2-5650199e7e6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:21.017771 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d6be4-2866-4671-a1d2-5650199e7e6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:21.019241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d6be4-2866-4671-a1d2-5650199e7e6d None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:21.030810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-f14d6be4-2866-4671-a1d2-5650199e7e6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:21.030810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:21.030810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:21.030810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:21.030810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:21.030810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:21.030810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:21.030810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:21.030810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:21.030810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:21.030810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:21.030810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:21.030810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:21.030810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:21.030810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:21.031926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:21.031926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:21.031926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:21.031926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:21.031926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:21.031926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:21.031926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:21.031926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:21.031926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:21.031926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:21.031926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:21.031926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:21.031926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:21.031926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:21.031926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:21.031926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:21.031926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:21.033633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:21.033633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:21.033633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:21.033633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:21.033633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:21.033633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:21.033633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:21.033633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:21.033633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 267/530] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:21.033633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d6be4-2866-4671-a1d2-5650199e7e6d None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:21.072251 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:21.111505 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4932e9-c719-40ab-93cc-47aba92a1886 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:21.147172 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d6be4-2866-4671-a1d2-5650199e7e6d None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:21.152661 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9a573-7b14-44b3-8ec1-0dd5541e929d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:21.153609 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9a573-7b14-44b3-8ec1-0dd5541e929d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:21.154090 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9a573-7b14-44b3-8ec1-0dd5541e929d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:21.154585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9a573-7b14-44b3-8ec1-0dd5541e929d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:21.155624 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9a573-7b14-44b3-8ec1-0dd5541e929d None admin] RBAC: Adding query filter params (role.id=ff0af8236fc84d82bf84c8d2d11c11ca, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=e5579f23592846abb3273cc5f5658ac9) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:21.156201 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9a573-7b14-44b3-8ec1-0dd5541e929d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:21.157995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9a573-7b14-44b3-8ec1-0dd5541e929d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:21.164391 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 264/531] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:25:20 2022] GET /identity/v3/role_assignments?user.id=e5579f23592846abb3273cc5f5658ac9&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=ff0af8236fc84d82bf84c8d2d11c11ca => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:21.165467 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9a573-7b14-44b3-8ec1-0dd5541e929d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:21.197708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae055bf-96fa-4082-9520-c10fed4c95f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:21.199346 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae055bf-96fa-4082-9520-c10fed4c95f6 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:21.199823 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae055bf-96fa-4082-9520-c10fed4c95f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:21.200302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae055bf-96fa-4082-9520-c10fed4c95f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:21.201559 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae055bf-96fa-4082-9520-c10fed4c95f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:21.202065 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae055bf-96fa-4082-9520-c10fed4c95f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:21.205043 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae055bf-96fa-4082-9520-c10fed4c95f6 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:21.231085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 268/532] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:21.232498 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae055bf-96fa-4082-9520-c10fed4c95f6 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:21.238532 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:21.310275 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9a573-7b14-44b3-8ec1-0dd5541e929d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:21.355374 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66bcf0-0bd7-4937-858c-cb000c151987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:21.356327 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66bcf0-0bd7-4937-858c-cb000c151987 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:21.356613 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66bcf0-0bd7-4937-858c-cb000c151987 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:21.356890 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66bcf0-0bd7-4937-858c-cb000c151987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:21.367436 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:21.371657 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae055bf-96fa-4082-9520-c10fed4c95f6 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:21.420401 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e947f0-9225-4a9b-9077-90f9a7e80945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:21.421033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e947f0-9225-4a9b-9077-90f9a7e80945 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:21.421318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e947f0-9225-4a9b-9077-90f9a7e80945 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:21.421597 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e947f0-9225-4a9b-9077-90f9a7e80945 None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:21.422357 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e947f0-9225-4a9b-9077-90f9a7e80945 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:21.423255 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e947f0-9225-4a9b-9077-90f9a7e80945 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:21.425006 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e947f0-9225-4a9b-9077-90f9a7e80945 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:21.437320 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 269/533] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:21.439018 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e947f0-9225-4a9b-9077-90f9a7e80945 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:21.448005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66bcf0-0bd7-4937-858c-cb000c151987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:21.449587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66bcf0-0bd7-4937-858c-cb000c151987 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:21.515225 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:21.557332 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e947f0-9225-4a9b-9077-90f9a7e80945 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:21.586144 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 265/534] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:25:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:25:21.587845 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66bcf0-0bd7-4937-858c-cb000c151987 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:21.598557 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517a4cb-5e74-4266-aac2-fa5b28d60ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:21.599367 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517a4cb-5e74-4266-aac2-fa5b28d60ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:21.600109 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517a4cb-5e74-4266-aac2-fa5b28d60ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:21.600109 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517a4cb-5e74-4266-aac2-fa5b28d60ed4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:21.601241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517a4cb-5e74-4266-aac2-fa5b28d60ed4 None admin] RBAC: Adding query filter params (role.id=ff0af8236fc84d82bf84c8d2d11c11ca, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=be769d4dd016466f9174e7d5e47a2a0d) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:21.601647 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517a4cb-5e74-4266-aac2-fa5b28d60ed4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:21.603468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517a4cb-5e74-4266-aac2-fa5b28d60ed4 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:21.616207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 270/535] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:25:21 2022] GET /identity/v3/role_assignments?user.id=be769d4dd016466f9174e7d5e47a2a0d&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=ff0af8236fc84d82bf84c8d2d11c11ca => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:21.617000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517a4cb-5e74-4266-aac2-fa5b28d60ed4 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:21.661065 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:21.744289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66bcf0-0bd7-4937-858c-cb000c151987 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:21.831698 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31778020-a0f4-4ee4-9f77-69339767ac49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:21.832334 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31778020-a0f4-4ee4-9f77-69339767ac49 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:21.832618 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31778020-a0f4-4ee4-9f77-69339767ac49 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:21.832947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31778020-a0f4-4ee4-9f77-69339767ac49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:21.833699 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31778020-a0f4-4ee4-9f77-69339767ac49 None admin] RBAC: Adding query filter params (role.id=ff0af8236fc84d82bf84c8d2d11c11ca, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=d49a34cd99ab47bb92af6ed2f82fefde) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:21.834012 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31778020-a0f4-4ee4-9f77-69339767ac49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:21.835515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31778020-a0f4-4ee4-9f77-69339767ac49 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:21.846617 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 266/536] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:25:21 2022] GET /identity/v3/role_assignments?user.id=d49a34cd99ab47bb92af6ed2f82fefde&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=ff0af8236fc84d82bf84c8d2d11c11ca => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:21.860990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517a4cb-5e74-4266-aac2-fa5b28d60ed4 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:21.910510 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29760a-a6d3-4503-b516-87190a7a6a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:21.911691 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29760a-a6d3-4503-b516-87190a7a6a21 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:21.912179 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29760a-a6d3-4503-b516-87190a7a6a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:21.912686 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29760a-a6d3-4503-b516-87190a7a6a21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:21.931030 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29760a-a6d3-4503-b516-87190a7a6a21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:21.932923 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29760a-a6d3-4503-b516-87190a7a6a21 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:21.949690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-0b29760a-a6d3-4503-b516-87190a7a6a21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:21.949690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:21.949690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:21.949690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:21.949690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:21.949690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:21.949690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:21.949690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:21.949690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:21.949690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:21.949690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:21.949690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:21.949690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:21.949690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:21.949690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:21.950648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:21.950648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:21.950648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:21.950648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:21.950648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:21.950648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:21.950648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:21.950648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:21.950648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:21.950648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:21.950648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:21.950648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:21.950648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:21.950648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:21.950648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:21.950648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:21.950648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:21.951528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:21.951528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:21.951528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:21.951528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:21.953876 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 271/537] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:21.959436 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31778020-a0f4-4ee4-9f77-69339767ac49 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:21.991290 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:22.083406 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31778020-a0f4-4ee4-9f77-69339767ac49 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:22.127637 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8bbcb-5ee4-4057-87f4-526374f89159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:22.128411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8bbcb-5ee4-4057-87f4-526374f89159 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:22.128701 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8bbcb-5ee4-4057-87f4-526374f89159 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:22.128979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8bbcb-5ee4-4057-87f4-526374f89159 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:22.129682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8bbcb-5ee4-4057-87f4-526374f89159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:22.129988 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8bbcb-5ee4-4057-87f4-526374f89159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:22.131517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8bbcb-5ee4-4057-87f4-526374f89159 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:22.146553 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 267/538] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:22.152046 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29760a-a6d3-4503-b516-87190a7a6a21 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:22.229058 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:22.270211 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29760a-a6d3-4503-b516-87190a7a6a21 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:22.295681 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9373a8c-1511-42d4-bdef-3dfdc64c077a None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:22.296021 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9373a8c-1511-42d4-bdef-3dfdc64c077a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:22.296237 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9373a8c-1511-42d4-bdef-3dfdc64c077a None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:22.299725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 268/539] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:22.304331 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8bab7-0c54-4a2b-a5b5-f461d603a1a3 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:22.304457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8bab7-0c54-4a2b-a5b5-f461d603a1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:22.304707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8bab7-0c54-4a2b-a5b5-f461d603a1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:22.316493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1867a-6b7e-4089-b597-2f901dce195f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:22.319121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1867a-6b7e-4089-b597-2f901dce195f None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:22.324468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1867a-6b7e-4089-b597-2f901dce195f None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:22.325007 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1867a-6b7e-4089-b597-2f901dce195f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:22.337900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1867a-6b7e-4089-b597-2f901dce195f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:22.339723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1867a-6b7e-4089-b597-2f901dce195f None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:22.340924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-92f8bab7-0c54-4a2b-a5b5-f461d603a1a3 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:22.342795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-92f8bab7-0c54-4a2b-a5b5-f461d603a1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:22.363104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-30a1867a-6b7e-4089-b597-2f901dce195f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:22.363104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:22.363104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:22.363104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:22.363104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:22.363104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:22.363104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:22.363104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:22.363104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:22.363104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:22.363104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:22.363104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:22.363104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:22.363104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:22.363104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:22.364129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:22.364129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:22.364129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:22.364129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:22.364129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:22.364129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:22.364129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:22.364129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:22.364129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:22.364129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:22.364129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:22.364129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:22.364129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:22.364129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:22.364129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:22.364129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:22.364129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:22.364969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:22.364969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:22.364969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:22.364969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:22.364969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:22.364969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:22.364969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:22.364969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:22.367457 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 272/540] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:22.372696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1867a-6b7e-4089-b597-2f901dce195f None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:22.495669 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 269/541] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:22.519404 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8bab7-0c54-4a2b-a5b5-f461d603a1a3 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:22.524485 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:22.555525 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1867a-6b7e-4089-b597-2f901dce195f None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:22.617017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:22.647985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bab94-f4d1-4bd2-871d-0c92e75e1eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:22.648632 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bab94-f4d1-4bd2-871d-0c92e75e1eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:22.648917 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bab94-f4d1-4bd2-871d-0c92e75e1eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:22.649209 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bab94-f4d1-4bd2-871d-0c92e75e1eb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:22.650023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58bab94-f4d1-4bd2-871d-0c92e75e1eb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:22.655800 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58bab94-f4d1-4bd2-871d-0c92e75e1eb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:22.657405 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58bab94-f4d1-4bd2-871d-0c92e75e1eb6 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:22.665730 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8bab7-0c54-4a2b-a5b5-f461d603a1a3 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:22.690426 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 273/542] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:22.700369 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bab94-f4d1-4bd2-871d-0c92e75e1eb6 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:22.723119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557faad-18c7-4d9d-b192-e8af0d0ee9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:22.723807 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557faad-18c7-4d9d-b192-e8af0d0ee9bd None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:22.724093 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557faad-18c7-4d9d-b192-e8af0d0ee9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:22.724370 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557faad-18c7-4d9d-b192-e8af0d0ee9bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:22.750602 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557faad-18c7-4d9d-b192-e8af0d0ee9bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:22.756200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-2557faad-18c7-4d9d-b192-e8af0d0ee9bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:22.756200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:22.756200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:22.756200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:22.756200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:22.756200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:22.756200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:22.756200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:22.756200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:22.756200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:22.756200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:22.756200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:22.756200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:22.756200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:22.756200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:22.756200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:22.757608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:22.757608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:22.757608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:22.757608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:22.757608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:22.757608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:22.757608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:22.757608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:22.757608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:22.757608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:22.757608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:22.757608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:22.757608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:22.757608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:22.757608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:22.757608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:22.759521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:22.759521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:22.759521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:22.759521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:22.759521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:22.759521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:22.759521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:22.759521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:22.759521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:22.759521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:22.759521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:22.759521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:22.759521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 270/543] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:25:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:25:22.764873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557faad-18c7-4d9d-b192-e8af0d0ee9bd None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:22.903698 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:22.916168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bab94-f4d1-4bd2-871d-0c92e75e1eb6 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:22.981573 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557faad-18c7-4d9d-b192-e8af0d0ee9bd None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:22.995076 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974c695-aeb7-4f04-b321-1d7794146b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:22.995770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974c695-aeb7-4f04-b321-1d7794146b8d None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:22.996057 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974c695-aeb7-4f04-b321-1d7794146b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:22.996336 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974c695-aeb7-4f04-b321-1d7794146b8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:22.997143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974c695-aeb7-4f04-b321-1d7794146b8d None admin] RBAC: Adding query filter params (role.id=ff0af8236fc84d82bf84c8d2d11c11ca, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=ffee4a13d4fd4f86bd1c79b4535a0c55) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:22.997459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974c695-aeb7-4f04-b321-1d7794146b8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:22.998920 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974c695-aeb7-4f04-b321-1d7794146b8d None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:23.006574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 274/544] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:25:22 2022] GET /identity/v3/role_assignments?user.id=ffee4a13d4fd4f86bd1c79b4535a0c55&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=ff0af8236fc84d82bf84c8d2d11c11ca => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:23.054900 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba30d8-ea6c-4f25-8689-57b3d98e3825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:23.056004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba30d8-ea6c-4f25-8689-57b3d98e3825 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:23.056517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba30d8-ea6c-4f25-8689-57b3d98e3825 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:23.056990 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba30d8-ea6c-4f25-8689-57b3d98e3825 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:23.057961 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba30d8-ea6c-4f25-8689-57b3d98e3825 None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:23.058504 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba30d8-ea6c-4f25-8689-57b3d98e3825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:23.060203 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba30d8-ea6c-4f25-8689-57b3d98e3825 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:23.075466 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 271/545] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 18:25:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:23.082407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974c695-aeb7-4f04-b321-1d7794146b8d None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:23.183437 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:23.251837 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974c695-aeb7-4f04-b321-1d7794146b8d None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:23.293504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaef5ba-c136-44b6-8bb1-45ef5960408c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:23.294105 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaef5ba-c136-44b6-8bb1-45ef5960408c None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:23.294390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaef5ba-c136-44b6-8bb1-45ef5960408c None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:23.294669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaef5ba-c136-44b6-8bb1-45ef5960408c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:23.312475 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaef5ba-c136-44b6-8bb1-45ef5960408c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:23.314496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaef5ba-c136-44b6-8bb1-45ef5960408c None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:23.335022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-cdaef5ba-c136-44b6-8bb1-45ef5960408c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:23.335022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:23.335022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:23.335022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:23.335022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:23.335022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:23.335022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:23.335022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:23.335022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:23.335022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:23.335022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:23.335022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:23.335022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:23.335022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:23.335022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:23.335962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:23.335962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:23.335962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:23.335962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:23.335962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:23.335962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:23.335962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:23.335962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:23.335962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:23.335962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:23.335962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:23.335962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:23.335962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:23.335962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:23.335962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:23.335962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:23.335962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:23.336888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:23.336888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:23.336888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:23.336888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:23.336888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 275/546] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:23.342524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba30d8-ea6c-4f25-8689-57b3d98e3825 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:23.524013 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba30d8-ea6c-4f25-8689-57b3d98e3825 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:23.562026 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:23.582558 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8f074-da53-4d1c-8818-5441f4ef60fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:23.583243 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8f074-da53-4d1c-8818-5441f4ef60fb None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:23.583787 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8f074-da53-4d1c-8818-5441f4ef60fb None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:23.583787 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8f074-da53-4d1c-8818-5441f4ef60fb None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:23.584501 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8f074-da53-4d1c-8818-5441f4ef60fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:23.584804 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8f074-da53-4d1c-8818-5441f4ef60fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:23.586191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8f074-da53-4d1c-8818-5441f4ef60fb None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:23.607187 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 272/547] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:23.612984 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaef5ba-c136-44b6-8bb1-45ef5960408c None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:23.617756 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1ebff-208a-4b15-9ed2-e42bca569999 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:23.618038 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1ebff-208a-4b15-9ed2-e42bca569999 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:23.618312 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1ebff-208a-4b15-9ed2-e42bca569999 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:23.620109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 273/548] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:25:23.632317 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60e507-4654-4d14-bdfd-5bf425ec8f1f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:23.632632 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60e507-4654-4d14-bdfd-5bf425ec8f1f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:23.632871 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60e507-4654-4d14-bdfd-5bf425ec8f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:23.668370 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-4c60e507-4654-4d14-bdfd-5bf425ec8f1f None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:23.669682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4c60e507-4654-4d14-bdfd-5bf425ec8f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:23.782602 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaef5ba-c136-44b6-8bb1-45ef5960408c None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:23.795675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:23.833661 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 274/549] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:25:23.846794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e370d-5007-4643-b931-492fb0d22377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:23.847470 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e370d-5007-4643-b931-492fb0d22377 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:23.847752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e370d-5007-4643-b931-492fb0d22377 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:23.848204 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e370d-5007-4643-b931-492fb0d22377 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:23.856027 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e370d-5007-4643-b931-492fb0d22377 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:23.857742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e370d-5007-4643-b931-492fb0d22377 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:23.866562 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60e507-4654-4d14-bdfd-5bf425ec8f1f None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:23.886873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-b71e370d-5007-4643-b931-492fb0d22377 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:25:23.886873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:23.886873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:23.886873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:23.886873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:23.886873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:23.886873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:23.886873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:23.886873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:23.886873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:23.886873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:23.886873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:23.886873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:23.886873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:23.886873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:23.886873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:23.887899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:23.887899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:23.887899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:23.887899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:23.887899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:23.887899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:23.887899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:23.887899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:23.887899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:23.887899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:23.887899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:23.887899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:23.887899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:23.887899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:23.887899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:23.887899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:23.887899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:23.887899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:23.888818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:23.888818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:23.888818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:23.888818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:23.888818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:23.888818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:23.888818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:23.888818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:23.888818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:25:23.888818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:23.889340 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 276/550] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:25:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:23.895073 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e370d-5007-4643-b931-492fb0d22377 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:24.073679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60e507-4654-4d14-bdfd-5bf425ec8f1f None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:24.093569 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e370d-5007-4643-b931-492fb0d22377 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:24.095112 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:24.117785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f10e6d-0a3d-4305-8cdf-ebf3b000e7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:24.118451 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f10e6d-0a3d-4305-8cdf-ebf3b000e7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:24.118734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f10e6d-0a3d-4305-8cdf-ebf3b000e7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:24.119349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f10e6d-0a3d-4305-8cdf-ebf3b000e7e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:24.134705 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f10e6d-0a3d-4305-8cdf-ebf3b000e7e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:24.142361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-a7f10e6d-0a3d-4305-8cdf-ebf3b000e7e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:24.142361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:24.142361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:24.142361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:24.142361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:24.142361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:24.142361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:24.142361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:24.142361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:24.142361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:24.142361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:24.142361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:24.142361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:24.142361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:24.142361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:24.142361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:24.145285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:24.145285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:24.145285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:24.145285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:24.145285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:24.145285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:24.145285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:24.145285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:24.145285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:24.145285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:24.145285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:24.145285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:24.145285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:24.145285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:24.145285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:24.145285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:24.148075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:24.148075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:24.148075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:24.148075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:24.148075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:24.148075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:24.148075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:24.148075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:24.148075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:24.148075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:24.148075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:24.148075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:24.148075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 275/551] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:25:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:25:24.155902 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f10e6d-0a3d-4305-8cdf-ebf3b000e7e3 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:24.175180 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb908992-5300-4c04-b526-59e1c0d41ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:24.175848 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb908992-5300-4c04-b526-59e1c0d41ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:24.176135 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb908992-5300-4c04-b526-59e1c0d41ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:24.176520 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb908992-5300-4c04-b526-59e1c0d41ab4 None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:24.177455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb908992-5300-4c04-b526-59e1c0d41ab4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:24.177822 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb908992-5300-4c04-b526-59e1c0d41ab4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:24.179350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb908992-5300-4c04-b526-59e1c0d41ab4 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:24.204741 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 277/552] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Jul 27 18:25:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:24.206225 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98ec41-f02b-44fd-a3ec-bb7533d1ca19 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:24.206530 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98ec41-f02b-44fd-a3ec-bb7533d1ca19 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:24.206915 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98ec41-f02b-44fd-a3ec-bb7533d1ca19 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:24.208424 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 278/553] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:24.211013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98ec41-f02b-44fd-a3ec-bb7533d1ca19 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:24.244801 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:24.293224 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f10e6d-0a3d-4305-8cdf-ebf3b000e7e3 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:24.330249 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98ec41-f02b-44fd-a3ec-bb7533d1ca19 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:24.332011 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3c0ea-01b1-4842-800b-96f47f6085e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:24.332643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3c0ea-01b1-4842-800b-96f47f6085e1 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:24.332926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3c0ea-01b1-4842-800b-96f47f6085e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:24.333200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3c0ea-01b1-4842-800b-96f47f6085e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:24.334630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3c0ea-01b1-4842-800b-96f47f6085e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:24.334630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3c0ea-01b1-4842-800b-96f47f6085e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:24.335629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3c0ea-01b1-4842-800b-96f47f6085e1 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:24.350621 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 276/554] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 18:25:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:24.352038 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3f849-1fc4-4c5d-93a4-c2062c572d3b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:24.352330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3f849-1fc4-4c5d-93a4-c2062c572d3b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:24.352611 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3f849-1fc4-4c5d-93a4-c2062c572d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:24.372150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-05d3f849-1fc4-4c5d-93a4-c2062c572d3b None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:24.373555 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-05d3f849-1fc4-4c5d-93a4-c2062c572d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:24.375317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6775967-e7dd-450f-bd00-0c4c0a226f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:24.376785 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6775967-e7dd-450f-bd00-0c4c0a226f69 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:24.377259 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6775967-e7dd-450f-bd00-0c4c0a226f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:24.377712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6775967-e7dd-450f-bd00-0c4c0a226f69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:24.405785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:24.444963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 277/555] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:24.445945 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3f849-1fc4-4c5d-93a4-c2062c572d3b None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:24.458187 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6775967-e7dd-450f-bd00-0c4c0a226f69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:24.460201 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6775967-e7dd-450f-bd00-0c4c0a226f69 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:24.488453 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:24.557579 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3f849-1fc4-4c5d-93a4-c2062c572d3b None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:24.595142 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 279/556] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:25:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 18:25:24.596616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6775967-e7dd-450f-bd00-0c4c0a226f69 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:24.598305 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda311f0-2dc1-4e40-a342-ad5af51c86d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:24.599144 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda311f0-2dc1-4e40-a342-ad5af51c86d5 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:24.600883 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda311f0-2dc1-4e40-a342-ad5af51c86d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:24.600883 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda311f0-2dc1-4e40-a342-ad5af51c86d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:24.612715 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda311f0-2dc1-4e40-a342-ad5af51c86d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:24.614186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda311f0-2dc1-4e40-a342-ad5af51c86d5 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:24.630062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-bda311f0-2dc1-4e40-a342-ad5af51c86d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:24.630062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:24.630062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:24.630062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:24.630062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:24.630062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:24.630062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:24.630062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:24.630062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:24.630062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:24.630062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:24.630062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:24.630062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:24.630062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:24.630062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:24.636944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:24.636944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:24.636944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:24.636944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:24.636944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:24.636944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:24.636944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:24.636944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:24.636944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:24.636944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:24.636944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:24.636944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:24.636944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:24.636944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:24.636944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:24.636944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:24.636944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:24.637855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:24.637855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:24.637855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:24.637855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:24.637855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 278/557] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:24.637855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a5772-0a87-44d5-be96-baf0b6b8dd58 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:24.637855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a5772-0a87-44d5-be96-baf0b6b8dd58 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:24.637855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a5772-0a87-44d5-be96-baf0b6b8dd58 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:24.637855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 279/558] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:24.639524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a5772-0a87-44d5-be96-baf0b6b8dd58 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:24.662708 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:24.770549 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6775967-e7dd-450f-bd00-0c4c0a226f69 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:24.795912 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:24.808717 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b499b-900c-4d95-b47a-4e681f370e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:24.809038 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a5772-0a87-44d5-be96-baf0b6b8dd58 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:24.809468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b499b-900c-4d95-b47a-4e681f370e09 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:24.809638 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b499b-900c-4d95-b47a-4e681f370e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:24.809913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b499b-900c-4d95-b47a-4e681f370e09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:24.821381 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b499b-900c-4d95-b47a-4e681f370e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:24.826345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-933b499b-900c-4d95-b47a-4e681f370e09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:24.826345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:24.826345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:24.826345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:24.826345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:24.826345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:24.826345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:24.826345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:24.826345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:24.826345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:24.826345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:24.826345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:24.826345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:24.826345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:24.826345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:24.826345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:24.827818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:24.827818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:24.827818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:24.827818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:24.827818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:24.827818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:24.827818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:24.827818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:24.827818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:24.827818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:24.827818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:24.827818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:24.827818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:24.827818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:24.827818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:24.827818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:24.829494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:24.829494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:24.829494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:24.829494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:24.829494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:24.829494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:24.829494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:24.829494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:24.829494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:24.829494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:24.829494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:24.829494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:24.829494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 280/559] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:25:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:24.829494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b499b-900c-4d95-b47a-4e681f370e09 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:24.854384 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c6a3f-3f55-4f41-9a06-bee163da2758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:24.855047 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c6a3f-3f55-4f41-9a06-bee163da2758 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:24.855254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c6a3f-3f55-4f41-9a06-bee163da2758 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:24.855636 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c6a3f-3f55-4f41-9a06-bee163da2758 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:24.868605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c6a3f-3f55-4f41-9a06-bee163da2758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:24.869993 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c6a3f-3f55-4f41-9a06-bee163da2758 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:24.886778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-b07c6a3f-3f55-4f41-9a06-bee163da2758 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:24.886778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:24.886778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:24.886778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:24.886778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:24.886778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:24.886778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:24.886778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:24.886778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:24.886778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:24.886778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:24.886778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:24.886778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:24.886778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:24.886778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:24.887766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:24.887766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:24.887766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:24.887766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:24.887766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:24.887766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:24.887766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:24.887766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:24.887766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:24.887766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:24.887766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:24.887766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:24.887766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:24.887766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:24.887766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:24.887766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:24.887766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:24.888758 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:24.888758 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:24.888758 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:24.888758 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:24.888758 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 280/560] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:24.890776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039aac80-2652-4085-ab59-5cce0dd5fba4 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:24.891573 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039aac80-2652-4085-ab59-5cce0dd5fba4 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:24.891851 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039aac80-2652-4085-ab59-5cce0dd5fba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:24.910501 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-039aac80-2652-4085-ab59-5cce0dd5fba4 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:24.911747 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-039aac80-2652-4085-ab59-5cce0dd5fba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:24.963374 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b499b-900c-4d95-b47a-4e681f370e09 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:24.997479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 281/561] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:24.998316 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039aac80-2652-4085-ab59-5cce0dd5fba4 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:25.001881 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:25.018610 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11e1a6-681e-4128-8384-69d795d55a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:25.019309 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11e1a6-681e-4128-8384-69d795d55a0c None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:25.019624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11e1a6-681e-4128-8384-69d795d55a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:25.019970 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11e1a6-681e-4128-8384-69d795d55a0c None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:25.020974 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11e1a6-681e-4128-8384-69d795d55a0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:25.021116 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11e1a6-681e-4128-8384-69d795d55a0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:25.022493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11e1a6-681e-4128-8384-69d795d55a0c None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:25.039464 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 281/562] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:25.041429 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11e1a6-681e-4128-8384-69d795d55a0c None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:25.105698 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:25.116645 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039aac80-2652-4085-ab59-5cce0dd5fba4 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:25.155027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6e2f7-117f-4a1f-8a9e-ac136b7fa377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:25.155683 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6e2f7-117f-4a1f-8a9e-ac136b7fa377 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:25.155974 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6e2f7-117f-4a1f-8a9e-ac136b7fa377 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:25.156258 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6e2f7-117f-4a1f-8a9e-ac136b7fa377 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:25.157530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6e2f7-117f-4a1f-8a9e-ac136b7fa377 None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:25.157859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6e2f7-117f-4a1f-8a9e-ac136b7fa377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:25.159336 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6e2f7-117f-4a1f-8a9e-ac136b7fa377 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:25.168623 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 282/563] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 18:25:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:25.169115 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11e1a6-681e-4128-8384-69d795d55a0c None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:25.174053 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6e2f7-117f-4a1f-8a9e-ac136b7fa377 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:25.207316 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821efcc8-9792-4cb6-a87c-d9860ef135ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:25.208350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821efcc8-9792-4cb6-a87c-d9860ef135ac None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:25.208856 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821efcc8-9792-4cb6-a87c-d9860ef135ac None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:25.209236 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821efcc8-9792-4cb6-a87c-d9860ef135ac None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:25.209960 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821efcc8-9792-4cb6-a87c-d9860ef135ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:25.210275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821efcc8-9792-4cb6-a87c-d9860ef135ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:25.211701 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821efcc8-9792-4cb6-a87c-d9860ef135ac None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:25.225731 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 282/564] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:25.226598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821efcc8-9792-4cb6-a87c-d9860ef135ac None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:25.248610 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:25.295474 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6e2f7-117f-4a1f-8a9e-ac136b7fa377 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:25.332134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58c784-0761-44cf-92f8-c8d8273cde5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:25.332789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58c784-0761-44cf-92f8-c8d8273cde5e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:25.333076 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58c784-0761-44cf-92f8-c8d8273cde5e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:25.333353 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58c784-0761-44cf-92f8-c8d8273cde5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:25.343949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58c784-0761-44cf-92f8-c8d8273cde5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:25.344225 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821efcc8-9792-4cb6-a87c-d9860ef135ac None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:25.347924 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:25.349984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-7d58c784-0761-44cf-92f8-c8d8273cde5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:25.349984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:25.349984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:25.349984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:25.349984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:25.349984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:25.349984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:25.349984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:25.349984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:25.349984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:25.349984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:25.349984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:25.349984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:25.349984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:25.349984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:25.349984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:25.351503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:25.351503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:25.351503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:25.351503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:25.351503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:25.351503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:25.351503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:25.351503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:25.351503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:25.351503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:25.351503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:25.351503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:25.351503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:25.351503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:25.351503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:25.351503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:25.356920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:25.356920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:25.356920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:25.356920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:25.356920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:25.356920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:25.356920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:25.356920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:25.356920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:25.356920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:25.356920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:25.356920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:25.356920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 283/565] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:25:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:25.356920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58c784-0761-44cf-92f8-c8d8273cde5e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:25.379965 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4750ee-6541-45bf-99b8-f20e1bd86483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:25.380606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4750ee-6541-45bf-99b8-f20e1bd86483 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:25.380906 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4750ee-6541-45bf-99b8-f20e1bd86483 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:25.381173 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4750ee-6541-45bf-99b8-f20e1bd86483 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:25.388734 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4750ee-6541-45bf-99b8-f20e1bd86483 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:25.390182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4750ee-6541-45bf-99b8-f20e1bd86483 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:25.402031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-7d4750ee-6541-45bf-99b8-f20e1bd86483 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:25:25.402031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:25.402031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:25.402031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:25.402031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:25.402031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:25.402031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:25.402031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:25.402031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:25.402031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:25.402031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:25.402031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:25.402031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:25.402031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:25.402031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:25.402031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:25.403203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:25.403203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:25.403203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:25.403203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:25.403203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:25.403203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:25.403203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:25.403203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:25.403203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:25.403203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:25.403203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:25.403203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:25.403203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:25.403203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:25.403203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:25.403203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:25.403203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:25.403203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:25.404411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:25.404411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:25.404411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:25.404411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:25.404411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:25.404411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:25.404411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:25.404411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:25.404411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:25:25.404411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:25.404411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 283/566] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:25:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:25.404411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4750ee-6541-45bf-99b8-f20e1bd86483 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:25.461680 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58c784-0761-44cf-92f8-c8d8273cde5e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:25.487942 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:25.498594 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc8f1f-e710-40ca-964a-94ec7e9fc54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:25.502468 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc8f1f-e710-40ca-964a-94ec7e9fc54d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:25.502468 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc8f1f-e710-40ca-964a-94ec7e9fc54d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:25.502468 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc8f1f-e710-40ca-964a-94ec7e9fc54d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:25.510853 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4750ee-6541-45bf-99b8-f20e1bd86483 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:25.512159 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc8f1f-e710-40ca-964a-94ec7e9fc54d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:25.513649 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc8f1f-e710-40ca-964a-94ec7e9fc54d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:25.530330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-21fc8f1f-e710-40ca-964a-94ec7e9fc54d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:25.530330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:25.530330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:25.530330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:25.530330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:25.530330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:25.530330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:25.530330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:25.530330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:25.530330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:25.530330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:25.530330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:25.530330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:25.530330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:25.530330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:25.531428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:25.531428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:25.531428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:25.531428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:25.531428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:25.531428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:25.531428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:25.531428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:25.531428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:25.531428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:25.531428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:25.531428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:25.531428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:25.531428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:25.531428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:25.531428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:25.531428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:25.533093 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:25.533093 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:25.533093 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:25.533093 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:25.533093 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 284/567] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:25.533634 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4658ef-fa0e-4269-b442-a87213a3037d None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:25.533904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4658ef-fa0e-4269-b442-a87213a3037d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:25.534186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4658ef-fa0e-4269-b442-a87213a3037d None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:25.535632 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 285/568] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:25.538656 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4658ef-fa0e-4269-b442-a87213a3037d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:25.555904 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a079982-091d-4864-9400-2c2b393e00ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:25.556555 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a079982-091d-4864-9400-2c2b393e00ab None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:25.556839 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a079982-091d-4864-9400-2c2b393e00ab None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:25.557116 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a079982-091d-4864-9400-2c2b393e00ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:25.565024 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a079982-091d-4864-9400-2c2b393e00ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:25.566486 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a079982-091d-4864-9400-2c2b393e00ab None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:25.578278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-1a079982-091d-4864-9400-2c2b393e00ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:25.578278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:25.578278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:25.578278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:25.578278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:25.578278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:25.578278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:25.578278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:25.578278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:25.578278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:25.578278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:25.578278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:25.578278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:25.578278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:25.578278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:25.579228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:25.579228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:25.579228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:25.579228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:25.579228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:25.579228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:25.579228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:25.579228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:25.579228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:25.579228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:25.579228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:25.579228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:25.579228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:25.579228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:25.579228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:25.579228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:25.579228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:25.580167 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:25.580167 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:25.580167 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:25.580167 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:25.580167 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:25.580167 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:25.580167 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:25.580167 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:25.580167 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 284/569] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:25.580660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a079982-091d-4864-9400-2c2b393e00ab None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:25.606658 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:25.644866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4658ef-fa0e-4269-b442-a87213a3037d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:25.679449 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96515fbe-0425-41e5-a72b-f36a07c8cfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:25.680109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96515fbe-0425-41e5-a72b-f36a07c8cfd2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:25.680378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96515fbe-0425-41e5-a72b-f36a07c8cfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:25.680752 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96515fbe-0425-41e5-a72b-f36a07c8cfd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:25.681372 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96515fbe-0425-41e5-a72b-f36a07c8cfd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:25.681675 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96515fbe-0425-41e5-a72b-f36a07c8cfd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:25.683065 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96515fbe-0425-41e5-a72b-f36a07c8cfd2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:25.684063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a079982-091d-4864-9400-2c2b393e00ab None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:25.691147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 286/570] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 18:25:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:25.692027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96515fbe-0425-41e5-a72b-f36a07c8cfd2 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:25.718892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71536afe-7131-45c7-8bb9-1ec6787a559f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:25.720093 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71536afe-7131-45c7-8bb9-1ec6787a559f None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:25.720336 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71536afe-7131-45c7-8bb9-1ec6787a559f None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:25.720616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71536afe-7131-45c7-8bb9-1ec6787a559f None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:25.721411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71536afe-7131-45c7-8bb9-1ec6787a559f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:25.721723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71536afe-7131-45c7-8bb9-1ec6787a559f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:25.723173 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71536afe-7131-45c7-8bb9-1ec6787a559f None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:25.732030 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:25.740871 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 285/571] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Jul 27 18:25:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:25.742089 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60eed82-cf70-42c8-bbe1-f0cadf966545 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:25.742377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60eed82-cf70-42c8-bbe1-f0cadf966545 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:25.742913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60eed82-cf70-42c8-bbe1-f0cadf966545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:25.761703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-e60eed82-cf70-42c8-bbe1-f0cadf966545 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:25.762804 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e60eed82-cf70-42c8-bbe1-f0cadf966545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:25.796143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96515fbe-0425-41e5-a72b-f36a07c8cfd2 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:25.830242 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 286/572] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:25.830885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17ee25-3b9f-4876-8309-18b04b25958f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:25.831517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17ee25-3b9f-4876-8309-18b04b25958f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:25.831802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17ee25-3b9f-4876-8309-18b04b25958f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:25.832078 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17ee25-3b9f-4876-8309-18b04b25958f None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:25.832177 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60eed82-cf70-42c8-bbe1-f0cadf966545 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:25.832779 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17ee25-3b9f-4876-8309-18b04b25958f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:25.833085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17ee25-3b9f-4876-8309-18b04b25958f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:25.834458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17ee25-3b9f-4876-8309-18b04b25958f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:25.847093 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:25.848398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 287/573] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:25.849234 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17ee25-3b9f-4876-8309-18b04b25958f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:25.938045 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60eed82-cf70-42c8-bbe1-f0cadf966545 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:25.945812 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:25.949593 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17ee25-3b9f-4876-8309-18b04b25958f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:25.972424 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170fd17-4a13-4101-824a-0c43471f3b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:25.973046 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170fd17-4a13-4101-824a-0c43471f3b59 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:25.973325 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170fd17-4a13-4101-824a-0c43471f3b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:25.973598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170fd17-4a13-4101-824a-0c43471f3b59 None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:25.974350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170fd17-4a13-4101-824a-0c43471f3b59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:25.974658 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170fd17-4a13-4101-824a-0c43471f3b59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:25.976191 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170fd17-4a13-4101-824a-0c43471f3b59 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:25.983806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64a007-698f-473f-a6b3-7c201e22bd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:25.984675 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64a007-698f-473f-a6b3-7c201e22bd91 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:25.985440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64a007-698f-473f-a6b3-7c201e22bd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:25.985726 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64a007-698f-473f-a6b3-7c201e22bd91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:25.988549 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 287/574] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:25.989350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170fd17-4a13-4101-824a-0c43471f3b59 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:26.001594 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64a007-698f-473f-a6b3-7c201e22bd91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:26.003054 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64a007-698f-473f-a6b3-7c201e22bd91 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:26.018244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-0a64a007-698f-473f-a6b3-7c201e22bd91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:26.018244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:26.018244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:26.018244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:26.018244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:26.018244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:26.018244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:26.018244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:26.018244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:26.018244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:26.018244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:26.018244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:26.018244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:26.018244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:26.018244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:26.019242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:26.019242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:26.019242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:26.019242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:26.019242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:26.019242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:26.019242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:26.019242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:26.019242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:26.019242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:26.019242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:26.019242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:26.019242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:26.019242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:26.019242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:26.019242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:26.019242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:26.020364 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:26.020364 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:26.020364 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:26.020364 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:26.020364 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 288/575] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:26.020364 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64a007-698f-473f-a6b3-7c201e22bd91 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:26.060375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:26.090617 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170fd17-4a13-4101-824a-0c43471f3b59 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:26.123037 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64a007-698f-473f-a6b3-7c201e22bd91 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:26.124980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c9074-333a-47c3-b95e-e83235c5a045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:26.125678 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c9074-333a-47c3-b95e-e83235c5a045 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:26.125959 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c9074-333a-47c3-b95e-e83235c5a045 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:26.126397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c9074-333a-47c3-b95e-e83235c5a045 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:26.136754 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c9074-333a-47c3-b95e-e83235c5a045 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:26.138208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c9074-333a-47c3-b95e-e83235c5a045 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:26.152720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-825c9074-333a-47c3-b95e-e83235c5a045 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:26.152720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:26.152720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:26.152720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:26.152720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:26.152720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:26.152720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:26.152720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:26.152720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:26.152720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:26.152720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:26.152720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:26.152720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:26.152720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:26.152720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:26.153818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:26.153818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:26.153818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:26.153818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:26.153818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:26.153818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:26.153818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:26.153818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:26.153818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:26.153818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:26.153818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:26.153818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:26.153818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:26.153818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:26.153818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:26.153818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:26.153818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:26.154876 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:26.154876 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:26.154876 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:26.154876 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:26.154876 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 288/576] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:26.154876 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c9074-333a-47c3-b95e-e83235c5a045 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:26.162411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ec6b7-1fcd-42ac-8459-4c002f77539a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:26.163092 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ec6b7-1fcd-42ac-8459-4c002f77539a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:26.163366 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ec6b7-1fcd-42ac-8459-4c002f77539a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:26.163641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ec6b7-1fcd-42ac-8459-4c002f77539a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:26.174028 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ec6b7-1fcd-42ac-8459-4c002f77539a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:26.179280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-347ec6b7-1fcd-42ac-8459-4c002f77539a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:26.179280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:26.179280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:26.179280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:26.179280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:26.179280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:26.179280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:26.179280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:26.179280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:26.179280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:26.179280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:26.179280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:26.179280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:26.179280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:26.179280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:26.179280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:26.180412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:26.180412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:26.180412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:26.180412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:26.180412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:26.180412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:26.180412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:26.180412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:26.180412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:26.180412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:26.180412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:26.180412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:26.180412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:26.180412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:26.180412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:26.180412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:26.181406 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:26.181406 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:26.181406 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:26.181406 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:26.181406 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:26.181406 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:26.181406 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:26.181406 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:26.181406 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:26.181406 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:26.181406 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:26.181406 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:26.185215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 289/577] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:25:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:26.185998 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ec6b7-1fcd-42ac-8459-4c002f77539a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:26.199465 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:26.259822 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c9074-333a-47c3-b95e-e83235c5a045 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:26.285135 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:26.290246 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ec6b7-1fcd-42ac-8459-4c002f77539a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:26.295701 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff259227-a968-4a43-9a96-4c8601d2fd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:26.302494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff259227-a968-4a43-9a96-4c8601d2fd03 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:26.302494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff259227-a968-4a43-9a96-4c8601d2fd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:26.302494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff259227-a968-4a43-9a96-4c8601d2fd03 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:26.306067 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff259227-a968-4a43-9a96-4c8601d2fd03 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:26.307687 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff259227-a968-4a43-9a96-4c8601d2fd03 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:26.321627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-ff259227-a968-4a43-9a96-4c8601d2fd03 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:25:26.321627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:26.321627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:26.321627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:26.321627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:26.321627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:26.321627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:26.321627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:26.321627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:26.321627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:26.321627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:26.321627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:26.321627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:26.321627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:26.321627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:26.321627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:26.322846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:26.322846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:26.322846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:26.322846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:26.322846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:26.322846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:26.322846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:26.322846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:26.322846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:26.322846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:26.322846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:26.322846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:26.322846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:26.322846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:26.322846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:26.322846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:26.322846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:26.322846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:26.323930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:26.323930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:26.323930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:26.323930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:26.323930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:26.323930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:26.323930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:26.323930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:26.323930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:25:26.323930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:26.323930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 289/578] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 18:25:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:26.324629 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff259227-a968-4a43-9a96-4c8601d2fd03 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:26.334060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ef2dd-4dd9-4f5b-9a6d-9c6a31fd3e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:26.334685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ef2dd-4dd9-4f5b-9a6d-9c6a31fd3e79 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:26.334971 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ef2dd-4dd9-4f5b-9a6d-9c6a31fd3e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:26.335247 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ef2dd-4dd9-4f5b-9a6d-9c6a31fd3e79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:26.336072 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ef2dd-4dd9-4f5b-9a6d-9c6a31fd3e79 None admin] RBAC: Adding query filter params (role.id=ff0af8236fc84d82bf84c8d2d11c11ca, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=7832398e97af4e539e10d1eef49f6d6f) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:26.336385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ef2dd-4dd9-4f5b-9a6d-9c6a31fd3e79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:26.337834 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ef2dd-4dd9-4f5b-9a6d-9c6a31fd3e79 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:26.343366 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 290/579] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:25:26 2022] GET /identity/v3/role_assignments?user.id=7832398e97af4e539e10d1eef49f6d6f&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=ff0af8236fc84d82bf84c8d2d11c11ca => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:26.344152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ef2dd-4dd9-4f5b-9a6d-9c6a31fd3e79 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:26.440472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:26.440849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff259227-a968-4a43-9a96-4c8601d2fd03 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:26.470197 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ef2dd-4dd9-4f5b-9a6d-9c6a31fd3e79 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:26.480910 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51387bb8-a31d-4931-8ebe-7699fc09d669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:26.481564 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51387bb8-a31d-4931-8ebe-7699fc09d669 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:26.481849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51387bb8-a31d-4931-8ebe-7699fc09d669 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:26.482125 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51387bb8-a31d-4931-8ebe-7699fc09d669 None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:26.482839 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51387bb8-a31d-4931-8ebe-7699fc09d669 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:26.483148 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51387bb8-a31d-4931-8ebe-7699fc09d669 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:26.484638 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51387bb8-a31d-4931-8ebe-7699fc09d669 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:26.498586 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 290/580] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:26.499736 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51387bb8-a31d-4931-8ebe-7699fc09d669 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:26.513208 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed12217-2846-414a-91f0-dae6b6312c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:26.514163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed12217-2846-414a-91f0-dae6b6312c09 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:26.514509 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed12217-2846-414a-91f0-dae6b6312c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:26.514848 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed12217-2846-414a-91f0-dae6b6312c09 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:26.515683 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed12217-2846-414a-91f0-dae6b6312c09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:26.516055 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed12217-2846-414a-91f0-dae6b6312c09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:26.517661 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed12217-2846-414a-91f0-dae6b6312c09 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:26.534993 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 291/581] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:26.534993 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed12217-2846-414a-91f0-dae6b6312c09 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:26.568087 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:26.626815 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51387bb8-a31d-4931-8ebe-7699fc09d669 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:26.640682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed12217-2846-414a-91f0-dae6b6312c09 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:26.662242 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898db9c-8b26-4ee6-b06a-637a0028aef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:26.662877 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898db9c-8b26-4ee6-b06a-637a0028aef7 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:26.663320 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898db9c-8b26-4ee6-b06a-637a0028aef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:26.663514 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898db9c-8b26-4ee6-b06a-637a0028aef7 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:26.664247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898db9c-8b26-4ee6-b06a-637a0028aef7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:26.664560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898db9c-8b26-4ee6-b06a-637a0028aef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:26.666086 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898db9c-8b26-4ee6-b06a-637a0028aef7 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:26.679866 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 291/582] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 18:25:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:26.679866 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898db9c-8b26-4ee6-b06a-637a0028aef7 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:26.684733 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f4079-9473-4a1f-b80c-c1a3b0fab36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:26.685367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f4079-9473-4a1f-b80c-c1a3b0fab36a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:26.685647 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f4079-9473-4a1f-b80c-c1a3b0fab36a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:26.685971 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f4079-9473-4a1f-b80c-c1a3b0fab36a None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:26.686786 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f4079-9473-4a1f-b80c-c1a3b0fab36a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:26.687092 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f4079-9473-4a1f-b80c-c1a3b0fab36a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:26.689197 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f4079-9473-4a1f-b80c-c1a3b0fab36a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:26.711207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 292/583] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 18:25:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:26.711207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f4079-9473-4a1f-b80c-c1a3b0fab36a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:26.755222 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:26.796819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898db9c-8b26-4ee6-b06a-637a0028aef7 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:26.814754 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f4079-9473-4a1f-b80c-c1a3b0fab36a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:26.863251 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:26.896254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7421e65-bb3d-4213-9f3a-fb91ab8fe40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:26.896524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a040c0-81bc-41fe-804b-c216cf487f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:26.896978 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7421e65-bb3d-4213-9f3a-fb91ab8fe40c None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:26.897065 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a040c0-81bc-41fe-804b-c216cf487f2f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:26.897386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7421e65-bb3d-4213-9f3a-fb91ab8fe40c None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:26.897475 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a040c0-81bc-41fe-804b-c216cf487f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:26.897558 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7421e65-bb3d-4213-9f3a-fb91ab8fe40c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:26.897630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a040c0-81bc-41fe-804b-c216cf487f2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:26.904611 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a040c0-81bc-41fe-804b-c216cf487f2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:26.906074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a040c0-81bc-41fe-804b-c216cf487f2f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:26.906190 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7421e65-bb3d-4213-9f3a-fb91ab8fe40c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:26.907809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7421e65-bb3d-4213-9f3a-fb91ab8fe40c None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:26.917979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-c6a040c0-81bc-41fe-804b-c216cf487f2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:26.917979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:26.917979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:26.917979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:26.917979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:26.917979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:26.917979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:26.917979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:26.917979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:26.917979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:26.917979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:26.917979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:26.917979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:26.917979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:26.917979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:26.918930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:26.918930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:26.918930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:26.918930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:26.918930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:26.918930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:26.918930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:26.918930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:26.918930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:26.918930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:26.918930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:26.918930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:26.918930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:26.918930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:26.918930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:26.918930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:26.918930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:26.919903 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:26.919903 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:26.919903 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:26.919903 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:26.919903 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:26.919903 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:26.919903 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:26.919903 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:26.920364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-f7421e65-bb3d-4213-9f3a-fb91ab8fe40c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 18:25:26.920364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:26.920364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:26.920364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:26.920364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:26.920364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:26.920364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:26.920364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:26.920364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:26.920364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:26.920364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:26.920364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:26.920364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:26.920364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:26.920364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:26.920364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:26.921208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:26.921208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:26.921208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:26.921208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:26.921208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:26.921208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:26.921208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:26.921208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:26.921208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:26.921208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:26.921208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:26.921208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:26.921208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:26.921208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:26.921208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:26.921208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:26.921208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:26.921208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:26.922143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:26.922143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:26.922143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:26.922143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:26.922143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:26.922143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:26.922143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:26.922143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:26.922143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 18:25:26.922143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:26.922143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 292/584] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:25:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:26.922143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7421e65-bb3d-4213-9f3a-fb91ab8fe40c None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:26.927595 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 293/585] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:26.928395 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a040c0-81bc-41fe-804b-c216cf487f2f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:26.984770 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:27.028134 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7421e65-bb3d-4213-9f3a-fb91ab8fe40c None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:27.035282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a040c0-81bc-41fe-804b-c216cf487f2f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:27.065339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d96fbc-9b70-4d83-8da2-d905a900e396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:27.066005 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d96fbc-9b70-4d83-8da2-d905a900e396 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:27.066286 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d96fbc-9b70-4d83-8da2-d905a900e396 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:27.066559 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d96fbc-9b70-4d83-8da2-d905a900e396 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:27.073018 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f6d8e-e897-4468-9e0b-2adf3380a19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:27.073662 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f6d8e-e897-4468-9e0b-2adf3380a19c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:27.073947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f6d8e-e897-4468-9e0b-2adf3380a19c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:27.074222 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f6d8e-e897-4468-9e0b-2adf3380a19c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:27.080121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d96fbc-9b70-4d83-8da2-d905a900e396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:27.081594 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d96fbc-9b70-4d83-8da2-d905a900e396 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:27.085751 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f6d8e-e897-4468-9e0b-2adf3380a19c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:27.087226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f6d8e-e897-4468-9e0b-2adf3380a19c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:27.097396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-81d96fbc-9b70-4d83-8da2-d905a900e396 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:27.097396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:27.097396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:27.097396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:27.097396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:27.097396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:27.097396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:27.097396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:27.097396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:27.097396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:27.097396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:27.097396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:27.097396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:27.097396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:27.097396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:27.098478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:27.098478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:27.098478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:27.098478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:27.098478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:27.098478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:27.098478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:27.098478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:27.098478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:27.098478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:27.098478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:27.098478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:27.098478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:27.098478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:27.098478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:27.098478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:27.098478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:27.099630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:27.099630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:27.099630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:27.099630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:27.103166 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 293/586] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:27.104016 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d96fbc-9b70-4d83-8da2-d905a900e396 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:27.109823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-f47f6d8e-e897-4468-9e0b-2adf3380a19c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:27.109823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:27.109823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:27.109823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:27.109823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:27.109823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:27.109823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:27.109823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:27.109823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:27.109823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:27.109823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:27.109823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:27.109823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:27.109823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:27.109823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:27.111094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:27.111094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:27.111094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:27.111094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:27.111094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:27.111094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:27.111094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:27.111094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:27.111094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:27.111094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:27.111094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:27.111094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:27.111094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:27.111094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:27.111094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:27.111094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:27.111094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:27.113106 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:27.113106 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:27.113106 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:27.113106 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:27.113666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 294/587] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:27.114679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f6d8e-e897-4468-9e0b-2adf3380a19c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:27.128426 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:27.218115 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d96fbc-9b70-4d83-8da2-d905a900e396 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:27.228896 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f6d8e-e897-4468-9e0b-2adf3380a19c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:27.231277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:27.255702 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857da8a2-8795-4259-b84b-129fc9af70f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:27.256318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857da8a2-8795-4259-b84b-129fc9af70f6 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:27.256599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857da8a2-8795-4259-b84b-129fc9af70f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:27.256879 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857da8a2-8795-4259-b84b-129fc9af70f6 None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:27.257676 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857da8a2-8795-4259-b84b-129fc9af70f6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:27.257990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857da8a2-8795-4259-b84b-129fc9af70f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:27.259456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857da8a2-8795-4259-b84b-129fc9af70f6 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:27.265416 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6869c-c008-47be-be9f-9a4eb73b99b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:27.266043 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6869c-c008-47be-be9f-9a4eb73b99b4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:27.266471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6869c-c008-47be-be9f-9a4eb73b99b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:27.266753 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6869c-c008-47be-be9f-9a4eb73b99b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:27.267540 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6869c-c008-47be-be9f-9a4eb73b99b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:27.267857 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6869c-c008-47be-be9f-9a4eb73b99b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:27.269286 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6869c-c008-47be-be9f-9a4eb73b99b4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:27.280340 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 294/588] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Jul 27 18:25:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:27.281475 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857da8a2-8795-4259-b84b-129fc9af70f6 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:27.287503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 295/589] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:27.288489 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6869c-c008-47be-be9f-9a4eb73b99b4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:27.363384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:27.386181 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857da8a2-8795-4259-b84b-129fc9af70f6 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:27.402657 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6869c-c008-47be-be9f-9a4eb73b99b4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:27.431612 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222a5fd-7039-405b-bb83-fb97a8814bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:27.432257 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222a5fd-7039-405b-bb83-fb97a8814bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:27.432543 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222a5fd-7039-405b-bb83-fb97a8814bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:27.432823 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222a5fd-7039-405b-bb83-fb97a8814bd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:27.433522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222a5fd-7039-405b-bb83-fb97a8814bd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:27.433829 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222a5fd-7039-405b-bb83-fb97a8814bd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:27.435207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222a5fd-7039-405b-bb83-fb97a8814bd7 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:27.442747 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826bd85-0d4e-47a5-8e17-4aec5e70639e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:27.443419 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826bd85-0d4e-47a5-8e17-4aec5e70639e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:27.443707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826bd85-0d4e-47a5-8e17-4aec5e70639e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:27.443987 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826bd85-0d4e-47a5-8e17-4aec5e70639e None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:27.444689 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826bd85-0d4e-47a5-8e17-4aec5e70639e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:27.444997 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826bd85-0d4e-47a5-8e17-4aec5e70639e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:27.446382 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826bd85-0d4e-47a5-8e17-4aec5e70639e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:27.449339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 295/590] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:27.450442 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222a5fd-7039-405b-bb83-fb97a8814bd7 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:27.461240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 296/591] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:27.462124 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826bd85-0d4e-47a5-8e17-4aec5e70639e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:27.494698 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:27.583237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222a5fd-7039-405b-bb83-fb97a8814bd7 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:27.584310 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826bd85-0d4e-47a5-8e17-4aec5e70639e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:27.621608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa1cbe-63ca-4815-af65-9f7078952101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:27.622336 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa1cbe-63ca-4815-af65-9f7078952101 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:27.622619 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa1cbe-63ca-4815-af65-9f7078952101 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:27.622719 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac442d-d412-4c9f-96fd-bfb266bf64b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:27.622894 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa1cbe-63ca-4815-af65-9f7078952101 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:27.623458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac442d-d412-4c9f-96fd-bfb266bf64b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:27.623782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac442d-d412-4c9f-96fd-bfb266bf64b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:27.624066 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac442d-d412-4c9f-96fd-bfb266bf64b5 None admin] PATH_INFO: `/v3/projects/2880a34079d742c38bfdace2c04564c7/users/e5579f23592846abb3273cc5f5658ac9/roles/ff0af8236fc84d82bf84c8d2d11c11ca` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:27.627696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:27.636690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa1cbe-63ca-4815-af65-9f7078952101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:27.638173 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa1cbe-63ca-4815-af65-9f7078952101 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:27.642952 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac442d-d412-4c9f-96fd-bfb266bf64b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2880a34079d742c38bfdace2c04564c7, user_id=e5579f23592846abb3273cc5f5658ac9, role_id=ff0af8236fc84d82bf84c8d2d11c11ca)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:27.644455 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac442d-d412-4c9f-96fd-bfb266bf64b5 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:27.652667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-1ffa1cbe-63ca-4815-af65-9f7078952101 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:27.652667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:27.652667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:27.652667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:27.652667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:27.652667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:27.652667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:27.652667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:27.652667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:27.652667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:27.652667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:27.652667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:27.652667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:27.652667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:27.652667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:27.653730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:27.653730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:27.653730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:27.653730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:27.653730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:27.653730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:27.653730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:27.653730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:27.653730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:27.653730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:27.653730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:27.653730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:27.653730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:27.653730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:27.653730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:27.653730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:27.653730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:27.654743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:27.654743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:27.654743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:27.654743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:27.654743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 296/592] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:27.654743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa1cbe-63ca-4815-af65-9f7078952101 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:27.721721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 297/593] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:25:27 2022] PUT /identity/v3/projects/2880a34079d742c38bfdace2c04564c7/users/e5579f23592846abb3273cc5f5658ac9/roles/ff0af8236fc84d82bf84c8d2d11c11ca => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:27.722454 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac442d-d412-4c9f-96fd-bfb266bf64b5 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:27.780417 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa1cbe-63ca-4815-af65-9f7078952101 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:27.820484 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:27.833703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7b244-583c-44a0-a92a-41544f586f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:27.835770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7b244-583c-44a0-a92a-41544f586f65 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:27.835770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7b244-583c-44a0-a92a-41544f586f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:27.835770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7b244-583c-44a0-a92a-41544f586f65 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:27.848266 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7b244-583c-44a0-a92a-41544f586f65 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:27.850442 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7b244-583c-44a0-a92a-41544f586f65 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:27.850890 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac442d-d412-4c9f-96fd-bfb266bf64b5 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:27.868078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-2af7b244-583c-44a0-a92a-41544f586f65 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 18:25:27.868078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:27.868078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:27.868078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:27.868078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:27.868078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:27.868078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:27.868078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:27.868078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:27.868078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:27.868078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:27.868078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:27.868078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:27.868078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:27.868078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:27.868078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:27.869666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:27.869666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:27.869666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:27.869666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:27.869666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:27.869666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:27.869666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:27.869666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:27.869666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:27.869666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:27.869666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:27.869666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:27.869666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:27.869666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:27.869666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:27.869666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:27.869666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:27.869666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:27.870628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:27.870628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:27.870628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:27.870628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:27.870628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:27.870628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:27.870628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:27.870628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:27.870628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 18:25:27.870628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:27.871185 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 297/594] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:25:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:27.871772 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7b244-583c-44a0-a92a-41544f586f65 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:27.910062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc137542-8d7a-45b2-86f5-23db80e9df9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:27.910745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc137542-8d7a-45b2-86f5-23db80e9df9f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:27.911127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc137542-8d7a-45b2-86f5-23db80e9df9f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:27.911439 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc137542-8d7a-45b2-86f5-23db80e9df9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:27.919691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc137542-8d7a-45b2-86f5-23db80e9df9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:27.921248 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc137542-8d7a-45b2-86f5-23db80e9df9f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:27.932266 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:27.937141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-fc137542-8d7a-45b2-86f5-23db80e9df9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:27.937141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:27.937141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:27.937141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:27.937141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:27.937141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:27.937141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:27.937141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:27.937141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:27.937141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:27.937141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:27.937141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:27.937141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:27.937141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:27.937141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:27.938655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:27.938655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:27.938655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:27.938655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:27.938655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:27.938655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:27.938655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:27.938655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:27.938655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:27.938655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:27.938655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:27.938655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:27.938655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:27.938655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:27.938655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:27.938655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:27.938655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:27.939743 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:27.939743 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:27.939743 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:27.939743 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:27.939743 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:27.939743 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:27.939743 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:27.939743 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:27.939743 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 298/595] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:27.940713 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc137542-8d7a-45b2-86f5-23db80e9df9f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:28.010574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7b244-583c-44a0-a92a-41544f586f65 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:28.047492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eaa46c-937a-41be-af79-dbcd1617633c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:28.048122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaa46c-937a-41be-af79-dbcd1617633c None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:28.048398 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaa46c-937a-41be-af79-dbcd1617633c None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:28.048779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaa46c-937a-41be-af79-dbcd1617633c None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:28.049370 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eaa46c-937a-41be-af79-dbcd1617633c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:28.049672 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eaa46c-937a-41be-af79-dbcd1617633c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:28.051180 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eaa46c-937a-41be-af79-dbcd1617633c None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:28.064634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 298/596] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:28.065496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eaa46c-937a-41be-af79-dbcd1617633c None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:28.074465 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc137542-8d7a-45b2-86f5-23db80e9df9f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:28.119505 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0eca1e-5637-422c-bd43-a3cdf808601d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:28.120136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0eca1e-5637-422c-bd43-a3cdf808601d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:28.120415 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0eca1e-5637-422c-bd43-a3cdf808601d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:28.120734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0eca1e-5637-422c-bd43-a3cdf808601d None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:28.121531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0eca1e-5637-422c-bd43-a3cdf808601d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:28.121835 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0eca1e-5637-422c-bd43-a3cdf808601d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:28.123391 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0eca1e-5637-422c-bd43-a3cdf808601d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:28.126166 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:28.149135 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 299/597] 10.222.0.65 () {56 vars in 1139 bytes} [Wed Jul 27 18:25:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:28.150094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0eca1e-5637-422c-bd43-a3cdf808601d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:28.197952 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eaa46c-937a-41be-af79-dbcd1617633c None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:28.212306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:28.254111 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fcd9d-19ea-4e12-90da-81304d47f64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:28.254852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fcd9d-19ea-4e12-90da-81304d47f64a None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:28.255135 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fcd9d-19ea-4e12-90da-81304d47f64a None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:28.255440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fcd9d-19ea-4e12-90da-81304d47f64a None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:28.256211 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36fcd9d-19ea-4e12-90da-81304d47f64a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:28.256506 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36fcd9d-19ea-4e12-90da-81304d47f64a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:28.258254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36fcd9d-19ea-4e12-90da-81304d47f64a None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:28.264683 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0eca1e-5637-422c-bd43-a3cdf808601d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:28.277762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 299/598] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:28.279163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fcd9d-19ea-4e12-90da-81304d47f64a None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:28.307822 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce67d4-1344-4c19-a61f-54b8f0d45d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:28.308842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce67d4-1344-4c19-a61f-54b8f0d45d04 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:28.309331 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce67d4-1344-4c19-a61f-54b8f0d45d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:28.309975 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce67d4-1344-4c19-a61f-54b8f0d45d04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:28.318093 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce67d4-1344-4c19-a61f-54b8f0d45d04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:28.319898 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce67d4-1344-4c19-a61f-54b8f0d45d04 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:28.336734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-61ce67d4-1344-4c19-a61f-54b8f0d45d04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:28.336734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:28.336734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:28.336734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:28.336734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:28.336734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:28.336734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:28.336734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:28.336734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:28.336734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:28.336734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:28.336734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:28.336734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:28.336734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:28.336734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:28.337721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:28.337721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:28.337721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:28.337721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:28.337721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:28.337721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:28.337721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:28.337721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:28.337721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:28.337721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:28.337721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:28.337721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:28.337721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:28.337721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:28.337721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:28.337721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:28.337721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:28.338651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:28.338651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:28.338651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:28.338651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:28.338651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:28.338651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:28.338651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:28.338651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:28.341657 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 300/599] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:28.347569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce67d4-1344-4c19-a61f-54b8f0d45d04 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:28.417742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fcd9d-19ea-4e12-90da-81304d47f64a None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:28.434076 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:28.459895 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313b1d9-551c-4f54-bcc0-6b4bd4ae5267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:28.460989 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313b1d9-551c-4f54-bcc0-6b4bd4ae5267 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:28.461411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313b1d9-551c-4f54-bcc0-6b4bd4ae5267 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:28.461821 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313b1d9-551c-4f54-bcc0-6b4bd4ae5267 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:28.478307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313b1d9-551c-4f54-bcc0-6b4bd4ae5267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:28.480332 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313b1d9-551c-4f54-bcc0-6b4bd4ae5267 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:28.493104 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce67d4-1344-4c19-a61f-54b8f0d45d04 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:28.503004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-8313b1d9-551c-4f54-bcc0-6b4bd4ae5267 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:28.503004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:28.503004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:28.503004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:28.503004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:28.503004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:28.503004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:28.503004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:28.503004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:28.503004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:28.503004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:28.503004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:28.503004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:28.503004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:28.503004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:28.504323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:28.504323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:28.504323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:28.504323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:28.504323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:28.504323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:28.504323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:28.504323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:28.504323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:28.504323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:28.504323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:28.504323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:28.504323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:28.504323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:28.504323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:28.504323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:28.504323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:28.505418 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:28.505418 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:28.505418 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:28.505418 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:28.511287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 300/600] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:28.511287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313b1d9-551c-4f54-bcc0-6b4bd4ae5267 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:28.534509 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d2889-87bb-4d0e-bd64-b351aa33c31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:28.535347 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d2889-87bb-4d0e-bd64-b351aa33c31b None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:28.535644 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d2889-87bb-4d0e-bd64-b351aa33c31b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:28.535975 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d2889-87bb-4d0e-bd64-b351aa33c31b None admin] PATH_INFO: `/v3/projects/2880a34079d742c38bfdace2c04564c7/users/be769d4dd016466f9174e7d5e47a2a0d/roles/ff0af8236fc84d82bf84c8d2d11c11ca` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:28.544355 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:28.556315 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d2889-87bb-4d0e-bd64-b351aa33c31b None admin] RBAC: Authorizing `identity:create_grant(project_id=2880a34079d742c38bfdace2c04564c7, user_id=be769d4dd016466f9174e7d5e47a2a0d, role_id=ff0af8236fc84d82bf84c8d2d11c11ca)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:28.557768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d2889-87bb-4d0e-bd64-b351aa33c31b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:28.626828 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313b1d9-551c-4f54-bcc0-6b4bd4ae5267 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:28.662491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 301/601] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:25:28 2022] PUT /identity/v3/projects/2880a34079d742c38bfdace2c04564c7/users/be769d4dd016466f9174e7d5e47a2a0d/roles/ff0af8236fc84d82bf84c8d2d11c11ca => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:28.662887 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861322c4-1a45-4743-99e5-65b7c64d9645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:28.663830 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861322c4-1a45-4743-99e5-65b7c64d9645 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:28.664222 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330bf7a-f667-4e86-aa46-6c70137f95cc None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:28.664539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861322c4-1a45-4743-99e5-65b7c64d9645 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:28.664749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330bf7a-f667-4e86-aa46-6c70137f95cc None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:28.665114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861322c4-1a45-4743-99e5-65b7c64d9645 None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:28.665235 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330bf7a-f667-4e86-aa46-6c70137f95cc None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:28.666291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861322c4-1a45-4743-99e5-65b7c64d9645 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:28.666809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861322c4-1a45-4743-99e5-65b7c64d9645 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:28.668533 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861322c4-1a45-4743-99e5-65b7c64d9645 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:28.671895 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 302/602] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:28.672975 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330bf7a-f667-4e86-aa46-6c70137f95cc None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:28.684849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 301/603] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:28.686542 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d742b-ec16-47c7-9682-d32c3247d879 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:28.686965 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d742b-ec16-47c7-9682-d32c3247d879 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:28.687475 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d742b-ec16-47c7-9682-d32c3247d879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:28.709948 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-111d742b-ec16-47c7-9682-d32c3247d879 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:28.711241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-111d742b-ec16-47c7-9682-d32c3247d879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:28.808813 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 302/604] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:28.810427 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d742b-ec16-47c7-9682-d32c3247d879 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:28.814589 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330bf7a-f667-4e86-aa46-6c70137f95cc None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:28.823962 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:28.838875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:28.871671 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640bfda-0235-46de-bba2-9f46383f8ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:28.872302 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640bfda-0235-46de-bba2-9f46383f8ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:28.872583 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640bfda-0235-46de-bba2-9f46383f8ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:28.872857 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640bfda-0235-46de-bba2-9f46383f8ec2 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:28.873558 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640bfda-0235-46de-bba2-9f46383f8ec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:28.873861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640bfda-0235-46de-bba2-9f46383f8ec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:28.876159 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640bfda-0235-46de-bba2-9f46383f8ec2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:28.889200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 303/605] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:28.890069 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640bfda-0235-46de-bba2-9f46383f8ec2 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:28.959796 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d742b-ec16-47c7-9682-d32c3247d879 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:29.006839 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0d273-57e9-44ea-b2a3-f0bf5e8fa066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:29.007550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0d273-57e9-44ea-b2a3-f0bf5e8fa066 None admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:29.007838 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0d273-57e9-44ea-b2a3-f0bf5e8fa066 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:29.008121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0d273-57e9-44ea-b2a3-f0bf5e8fa066 None admin] PATH_INFO: `/v3/projects/2880a34079d742c38bfdace2c04564c7/users/d49a34cd99ab47bb92af6ed2f82fefde/roles/ff0af8236fc84d82bf84c8d2d11c11ca` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:29.009031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640bfda-0235-46de-bba2-9f46383f8ec2 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:29.027311 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0d273-57e9-44ea-b2a3-f0bf5e8fa066 None admin] RBAC: Authorizing `identity:create_grant(project_id=2880a34079d742c38bfdace2c04564c7, user_id=d49a34cd99ab47bb92af6ed2f82fefde, role_id=ff0af8236fc84d82bf84c8d2d11c11ca)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:29.029453 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0d273-57e9-44ea-b2a3-f0bf5e8fa066 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:29.049770 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0933e6-68f3-4129-b714-be11cd7d0050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:29.050809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0933e6-68f3-4129-b714-be11cd7d0050 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:29.051254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0933e6-68f3-4129-b714-be11cd7d0050 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:29.052084 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0933e6-68f3-4129-b714-be11cd7d0050 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:29.063190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0933e6-68f3-4129-b714-be11cd7d0050 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:29.068905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-6a0933e6-68f3-4129-b714-be11cd7d0050 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:29.068905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:29.068905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:29.068905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:29.068905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:29.068905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:29.068905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:29.068905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:29.068905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:29.068905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:29.068905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:29.068905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:29.068905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:29.068905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:29.068905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:29.068905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:29.069873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:29.069873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:29.069873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:29.069873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:29.069873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:29.069873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:29.069873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:29.069873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:29.069873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:29.069873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:29.069873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:29.069873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:29.069873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:29.069873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:29.069873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:29.069873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:29.070887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:29.070887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:29.070887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:29.070887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:29.070887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:29.070887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:29.070887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:29.070887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:29.070887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:29.070887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:29.070887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:29.070887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:29.077127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 304/606] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:25:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:29.077127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0933e6-68f3-4129-b714-be11cd7d0050 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:29.100648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:29.143628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 303/607] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:25:28 2022] PUT /identity/v3/projects/2880a34079d742c38bfdace2c04564c7/users/d49a34cd99ab47bb92af6ed2f82fefde/roles/ff0af8236fc84d82bf84c8d2d11c11ca => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:29.144578 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0d273-57e9-44ea-b2a3-f0bf5e8fa066 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:29.199713 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0933e6-68f3-4129-b714-be11cd7d0050 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:29.242716 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20aeff5-2fb9-49f6-b4c1-a4b49244cec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:29.243995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20aeff5-2fb9-49f6-b4c1-a4b49244cec9 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:29.244996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20aeff5-2fb9-49f6-b4c1-a4b49244cec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:29.245507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20aeff5-2fb9-49f6-b4c1-a4b49244cec9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:29.255403 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20aeff5-2fb9-49f6-b4c1-a4b49244cec9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:29.258564 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20aeff5-2fb9-49f6-b4c1-a4b49244cec9 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:29.272984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-c20aeff5-2fb9-49f6-b4c1-a4b49244cec9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:29.272984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:29.272984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:29.272984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:29.272984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:29.272984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:29.272984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:29.272984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:29.272984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:29.272984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:29.272984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:29.272984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:29.272984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:29.272984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:29.272984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:29.273967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:29.273967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:29.273967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:29.273967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:29.273967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:29.273967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:29.273967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:29.273967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:29.273967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:29.273967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:29.273967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:29.273967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:29.273967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:29.273967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:29.273967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:29.273967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:29.273967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:29.274897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:29.274897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:29.274897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:29.274897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:29.274897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:29.274897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:29.274897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:29.274897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:29.278022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 305/608] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:29.285066 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20aeff5-2fb9-49f6-b4c1-a4b49244cec9 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:29.322016 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:29.387926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0d273-57e9-44ea-b2a3-f0bf5e8fa066 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:29.417984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:29.429617 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e31a6-7cf5-4585-9300-7bae8b26cadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:29.443308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e31a6-7cf5-4585-9300-7bae8b26cadb None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:29.443308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e31a6-7cf5-4585-9300-7bae8b26cadb None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:29.443308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e31a6-7cf5-4585-9300-7bae8b26cadb None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:29.443308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e31a6-7cf5-4585-9300-7bae8b26cadb None admin] RBAC: Adding query filter params (name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:29.443308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e31a6-7cf5-4585-9300-7bae8b26cadb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:29.443308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e31a6-7cf5-4585-9300-7bae8b26cadb None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:29.443979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20aeff5-2fb9-49f6-b4c1-a4b49244cec9 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:29.444101 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 304/609] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 18:25:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:29.449223 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e31a6-7cf5-4585-9300-7bae8b26cadb None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:29.475921 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ecab1-7fcc-4de1-9a51-4f0daebd7a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:29.476547 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ecab1-7fcc-4de1-9a51-4f0daebd7a94 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:29.476830 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ecab1-7fcc-4de1-9a51-4f0daebd7a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:29.477107 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ecab1-7fcc-4de1-9a51-4f0daebd7a94 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:29.477863 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ecab1-7fcc-4de1-9a51-4f0daebd7a94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:29.478172 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ecab1-7fcc-4de1-9a51-4f0daebd7a94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:29.479662 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ecab1-7fcc-4de1-9a51-4f0daebd7a94 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:29.495055 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 306/610] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:29.504691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ecab1-7fcc-4de1-9a51-4f0daebd7a94 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:29.563811 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e31a6-7cf5-4585-9300-7bae8b26cadb None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:29.591807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:29.600793 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653e864-44e2-40df-81dc-933de239f289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:29.601600 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653e864-44e2-40df-81dc-933de239f289 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:29.601992 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653e864-44e2-40df-81dc-933de239f289 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:29.602374 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653e864-44e2-40df-81dc-933de239f289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:29.614542 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653e864-44e2-40df-81dc-933de239f289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:29.616186 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653e864-44e2-40df-81dc-933de239f289 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:29.632507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-f653e864-44e2-40df-81dc-933de239f289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:29.632507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:29.632507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:29.632507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:29.632507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:29.632507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:29.632507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:29.632507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:29.632507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:29.632507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:29.632507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:29.632507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:29.632507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:29.632507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:29.632507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:29.633459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:29.633459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:29.633459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:29.633459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:29.633459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:29.633459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:29.633459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:29.633459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:29.633459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:29.633459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:29.633459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:29.633459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:29.633459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:29.633459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:29.633459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:29.633459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:29.633459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:29.634445 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:29.634445 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:29.634445 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:29.634445 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:29.634445 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 305/611] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:25:29.639539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653e864-44e2-40df-81dc-933de239f289 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:29.745613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653e864-44e2-40df-81dc-933de239f289 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:29.770279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ecab1-7fcc-4de1-9a51-4f0daebd7a94 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:29.782725 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d660c31-9890-4c09-93e8-95356d668eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:29.783384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d660c31-9890-4c09-93e8-95356d668eca None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:29.783674 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d660c31-9890-4c09-93e8-95356d668eca None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:29.783952 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d660c31-9890-4c09-93e8-95356d668eca None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:29.784759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d660c31-9890-4c09-93e8-95356d668eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:29.785099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d660c31-9890-4c09-93e8-95356d668eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:29.786549 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d660c31-9890-4c09-93e8-95356d668eca None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:29.800195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 306/612] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:29.805716 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d660c31-9890-4c09-93e8-95356d668eca None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:29.845071 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943f302-2bae-41bb-b320-6668ed2cbb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:29.845915 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943f302-2bae-41bb-b320-6668ed2cbb2c None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:29.846204 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943f302-2bae-41bb-b320-6668ed2cbb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:29.846483 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943f302-2bae-41bb-b320-6668ed2cbb2c None admin] PATH_INFO: `/v3/projects/2880a34079d742c38bfdace2c04564c7/users/ffee4a13d4fd4f86bd1c79b4535a0c55/roles/ff0af8236fc84d82bf84c8d2d11c11ca` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:29.874677 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943f302-2bae-41bb-b320-6668ed2cbb2c None admin] RBAC: Authorizing `identity:create_grant(project_id=2880a34079d742c38bfdace2c04564c7, user_id=ffee4a13d4fd4f86bd1c79b4535a0c55, role_id=ff0af8236fc84d82bf84c8d2d11c11ca)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:29.877475 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943f302-2bae-41bb-b320-6668ed2cbb2c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:29.880262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:29.882431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:29.954598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d660c31-9890-4c09-93e8-95356d668eca None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:29.967173 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 307/613] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:25:29 2022] PUT /identity/v3/projects/2880a34079d742c38bfdace2c04564c7/users/ffee4a13d4fd4f86bd1c79b4535a0c55/roles/ff0af8236fc84d82bf84c8d2d11c11ca => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:30.003736 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414c3df-0f0d-4d1b-bc9f-d8e3f1734425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:30.004499 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414c3df-0f0d-4d1b-bc9f-d8e3f1734425 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:30.004889 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414c3df-0f0d-4d1b-bc9f-d8e3f1734425 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:30.005272 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414c3df-0f0d-4d1b-bc9f-d8e3f1734425 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:30.014380 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414c3df-0f0d-4d1b-bc9f-d8e3f1734425 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:30.016083 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414c3df-0f0d-4d1b-bc9f-d8e3f1734425 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:30.017993 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4faf5-7273-4d26-a8ee-68192adff5c1 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:30.018475 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4faf5-7273-4d26-a8ee-68192adff5c1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:30.018645 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4faf5-7273-4d26-a8ee-68192adff5c1 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:30.020505 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 308/614] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:30.025939 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056bbae-5d8d-4d2e-8c06-8eb51fbcf1dd None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:30.026295 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056bbae-5d8d-4d2e-8c06-8eb51fbcf1dd None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:30.026573 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056bbae-5d8d-4d2e-8c06-8eb51fbcf1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:30.030465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-5414c3df-0f0d-4d1b-bc9f-d8e3f1734425 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:25:30.030465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:30.030465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:30.030465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:30.030465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:30.030465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:30.030465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:30.030465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:30.030465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:30.030465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:30.030465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:30.030465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:30.030465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:30.030465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:30.030465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:30.030465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:30.031450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:30.031450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:30.031450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:30.031450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:30.031450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:30.031450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:30.031450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:30.031450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:30.031450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:30.031450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:30.031450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:30.031450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:30.031450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:30.031450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:30.031450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:30.031450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:30.031450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:30.031450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:30.033359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:30.033359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:30.033359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:30.033359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:30.033359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:30.033359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:30.033359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:30.033359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:30.033359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:25:30.033359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:30.033359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 307/615] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:25:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:30.038603 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414c3df-0f0d-4d1b-bc9f-d8e3f1734425 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:30.048764 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-7056bbae-5d8d-4d2e-8c06-8eb51fbcf1dd None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:30.050300 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7056bbae-5d8d-4d2e-8c06-8eb51fbcf1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:30.210065 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 309/616] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:30.221065 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:30.230995 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414c3df-0f0d-4d1b-bc9f-d8e3f1734425 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:30.239896 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056bbae-5d8d-4d2e-8c06-8eb51fbcf1dd None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:30.270129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f288cc-a95a-4c01-bc23-8eed95ee63b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:30.270684 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f288cc-a95a-4c01-bc23-8eed95ee63b5 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:30.270970 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f288cc-a95a-4c01-bc23-8eed95ee63b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:30.271250 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f288cc-a95a-4c01-bc23-8eed95ee63b5 None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:30.272094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f288cc-a95a-4c01-bc23-8eed95ee63b5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:30.272411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f288cc-a95a-4c01-bc23-8eed95ee63b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:30.273883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f288cc-a95a-4c01-bc23-8eed95ee63b5 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:30.293576 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 308/617] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Jul 27 18:25:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:30.300927 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f288cc-a95a-4c01-bc23-8eed95ee63b5 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:30.411863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f288cc-a95a-4c01-bc23-8eed95ee63b5 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:30.449361 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b827b-cde5-463d-9cc0-546c7ba91cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:30.449707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056bbae-5d8d-4d2e-8c06-8eb51fbcf1dd None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:30.450012 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b827b-cde5-463d-9cc0-546c7ba91cfd None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:30.450297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b827b-cde5-463d-9cc0-546c7ba91cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:30.450574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b827b-cde5-463d-9cc0-546c7ba91cfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:30.471088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b827b-cde5-463d-9cc0-546c7ba91cfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:30.472726 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b827b-cde5-463d-9cc0-546c7ba91cfd None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:30.491275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-487b827b-cde5-463d-9cc0-546c7ba91cfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:30.491275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:30.491275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:30.491275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:30.491275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:30.491275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:30.491275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:30.491275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:30.491275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:30.491275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:30.491275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:30.491275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:30.491275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:30.491275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:30.491275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:30.492247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:30.492247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:30.492247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:30.492247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:30.492247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:30.492247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:30.492247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:30.492247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:30.492247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:30.492247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:30.492247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:30.492247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:30.492247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:30.492247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:30.492247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:30.492247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:30.492247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:30.493722 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:30.493722 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:30.493722 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:30.493722 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:30.493722 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 309/618] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:25:30.501996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b827b-cde5-463d-9cc0-546c7ba91cfd None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:30.505523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:30.511535 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:30.526159 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f330f2-5742-44e9-bd70-9bcbe3f5cd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:30.526757 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f330f2-5742-44e9-bd70-9bcbe3f5cd89 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:30.527043 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f330f2-5742-44e9-bd70-9bcbe3f5cd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:30.527346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f330f2-5742-44e9-bd70-9bcbe3f5cd89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:30.556852 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f330f2-5742-44e9-bd70-9bcbe3f5cd89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:30.562412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-45f330f2-5742-44e9-bd70-9bcbe3f5cd89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:30.562412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:30.562412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:30.562412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:30.562412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:30.562412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:30.562412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:30.562412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:30.562412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:30.562412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:30.562412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:30.562412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:30.562412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:30.562412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:30.562412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:30.562412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:30.565866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:30.565866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:30.565866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:30.565866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:30.565866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:30.565866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:30.565866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:30.565866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:30.565866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:30.565866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:30.565866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:30.565866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:30.565866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:30.565866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:30.565866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:30.565866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:30.566731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:30.566731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:30.566731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:30.566731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:30.566731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:30.566731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:30.566731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:30.566731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:30.566731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:30.566731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:30.566731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:30.566731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:30.566731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 310/619] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:25:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:30.577112 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f330f2-5742-44e9-bd70-9bcbe3f5cd89 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:30.665074 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b827b-cde5-463d-9cc0-546c7ba91cfd None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:30.703197 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebf777-5bbe-4801-96de-052f5f2268b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:30.704790 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebf777-5bbe-4801-96de-052f5f2268b8 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:30.705213 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebf777-5bbe-4801-96de-052f5f2268b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:30.705490 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebf777-5bbe-4801-96de-052f5f2268b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:30.706198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebf777-5bbe-4801-96de-052f5f2268b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:30.706504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebf777-5bbe-4801-96de-052f5f2268b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:30.707978 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebf777-5bbe-4801-96de-052f5f2268b8 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:30.720857 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 310/620] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:30.735301 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebf777-5bbe-4801-96de-052f5f2268b8 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:30.794467 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f330f2-5742-44e9-bd70-9bcbe3f5cd89 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:30.795519 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:30.841128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebf777-5bbe-4801-96de-052f5f2268b8 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:30.880358 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200dace2-546d-42d3-9acb-5f30c9b9b0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:30.881083 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dace2-546d-42d3-9acb-5f30c9b9b0ff None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:30.881498 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dace2-546d-42d3-9acb-5f30c9b9b0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:30.881841 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dace2-546d-42d3-9acb-5f30c9b9b0ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:30.885796 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbe3da-f1a4-4646-a353-71313ee71285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:30.886433 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbe3da-f1a4-4646-a353-71313ee71285 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:30.886715 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbe3da-f1a4-4646-a353-71313ee71285 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:30.886992 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbe3da-f1a4-4646-a353-71313ee71285 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:30.887753 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbe3da-f1a4-4646-a353-71313ee71285 None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:30.888062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbe3da-f1a4-4646-a353-71313ee71285 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:30.889449 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbe3da-f1a4-4646-a353-71313ee71285 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:30.889909 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200dace2-546d-42d3-9acb-5f30c9b9b0ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:30.892281 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200dace2-546d-42d3-9acb-5f30c9b9b0ff None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:30.904998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-200dace2-546d-42d3-9acb-5f30c9b9b0ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:30.904998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:30.904998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:30.904998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:30.904998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:30.904998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:30.904998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:30.904998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:30.904998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:30.904998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:30.904998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:30.904998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:30.904998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:30.904998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:30.904998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:30.905968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:30.905968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:30.905968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:30.905968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:30.905968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:30.905968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:30.905968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:30.905968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:30.905968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:30.905968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:30.905968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:30.905968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:30.905968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:30.905968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:30.905968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:30.905968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:30.905968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:30.907494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:30.907494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:30.907494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:30.907494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:30.907494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:30.907494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:30.907494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:30.907494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:30.907494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 311/621] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:25:30.913147 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200dace2-546d-42d3-9acb-5f30c9b9b0ff None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:30.913742 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 311/622] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 18:25:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:30.930674 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbe3da-f1a4-4646-a353-71313ee71285 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:31.045621 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:31.178102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200dace2-546d-42d3-9acb-5f30c9b9b0ff None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:31.197543 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbe3da-f1a4-4646-a353-71313ee71285 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:31.206700 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:31.221128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028b122-6239-486a-8865-185d6b607b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:31.222059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028b122-6239-486a-8865-185d6b607b88 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:31.222587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028b122-6239-486a-8865-185d6b607b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:31.223053 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028b122-6239-486a-8865-185d6b607b88 None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:31.224045 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028b122-6239-486a-8865-185d6b607b88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:31.224583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028b122-6239-486a-8865-185d6b607b88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:31.226260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028b122-6239-486a-8865-185d6b607b88 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:31.240517 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 312/623] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:31.246926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028b122-6239-486a-8865-185d6b607b88 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:31.271051 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25067ea-b234-49fb-ba5e-13ff9bf378be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:31.271741 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25067ea-b234-49fb-ba5e-13ff9bf378be None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:31.272028 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25067ea-b234-49fb-ba5e-13ff9bf378be None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:31.272297 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25067ea-b234-49fb-ba5e-13ff9bf378be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:31.286503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25067ea-b234-49fb-ba5e-13ff9bf378be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:31.288814 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25067ea-b234-49fb-ba5e-13ff9bf378be None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:31.306600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-b25067ea-b234-49fb-ba5e-13ff9bf378be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:31.306600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:31.306600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:31.306600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:31.306600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:31.306600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:31.306600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:31.306600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:31.306600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:31.306600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:31.306600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:31.306600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:31.306600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:31.306600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:31.306600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:31.307569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:31.307569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:31.307569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:31.307569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:31.307569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:31.307569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:31.307569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:31.307569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:31.307569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:31.307569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:31.307569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:31.307569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:31.307569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:31.307569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:31.307569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:31.307569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:31.307569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:31.308466 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:31.308466 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:31.308466 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:31.308466 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:31.311331 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 312/624] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:31.312816 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04bf01-e30c-4941-9c13-c82db0451180 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:31.314141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04bf01-e30c-4941-9c13-c82db0451180 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:31.314543 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04bf01-e30c-4941-9c13-c82db0451180 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:31.316137 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 313/625] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:31.316924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04bf01-e30c-4941-9c13-c82db0451180 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:31.363512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028b122-6239-486a-8865-185d6b607b88 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:31.404610 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff8b63-869a-4f12-8a7a-52901dcc3819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:31.405590 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff8b63-869a-4f12-8a7a-52901dcc3819 None admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:31.406008 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff8b63-869a-4f12-8a7a-52901dcc3819 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:31.406358 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff8b63-869a-4f12-8a7a-52901dcc3819 None admin] PATH_INFO: `/v3/projects/2880a34079d742c38bfdace2c04564c7/users/7832398e97af4e539e10d1eef49f6d6f/roles/ff0af8236fc84d82bf84c8d2d11c11ca` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:31.424379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff8b63-869a-4f12-8a7a-52901dcc3819 None admin] RBAC: Authorizing `identity:create_grant(project_id=2880a34079d742c38bfdace2c04564c7, user_id=7832398e97af4e539e10d1eef49f6d6f, role_id=ff0af8236fc84d82bf84c8d2d11c11ca)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:31.425842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff8b63-869a-4f12-8a7a-52901dcc3819 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:31.434348 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:31.442389 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04bf01-e30c-4941-9c13-c82db0451180 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:31.478763 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119114d-07a1-4331-8442-c7e35462de63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:31.479434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119114d-07a1-4331-8442-c7e35462de63 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:31.479730 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119114d-07a1-4331-8442-c7e35462de63 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:31.480010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119114d-07a1-4331-8442-c7e35462de63 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:31.480693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119114d-07a1-4331-8442-c7e35462de63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:31.481005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119114d-07a1-4331-8442-c7e35462de63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:31.482382 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119114d-07a1-4331-8442-c7e35462de63 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:31.498928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 314/626] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:31.498928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde40437-8746-4e69-88c3-548fc496de55 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:31.498928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde40437-8746-4e69-88c3-548fc496de55 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:31.498928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde40437-8746-4e69-88c3-548fc496de55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:31.520942 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-fde40437-8746-4e69-88c3-548fc496de55 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:31.527287 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-fde40437-8746-4e69-88c3-548fc496de55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:31.528073 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 313/627] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:25:31 2022] PUT /identity/v3/projects/2880a34079d742c38bfdace2c04564c7/users/7832398e97af4e539e10d1eef49f6d6f/roles/ff0af8236fc84d82bf84c8d2d11c11ca => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:25:31.530219 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff8b63-869a-4f12-8a7a-52901dcc3819 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:31.635216 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:31.683328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 315/628] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:31.698477 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a7fda-bb1a-4cd4-ab0d-6367a6a2979d None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:31.698792 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a7fda-bb1a-4cd4-ab0d-6367a6a2979d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:31.699039 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a7fda-bb1a-4cd4-ab0d-6367a6a2979d None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:31.700462 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 316/629] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:25:31.706746 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918e753-56d9-41ad-95b2-1c7179e08d91 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:31.707084 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918e753-56d9-41ad-95b2-1c7179e08d91 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:31.707330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918e753-56d9-41ad-95b2-1c7179e08d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:31.728420 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-1918e753-56d9-41ad-95b2-1c7179e08d91 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:31.729643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1918e753-56d9-41ad-95b2-1c7179e08d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:31.754054 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff8b63-869a-4f12-8a7a-52901dcc3819 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:31.792208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4710d5-ae45-417d-9dee-39d5ddff89e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:31.792689 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4710d5-ae45-417d-9dee-39d5ddff89e6 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:31.792975 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4710d5-ae45-417d-9dee-39d5ddff89e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:31.793251 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4710d5-ae45-417d-9dee-39d5ddff89e6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:31.802266 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4710d5-ae45-417d-9dee-39d5ddff89e6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:31.804028 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4710d5-ae45-417d-9dee-39d5ddff89e6 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:31.816765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-4b4710d5-ae45-417d-9dee-39d5ddff89e6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:25:31.816765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:31.816765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:31.816765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:31.816765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:31.816765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:31.816765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:31.816765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:31.816765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:31.816765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:31.816765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:31.816765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:31.816765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:31.816765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:31.816765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:31.816765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:31.817916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:31.817916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:31.817916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:31.817916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:31.817916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:31.817916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:31.817916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:31.817916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:31.817916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:31.817916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:31.817916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:31.817916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:31.817916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:31.817916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:31.817916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:31.817916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:31.817916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:31.817916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:31.818892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:31.818892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:31.818892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:31.818892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:31.818892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:31.818892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:31.818892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:31.818892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:31.818892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:25:31.818892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:31.822674 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 314/630] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:25:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:31.823588 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4710d5-ae45-417d-9dee-39d5ddff89e6 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:31.827052 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 317/631] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:31.829214 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918e753-56d9-41ad-95b2-1c7179e08d91 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:31.852325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:31.944215 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:31.954315 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4710d5-ae45-417d-9dee-39d5ddff89e6 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:31.966840 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918e753-56d9-41ad-95b2-1c7179e08d91 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:32.005598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00528a0-7420-46d0-9a7c-00e95736a67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:32.006277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00528a0-7420-46d0-9a7c-00e95736a67a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:32.006565 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00528a0-7420-46d0-9a7c-00e95736a67a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:32.006841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00528a0-7420-46d0-9a7c-00e95736a67a None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:32.007089 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da3556-31b2-4737-8adf-20d7fe0d8b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:32.007675 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00528a0-7420-46d0-9a7c-00e95736a67a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:32.007985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00528a0-7420-46d0-9a7c-00e95736a67a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:32.008402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da3556-31b2-4737-8adf-20d7fe0d8b2a None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:32.008901 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da3556-31b2-4737-8adf-20d7fe0d8b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:32.009388 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da3556-31b2-4737-8adf-20d7fe0d8b2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:32.009567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00528a0-7420-46d0-9a7c-00e95736a67a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:32.024634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da3556-31b2-4737-8adf-20d7fe0d8b2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:32.030849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-d0da3556-31b2-4737-8adf-20d7fe0d8b2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:32.030849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:32.030849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:32.030849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:32.030849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:32.030849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:32.030849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:32.030849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:32.030849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:32.030849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:32.030849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:32.030849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:32.030849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:32.030849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:32.030849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:32.030849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:32.032103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:32.032103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:32.032103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:32.032103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:32.032103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:32.032103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:32.032103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:32.032103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:32.032103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:32.032103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:32.032103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:32.032103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:32.032103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:32.032103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:32.032103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:32.032103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:32.032987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:32.032987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:32.032987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:32.032987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:32.032987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:32.032987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:32.032987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:32.032987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:32.032987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:32.032987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:32.032987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:32.032987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:32.033637 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 318/632] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Jul 27 18:25:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:32.034294 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00528a0-7420-46d0-9a7c-00e95736a67a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:32.036427 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 315/633] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:25:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:32.037819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da3556-31b2-4737-8adf-20d7fe0d8b2a None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:32.117299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:32.145099 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00528a0-7420-46d0-9a7c-00e95736a67a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:32.152470 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da3556-31b2-4737-8adf-20d7fe0d8b2a None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:32.183467 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d5d3b-d750-4fe3-a079-9f3358f46fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:32.184111 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d5d3b-d750-4fe3-a079-9f3358f46fed None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:32.184392 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d5d3b-d750-4fe3-a079-9f3358f46fed None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:32.184665 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d5d3b-d750-4fe3-a079-9f3358f46fed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:32.190922 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc68c9-0777-429e-87ed-7b82bc72ee12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:32.192195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc68c9-0777-429e-87ed-7b82bc72ee12 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:32.192687 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc68c9-0777-429e-87ed-7b82bc72ee12 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:32.193184 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc68c9-0777-429e-87ed-7b82bc72ee12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:32.196287 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d5d3b-d750-4fe3-a079-9f3358f46fed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:32.201264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-3c9d5d3b-d750-4fe3-a079-9f3358f46fed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:32.201264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:32.201264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:32.201264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:32.201264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:32.201264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:32.201264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:32.201264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:32.201264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:32.201264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:32.201264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:32.201264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:32.201264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:32.201264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:32.201264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:32.201264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:32.202207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:32.202207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:32.202207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:32.202207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:32.202207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:32.202207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:32.202207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:32.202207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:32.202207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:32.202207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:32.202207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:32.202207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:32.202207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:32.202207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:32.202207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:32.202207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:32.203062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:32.203062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:32.203062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:32.203062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:32.203062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:32.203062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:32.203062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:32.203062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:32.203062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:32.203062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:32.203062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:32.203062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:32.203062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 319/634] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:25:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:32.205266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d5d3b-d750-4fe3-a079-9f3358f46fed None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:32.224735 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:32.272161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc68c9-0777-429e-87ed-7b82bc72ee12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:32.274010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc68c9-0777-429e-87ed-7b82bc72ee12 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:32.318898 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d5d3b-d750-4fe3-a079-9f3358f46fed None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:32.358529 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707a35d-3a44-40ba-bd4a-c7ea91ac28b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:32.359158 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707a35d-3a44-40ba-bd4a-c7ea91ac28b2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:32.359487 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707a35d-3a44-40ba-bd4a-c7ea91ac28b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:32.360637 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707a35d-3a44-40ba-bd4a-c7ea91ac28b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:32.361185 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707a35d-3a44-40ba-bd4a-c7ea91ac28b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:32.361505 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707a35d-3a44-40ba-bd4a-c7ea91ac28b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:32.362910 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707a35d-3a44-40ba-bd4a-c7ea91ac28b2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:32.364567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:32.373524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 320/635] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 18:25:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:32.374893 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707a35d-3a44-40ba-bd4a-c7ea91ac28b2 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:32.386576 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 316/636] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:25:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:25:32.387768 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc68c9-0777-429e-87ed-7b82bc72ee12 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:32.448323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:32.493725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707a35d-3a44-40ba-bd4a-c7ea91ac28b2 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:32.493969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc68c9-0777-429e-87ed-7b82bc72ee12 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:32.531287 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1cbdf-24c4-4bd3-a04f-5706021bd993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:32.531918 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5d097-6c0d-454a-a855-33e0751db369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:32.532088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1cbdf-24c4-4bd3-a04f-5706021bd993 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:32.532308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1cbdf-24c4-4bd3-a04f-5706021bd993 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:32.532530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1cbdf-24c4-4bd3-a04f-5706021bd993 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:32.532639 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5d097-6c0d-454a-a855-33e0751db369 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:32.532836 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5d097-6c0d-454a-a855-33e0751db369 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:32.533122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5d097-6c0d-454a-a855-33e0751db369 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:32.533275 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1cbdf-24c4-4bd3-a04f-5706021bd993 None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:32.533550 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1cbdf-24c4-4bd3-a04f-5706021bd993 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:32.534921 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1cbdf-24c4-4bd3-a04f-5706021bd993 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:32.545951 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 321/637] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 18:25:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:32.546781 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1cbdf-24c4-4bd3-a04f-5706021bd993 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:32.553873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5d097-6c0d-454a-a855-33e0751db369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:32.555373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5d097-6c0d-454a-a855-33e0751db369 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:32.572384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-b1b5d097-6c0d-454a-a855-33e0751db369 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:32.572384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:32.572384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:32.572384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:32.572384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:32.572384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:32.572384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:32.572384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:32.572384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:32.572384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:32.572384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:32.572384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:32.572384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:32.572384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:32.572384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:32.573375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:32.573375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:32.573375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:32.573375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:32.573375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:32.573375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:32.573375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:32.573375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:32.573375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:32.573375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:32.573375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:32.573375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:32.573375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:32.573375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:32.573375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:32.573375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:32.573375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:32.574329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:32.574329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:32.574329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:32.574329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:32.575716 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 317/638] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:32.577186 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af4b9f-b044-4ee9-9620-902d8ee2313b None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:32.577794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af4b9f-b044-4ee9-9620-902d8ee2313b None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:32.579226 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af4b9f-b044-4ee9-9620-902d8ee2313b None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:32.580825 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 318/639] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:32.581863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af4b9f-b044-4ee9-9620-902d8ee2313b None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:32.626859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:32.673859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1cbdf-24c4-4bd3-a04f-5706021bd993 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:32.712474 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b1939-3922-4c83-9de3-85343b35d6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:32.713043 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b1939-3922-4c83-9de3-85343b35d6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:32.713320 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b1939-3922-4c83-9de3-85343b35d6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:32.713425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af4b9f-b044-4ee9-9620-902d8ee2313b None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:32.713602 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b1939-3922-4c83-9de3-85343b35d6f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:32.722025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:32.724638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b1939-3922-4c83-9de3-85343b35d6f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:32.726105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b1939-3922-4c83-9de3-85343b35d6f6 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:32.741500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-185b1939-3922-4c83-9de3-85343b35d6f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:32.741500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:32.741500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:32.741500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:32.741500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:32.741500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:32.741500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:32.741500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:32.741500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:32.741500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:32.741500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:32.741500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:32.741500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:32.741500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:32.741500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:32.742563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:32.742563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:32.742563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:32.742563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:32.742563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:32.742563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:32.742563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:32.742563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:32.742563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:32.742563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:32.742563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:32.742563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:32.742563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:32.742563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:32.742563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:32.742563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:32.742563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:32.743533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:32.743533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:32.743533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:32.743533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:32.743533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 322/640] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:32.743831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b1939-3922-4c83-9de3-85343b35d6f6 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:32.759845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314299f-6368-4f39-9c3e-de9d6501c096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:32.760491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314299f-6368-4f39-9c3e-de9d6501c096 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:32.760769 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314299f-6368-4f39-9c3e-de9d6501c096 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:32.761117 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314299f-6368-4f39-9c3e-de9d6501c096 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:32.773910 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314299f-6368-4f39-9c3e-de9d6501c096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:32.775420 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314299f-6368-4f39-9c3e-de9d6501c096 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:32.790492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-6314299f-6368-4f39-9c3e-de9d6501c096 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:32.790492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:32.790492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:32.790492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:32.790492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:32.790492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:32.790492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:32.790492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:32.790492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:32.790492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:32.790492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:32.790492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:32.790492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:32.790492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:32.790492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:32.796956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:32.796956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:32.796956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:32.796956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:32.796956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:32.796956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:32.796956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:32.796956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:32.796956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:32.796956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:32.796956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:32.796956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:32.796956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:32.796956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:32.796956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:32.796956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:32.796956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:32.798780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:32.798780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:32.798780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:32.798780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:32.798780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 319/641] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:32.798780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cd21d-2f86-4199-8e86-dc4876d8e0fb None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:32.798780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cd21d-2f86-4199-8e86-dc4876d8e0fb None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:32.798780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cd21d-2f86-4199-8e86-dc4876d8e0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:32.824321 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-364cd21d-2f86-4199-8e86-dc4876d8e0fb None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:32.825630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-364cd21d-2f86-4199-8e86-dc4876d8e0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:32.866633 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b1939-3922-4c83-9de3-85343b35d6f6 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:32.878930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:32.902726 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 320/642] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:32.902726 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cd21d-2f86-4199-8e86-dc4876d8e0fb None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:32.907951 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643bbc4-d904-4106-a56a-4cdb032bf295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:32.909027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643bbc4-d904-4106-a56a-4cdb032bf295 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:32.909027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643bbc4-d904-4106-a56a-4cdb032bf295 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:32.909227 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643bbc4-d904-4106-a56a-4cdb032bf295 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:32.909776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643bbc4-d904-4106-a56a-4cdb032bf295 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:32.910604 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643bbc4-d904-4106-a56a-4cdb032bf295 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:32.911480 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643bbc4-d904-4106-a56a-4cdb032bf295 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:32.925362 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 323/643] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:32.926195 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643bbc4-d904-4106-a56a-4cdb032bf295 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:33.020046 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:33.034041 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cd21d-2f86-4199-8e86-dc4876d8e0fb None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:33.043676 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643bbc4-d904-4106-a56a-4cdb032bf295 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:33.072633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564f323-97dc-4e46-826a-ab991b41fe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:33.073257 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564f323-97dc-4e46-826a-ab991b41fe0e None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:33.073550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564f323-97dc-4e46-826a-ab991b41fe0e None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:33.073833 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564f323-97dc-4e46-826a-ab991b41fe0e None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:33.074605 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564f323-97dc-4e46-826a-ab991b41fe0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:33.074911 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564f323-97dc-4e46-826a-ab991b41fe0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:33.076390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564f323-97dc-4e46-826a-ab991b41fe0e None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:33.080174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c9457-fda0-4923-a3e0-44eee14aade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:33.080807 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c9457-fda0-4923-a3e0-44eee14aade9 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:33.081095 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c9457-fda0-4923-a3e0-44eee14aade9 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:33.081382 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c9457-fda0-4923-a3e0-44eee14aade9 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:33.082068 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c9457-fda0-4923-a3e0-44eee14aade9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:33.082377 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c9457-fda0-4923-a3e0-44eee14aade9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:33.083804 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c9457-fda0-4923-a3e0-44eee14aade9 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:33.093230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 321/644] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:33.093230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564f323-97dc-4e46-826a-ab991b41fe0e None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:33.099071 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 324/645] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:33.100207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c9457-fda0-4923-a3e0-44eee14aade9 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:33.143494 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:33.198599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564f323-97dc-4e46-826a-ab991b41fe0e None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:33.224591 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c9457-fda0-4923-a3e0-44eee14aade9 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:33.237847 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8352d-da02-473e-97aa-93224fef568a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:33.238755 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8352d-da02-473e-97aa-93224fef568a None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:33.239182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8352d-da02-473e-97aa-93224fef568a None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:33.239624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8352d-da02-473e-97aa-93224fef568a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:33.252715 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8352d-da02-473e-97aa-93224fef568a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:33.258463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-c8e8352d-da02-473e-97aa-93224fef568a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:33.258463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:33.258463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:33.258463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:33.258463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:33.258463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:33.258463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:33.258463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:33.258463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:33.258463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:33.258463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:33.258463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:33.258463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:33.258463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:33.258463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:33.258463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:33.259625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:33.259625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:33.259625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:33.259625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:33.259625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:33.259625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:33.259625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:33.259625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:33.259625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:33.259625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:33.259625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:33.259625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:33.259625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:33.259625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:33.259625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:33.259625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:33.260779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:33.260779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:33.260779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:33.260779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:33.260779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:33.260779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:33.260779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:33.260779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:33.260779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:33.260779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:33.260779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:33.260779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:33.263117 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 322/646] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:25:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:33.263324 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012ec40-15f1-4ccb-a33a-a98c61f71c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:33.264040 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012ec40-15f1-4ccb-a33a-a98c61f71c57 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:33.264326 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012ec40-15f1-4ccb-a33a-a98c61f71c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:33.264498 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8352d-da02-473e-97aa-93224fef568a None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:33.264590 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012ec40-15f1-4ccb-a33a-a98c61f71c57 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:33.276162 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012ec40-15f1-4ccb-a33a-a98c61f71c57 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:33.277570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012ec40-15f1-4ccb-a33a-a98c61f71c57 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:33.279940 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:33.290794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-3012ec40-15f1-4ccb-a33a-a98c61f71c57 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:25:33.290794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:33.290794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:33.290794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:33.290794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:33.290794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:33.290794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:33.290794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:33.290794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:33.290794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:33.290794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:33.290794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:33.290794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:33.290794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:33.290794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:33.290794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:33.298346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:33.298346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:33.298346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:33.298346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:33.298346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:33.298346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:33.298346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:33.298346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:33.298346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:33.298346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:33.298346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:33.298346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:33.298346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:33.298346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:33.298346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:33.298346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:33.298346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:33.298346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:33.299319 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:33.299319 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:33.299319 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:33.299319 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:33.299319 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:33.299319 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:33.299319 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:33.299319 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:33.299319 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:25:33.299319 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:33.299319 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 325/647] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 18:25:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:33.299319 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012ec40-15f1-4ccb-a33a-a98c61f71c57 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:33.397483 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8352d-da02-473e-97aa-93224fef568a None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:33.416308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:33.427002 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012ec40-15f1-4ccb-a33a-a98c61f71c57 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:33.435868 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b95751-566a-496e-ad88-596bd32153ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:33.438659 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b95751-566a-496e-ad88-596bd32153ee None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:33.438659 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b95751-566a-496e-ad88-596bd32153ee None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:33.438659 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b95751-566a-496e-ad88-596bd32153ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:33.445926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b95751-566a-496e-ad88-596bd32153ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:33.447420 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b95751-566a-496e-ad88-596bd32153ee None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:33.459681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-48b95751-566a-496e-ad88-596bd32153ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:33.459681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:33.459681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:33.459681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:33.459681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:33.459681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:33.459681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:33.459681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:33.459681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:33.459681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:33.459681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:33.459681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:33.459681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:33.459681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:33.459681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:33.460613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:33.460613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:33.460613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:33.460613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:33.460613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:33.460613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:33.460613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:33.460613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:33.460613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:33.460613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:33.460613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:33.460613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:33.460613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:33.460613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:33.460613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:33.460613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:33.460613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:33.461522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:33.461522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:33.461522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:33.461522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:33.461522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:33.461522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:33.461522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:33.461522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:33.461522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 323/648] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:33.462606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b95751-566a-496e-ad88-596bd32153ee None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:33.468172 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa69f1-b7aa-4199-b50e-4af5ea8c8b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:33.468826 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa69f1-b7aa-4199-b50e-4af5ea8c8b9a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:33.469213 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa69f1-b7aa-4199-b50e-4af5ea8c8b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:33.469494 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa69f1-b7aa-4199-b50e-4af5ea8c8b9a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:33.479649 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa69f1-b7aa-4199-b50e-4af5ea8c8b9a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:33.481134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa69f1-b7aa-4199-b50e-4af5ea8c8b9a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:33.494367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-abfa69f1-b7aa-4199-b50e-4af5ea8c8b9a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 18:25:33.494367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:33.494367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:33.494367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:33.494367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:33.494367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:33.494367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:33.494367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:33.494367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:33.494367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:33.494367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:33.494367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:33.494367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:33.494367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:33.494367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:33.494367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:33.495434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:33.495434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:33.495434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:33.495434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:33.495434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:33.495434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:33.495434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:33.495434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:33.495434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:33.495434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:33.495434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:33.495434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:33.495434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:33.495434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:33.495434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:33.495434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:33.495434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:33.495434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:33.496408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:33.496408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:33.496408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:33.496408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:33.496408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:33.496408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:33.496408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:33.496408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:33.496408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 18:25:33.496408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:33.496408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 326/649] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:25:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:33.497019 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa69f1-b7aa-4199-b50e-4af5ea8c8b9a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:33.548130 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:33.582584 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b95751-566a-496e-ad88-596bd32153ee None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:33.617756 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406cdc5-dddc-46b4-a196-7a1625a4626b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:33.618291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406cdc5-dddc-46b4-a196-7a1625a4626b None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:33.618566 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406cdc5-dddc-46b4-a196-7a1625a4626b None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:33.618837 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406cdc5-dddc-46b4-a196-7a1625a4626b None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:33.619582 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6406cdc5-dddc-46b4-a196-7a1625a4626b None admin] RBAC: Adding query filter params (name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:33.619886 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6406cdc5-dddc-46b4-a196-7a1625a4626b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:33.620494 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa69f1-b7aa-4199-b50e-4af5ea8c8b9a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:33.621251 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6406cdc5-dddc-46b4-a196-7a1625a4626b None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:33.636584 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 324/650] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 18:25:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:33.636584 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406cdc5-dddc-46b4-a196-7a1625a4626b None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:33.671141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b06a3-27b5-48d8-8ab3-6fbf01a2b93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:33.671781 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b06a3-27b5-48d8-8ab3-6fbf01a2b93d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:33.672111 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b06a3-27b5-48d8-8ab3-6fbf01a2b93d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:33.672536 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b06a3-27b5-48d8-8ab3-6fbf01a2b93d None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:33.673650 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b06a3-27b5-48d8-8ab3-6fbf01a2b93d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:33.673894 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b06a3-27b5-48d8-8ab3-6fbf01a2b93d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:33.675403 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b06a3-27b5-48d8-8ab3-6fbf01a2b93d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:33.693084 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 327/651] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 18:25:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:33.693919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b06a3-27b5-48d8-8ab3-6fbf01a2b93d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:33.705650 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:33.745393 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406cdc5-dddc-46b4-a196-7a1625a4626b None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:33.774939 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:33.781121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0ec6f-5c8c-4faa-b25f-5238cd83a9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:33.781770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0ec6f-5c8c-4faa-b25f-5238cd83a9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:33.782076 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0ec6f-5c8c-4faa-b25f-5238cd83a9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:33.782338 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0ec6f-5c8c-4faa-b25f-5238cd83a9e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:33.783085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0ec6f-5c8c-4faa-b25f-5238cd83a9e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:33.783426 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0ec6f-5c8c-4faa-b25f-5238cd83a9e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:33.784867 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0ec6f-5c8c-4faa-b25f-5238cd83a9e7 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:33.796692 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 325/652] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:33.796971 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b06a3-27b5-48d8-8ab3-6fbf01a2b93d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:33.797500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0ec6f-5c8c-4faa-b25f-5238cd83a9e7 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:33.837978 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197f74a-6183-4569-834e-c8aef89dab5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:33.838514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197f74a-6183-4569-834e-c8aef89dab5c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:33.838802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197f74a-6183-4569-834e-c8aef89dab5c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:33.839076 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197f74a-6183-4569-834e-c8aef89dab5c None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:33.839974 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197f74a-6183-4569-834e-c8aef89dab5c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:33.840290 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197f74a-6183-4569-834e-c8aef89dab5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:33.841735 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197f74a-6183-4569-834e-c8aef89dab5c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:33.860124 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 328/653] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Jul 27 18:25:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:33.861269 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f59d40-153a-4354-b217-cb07b0dc90bd None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:33.861557 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f59d40-153a-4354-b217-cb07b0dc90bd None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:33.861835 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f59d40-153a-4354-b217-cb07b0dc90bd None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:33.863075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 329/654] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:33.863797 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f59d40-153a-4354-b217-cb07b0dc90bd None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:33.910040 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0ec6f-5c8c-4faa-b25f-5238cd83a9e7 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:33.933440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:33.945048 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938be8b6-36a3-4206-810b-b57491168ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:33.946674 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938be8b6-36a3-4206-810b-b57491168ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:33.946674 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938be8b6-36a3-4206-810b-b57491168ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:33.946674 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938be8b6-36a3-4206-810b-b57491168ec1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:33.957325 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938be8b6-36a3-4206-810b-b57491168ec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:33.958771 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938be8b6-36a3-4206-810b-b57491168ec1 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:33.970729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f59d40-153a-4354-b217-cb07b0dc90bd None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:33.973810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-938be8b6-36a3-4206-810b-b57491168ec1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:33.973810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:33.973810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:33.973810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:33.973810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:33.973810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:33.973810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:33.973810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:33.973810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:33.973810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:33.973810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:33.973810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:33.973810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:33.973810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:33.973810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:33.974846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:33.974846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:33.974846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:33.974846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:33.974846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:33.974846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:33.974846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:33.974846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:33.974846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:33.974846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:33.974846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:33.974846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:33.974846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:33.974846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:33.974846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:33.974846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:33.974846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:33.975980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:33.975980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:33.975980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:33.975980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:33.975980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 326/655] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:33.976304 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938be8b6-36a3-4206-810b-b57491168ec1 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:34.015424 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5602ab8-3128-4f98-a51a-585b6e1f19c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:34.016377 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5602ab8-3128-4f98-a51a-585b6e1f19c3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:34.016806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5602ab8-3128-4f98-a51a-585b6e1f19c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:34.017239 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5602ab8-3128-4f98-a51a-585b6e1f19c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:34.022854 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:34.080258 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938be8b6-36a3-4206-810b-b57491168ec1 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:34.088205 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5602ab8-3128-4f98-a51a-585b6e1f19c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:34.089595 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5602ab8-3128-4f98-a51a-585b6e1f19c3 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:34.114723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948468e-582e-45cc-9f4d-5fd04d294d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:34.115383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948468e-582e-45cc-9f4d-5fd04d294d79 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:34.115664 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948468e-582e-45cc-9f4d-5fd04d294d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:34.115939 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948468e-582e-45cc-9f4d-5fd04d294d79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:34.116731 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948468e-582e-45cc-9f4d-5fd04d294d79 None admin] RBAC: Adding query filter params (role.id=ff0af8236fc84d82bf84c8d2d11c11ca, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=e5579f23592846abb3273cc5f5658ac9) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:34.117041 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948468e-582e-45cc-9f4d-5fd04d294d79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:34.118478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948468e-582e-45cc-9f4d-5fd04d294d79 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:34.124571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 327/656] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:25:33 2022] GET /identity/v3/role_assignments?user.id=e5579f23592846abb3273cc5f5658ac9&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=ff0af8236fc84d82bf84c8d2d11c11ca => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:34.125354 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948468e-582e-45cc-9f4d-5fd04d294d79 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:34.162468 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:34.201571 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 330/657] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:25:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:25:34.203092 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a0f2a-55f3-4661-b9b4-970d19c4a608 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:34.204048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a0f2a-55f3-4661-b9b4-970d19c4a608 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:34.204423 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a0f2a-55f3-4661-b9b4-970d19c4a608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:34.226050 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-6d0a0f2a-55f3-4661-b9b4-970d19c4a608 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:34.227310 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6d0a0f2a-55f3-4661-b9b4-970d19c4a608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:34.246660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948468e-582e-45cc-9f4d-5fd04d294d79 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:34.255039 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:34.286817 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa497086-e17f-49a8-a197-ef7c62aebb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:34.287462 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa497086-e17f-49a8-a197-ef7c62aebb25 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:34.287740 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa497086-e17f-49a8-a197-ef7c62aebb25 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:34.288011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa497086-e17f-49a8-a197-ef7c62aebb25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:34.311585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 331/658] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:34.312323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a0f2a-55f3-4661-b9b4-970d19c4a608 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:34.373155 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa497086-e17f-49a8-a197-ef7c62aebb25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:34.375334 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa497086-e17f-49a8-a197-ef7c62aebb25 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:34.435060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:34.441849 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a0f2a-55f3-4661-b9b4-970d19c4a608 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:34.479769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c935936-30d6-45df-9e65-9fe277c8706c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:34.480397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c935936-30d6-45df-9e65-9fe277c8706c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:34.480682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c935936-30d6-45df-9e65-9fe277c8706c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:34.480954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c935936-30d6-45df-9e65-9fe277c8706c None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:34.481656 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c935936-30d6-45df-9e65-9fe277c8706c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:34.481979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 328/659] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:25:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:25:34.482858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa497086-e17f-49a8-a197-ef7c62aebb25 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:34.486548 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c935936-30d6-45df-9e65-9fe277c8706c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:34.488070 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c935936-30d6-45df-9e65-9fe277c8706c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:34.491910 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:34.507861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 332/660] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:34.507861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c935936-30d6-45df-9e65-9fe277c8706c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:34.603894 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa497086-e17f-49a8-a197-ef7c62aebb25 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:34.627400 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c935936-30d6-45df-9e65-9fe277c8706c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:34.643066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0a925-a435-4ddf-9fe1-dd8eabbe7fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:34.643830 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0a925-a435-4ddf-9fe1-dd8eabbe7fbc None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:34.644030 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0a925-a435-4ddf-9fe1-dd8eabbe7fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:34.644312 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0a925-a435-4ddf-9fe1-dd8eabbe7fbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:34.660049 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0a925-a435-4ddf-9fe1-dd8eabbe7fbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:34.662946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0a925-a435-4ddf-9fe1-dd8eabbe7fbc None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:34.666216 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37e478-041c-431d-a583-32c119e3c2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:34.666870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37e478-041c-431d-a583-32c119e3c2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:34.667153 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37e478-041c-431d-a583-32c119e3c2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:34.667468 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37e478-041c-431d-a583-32c119e3c2e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:34.678357 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37e478-041c-431d-a583-32c119e3c2e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:34.681764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-92b0a925-a435-4ddf-9fe1-dd8eabbe7fbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:34.681764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:34.681764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:34.681764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:34.681764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:34.681764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:34.681764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:34.681764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:34.681764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:34.681764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:34.681764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:34.681764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:34.681764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:34.681764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:34.681764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:34.682693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:34.682693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:34.682693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:34.682693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:34.682693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:34.682693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:34.682693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:34.682693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:34.682693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:34.682693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:34.682693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:34.682693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:34.682693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:34.682693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:34.682693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:34.682693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:34.682693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:34.683636 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:34.683636 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:34.683636 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:34.683636 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:34.683879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-0d37e478-041c-431d-a583-32c119e3c2e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:34.683879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:34.683879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:34.683879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:34.683879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:34.683879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:34.683879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:34.683879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:34.683879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:34.683879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:34.683879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:34.683879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:34.683879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:34.683879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:34.683879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:34.683879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:34.684782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:34.684782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:34.684782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:34.684782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:34.684782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:34.684782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:34.684782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:34.684782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:34.684782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:34.684782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:34.684782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:34.684782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:34.684782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:34.684782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:34.684782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:34.684782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:34.692259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:34.692259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:34.692259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:34.692259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:34.692259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:34.692259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:34.692259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:34.692259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:34.692259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:34.692259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:34.692259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:34.692259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:34.693998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 329/661] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:34.693998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0a925-a435-4ddf-9fe1-dd8eabbe7fbc None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:34.694329 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 333/662] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:25:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:34.694329 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37e478-041c-431d-a583-32c119e3c2e3 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:34.713239 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:34.752891 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:34.797774 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0a925-a435-4ddf-9fe1-dd8eabbe7fbc None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:34.804956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37e478-041c-431d-a583-32c119e3c2e3 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:34.836804 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733db1bb-fd70-403d-a72a-33c1e3003c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:34.837453 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733db1bb-fd70-403d-a72a-33c1e3003c83 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:34.837758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733db1bb-fd70-403d-a72a-33c1e3003c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:34.838095 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733db1bb-fd70-403d-a72a-33c1e3003c83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:34.846824 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae6408-96e5-4994-add4-0f2a0dc3a223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:34.847496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae6408-96e5-4994-add4-0f2a0dc3a223 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:34.847779 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae6408-96e5-4994-add4-0f2a0dc3a223 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:34.848056 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae6408-96e5-4994-add4-0f2a0dc3a223 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:34.850618 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733db1bb-fd70-403d-a72a-33c1e3003c83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:34.852306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733db1bb-fd70-403d-a72a-33c1e3003c83 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:34.857437 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae6408-96e5-4994-add4-0f2a0dc3a223 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:34.858893 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae6408-96e5-4994-add4-0f2a0dc3a223 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:34.867651 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-733db1bb-fd70-403d-a72a-33c1e3003c83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:34.867651 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:34.867651 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:34.867651 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:34.867651 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:34.867651 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:34.867651 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:34.867651 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:34.867651 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:34.867651 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:34.867651 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:34.867651 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:34.867651 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:34.867651 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:34.867651 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:34.868884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:34.868884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:34.868884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:34.868884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:34.868884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:34.868884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:34.868884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:34.868884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:34.868884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:34.868884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:34.868884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:34.868884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:34.868884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:34.868884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:34.868884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:34.868884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:34.868884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:34.870531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:34.870531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:34.870531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:34.870531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:34.870755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-63ae6408-96e5-4994-add4-0f2a0dc3a223 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 18:25:34.870755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:34.870755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:34.870755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:34.870755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:34.870755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:34.870755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:34.870755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:34.870755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:34.870755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:34.870755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:34.870755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:34.870755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:34.870755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:34.870755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:34.870755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:34.871658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:34.871658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:34.871658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:34.871658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:34.871658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:34.871658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:34.871658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:34.871658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:34.871658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:34.871658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:34.871658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:34.871658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:34.871658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:34.871658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:34.871658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:34.871658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:34.871658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:34.871658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:34.879311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:34.879311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:34.879311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:34.879311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:34.879311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:34.879311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:34.879311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:34.879311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:34.879311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 18:25:34.879311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:34.879311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 334/663] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:25:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:34.879311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae6408-96e5-4994-add4-0f2a0dc3a223 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:34.880149 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 330/664] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:34.880149 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733db1bb-fd70-403d-a72a-33c1e3003c83 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:34.961195 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:34.984899 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae6408-96e5-4994-add4-0f2a0dc3a223 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:34.992602 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733db1bb-fd70-403d-a72a-33c1e3003c83 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:35.005536 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:35.020173 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9d062-9491-4278-b65f-a1b5fe6d96ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:35.020799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9d062-9491-4278-b65f-a1b5fe6d96ee None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:35.021100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9d062-9491-4278-b65f-a1b5fe6d96ee None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:35.021362 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9d062-9491-4278-b65f-a1b5fe6d96ee None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:35.022058 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9d062-9491-4278-b65f-a1b5fe6d96ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:35.022364 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9d062-9491-4278-b65f-a1b5fe6d96ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:35.023781 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9d062-9491-4278-b65f-a1b5fe6d96ee None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:35.029264 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37c9f5-bbc9-48f4-8319-6964952164bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:35.029878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37c9f5-bbc9-48f4-8319-6964952164bb None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:35.030149 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37c9f5-bbc9-48f4-8319-6964952164bb None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:35.030430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37c9f5-bbc9-48f4-8319-6964952164bb None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:35.031142 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37c9f5-bbc9-48f4-8319-6964952164bb None admin] RBAC: Adding query filter params (name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:35.032132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37c9f5-bbc9-48f4-8319-6964952164bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:35.033667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37c9f5-bbc9-48f4-8319-6964952164bb None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:35.041329 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 335/665] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:35.042217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 331/666] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 18:25:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:35.042635 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9d062-9491-4278-b65f-a1b5fe6d96ee None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:35.043006 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37c9f5-bbc9-48f4-8319-6964952164bb None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:35.147738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37c9f5-bbc9-48f4-8319-6964952164bb None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:35.148881 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9d062-9491-4278-b65f-a1b5fe6d96ee None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:35.183137 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e259291-1337-4dee-b0c2-65bf2d797603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:35.183785 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e259291-1337-4dee-b0c2-65bf2d797603 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:35.184065 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e259291-1337-4dee-b0c2-65bf2d797603 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:35.184339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e259291-1337-4dee-b0c2-65bf2d797603 None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:35.185126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e259291-1337-4dee-b0c2-65bf2d797603 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:35.185437 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e259291-1337-4dee-b0c2-65bf2d797603 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:35.186867 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e259291-1337-4dee-b0c2-65bf2d797603 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:35.191290 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ff24d-7e26-45f0-ac02-650ae437f675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:35.192512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ff24d-7e26-45f0-ac02-650ae437f675 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:35.192977 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ff24d-7e26-45f0-ac02-650ae437f675 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:35.193430 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ff24d-7e26-45f0-ac02-650ae437f675 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:35.194340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ff24d-7e26-45f0-ac02-650ae437f675 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:35.194815 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ff24d-7e26-45f0-ac02-650ae437f675 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:35.196615 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ff24d-7e26-45f0-ac02-650ae437f675 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:35.199374 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:35.210598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 332/667] 10.222.0.65 () {56 vars in 1139 bytes} [Wed Jul 27 18:25:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:35.210598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e259291-1337-4dee-b0c2-65bf2d797603 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:35.219954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 336/668] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:35.219954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ff24d-7e26-45f0-ac02-650ae437f675 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:35.244372 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:35.325685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e259291-1337-4dee-b0c2-65bf2d797603 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:35.329448 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ff24d-7e26-45f0-ac02-650ae437f675 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:35.367677 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f31523-41a5-42db-92aa-167de19ba108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:35.368325 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f31523-41a5-42db-92aa-167de19ba108 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:35.368590 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc941b6-4ac2-48a6-98d0-7e897f35388f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:35.368726 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f31523-41a5-42db-92aa-167de19ba108 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:35.368873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f31523-41a5-42db-92aa-167de19ba108 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:35.369237 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc941b6-4ac2-48a6-98d0-7e897f35388f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:35.369522 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc941b6-4ac2-48a6-98d0-7e897f35388f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:35.369802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc941b6-4ac2-48a6-98d0-7e897f35388f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:35.376839 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f31523-41a5-42db-92aa-167de19ba108 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:35.378821 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f31523-41a5-42db-92aa-167de19ba108 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:35.381547 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc941b6-4ac2-48a6-98d0-7e897f35388f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:35.383012 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc941b6-4ac2-48a6-98d0-7e897f35388f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:35.391694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-53f31523-41a5-42db-92aa-167de19ba108 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:35.391694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:35.391694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:35.391694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:35.391694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:35.391694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:35.391694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:35.391694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:35.391694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:35.391694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:35.391694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:35.391694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:35.391694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:35.391694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:35.391694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:35.393145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:35.393145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:35.393145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:35.393145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:35.393145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:35.393145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:35.393145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:35.393145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:35.393145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:35.393145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:35.393145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:35.393145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:35.393145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:35.393145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:35.393145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:35.393145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:35.393145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:35.394278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:35.394278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:35.394278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:35.394278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:35.394278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:35.394278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:35.394278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:35.394278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:35.394278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 333/669] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:35.394278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f31523-41a5-42db-92aa-167de19ba108 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:35.402150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-3cc941b6-4ac2-48a6-98d0-7e897f35388f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:35.402150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:35.402150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:35.402150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:35.402150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:35.402150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:35.402150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:35.402150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:35.402150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:35.402150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:35.402150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:35.402150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:35.402150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:35.402150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:35.402150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:35.403219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:35.403219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:35.403219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:35.403219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:35.403219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:35.403219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:35.403219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:35.403219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:35.403219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:35.403219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:35.403219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:35.403219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:35.403219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:35.403219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:35.403219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:35.403219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:35.403219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:35.404422 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:35.404422 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:35.404422 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:35.404422 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:35.404422 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 337/670] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:35.404422 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc941b6-4ac2-48a6-98d0-7e897f35388f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:35.466361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:35.493776 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:35.504034 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f31523-41a5-42db-92aa-167de19ba108 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:35.523671 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc941b6-4ac2-48a6-98d0-7e897f35388f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:35.540692 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fff64-5232-46ff-9f39-f6a2b8d04f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:35.541069 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fff64-5232-46ff-9f39-f6a2b8d04f81 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:35.541358 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fff64-5232-46ff-9f39-f6a2b8d04f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:35.541634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fff64-5232-46ff-9f39-f6a2b8d04f81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:35.572240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a55b66-365a-46bf-93b2-4c4f8e3cc24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:35.572892 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a55b66-365a-46bf-93b2-4c4f8e3cc24a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:35.573177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a55b66-365a-46bf-93b2-4c4f8e3cc24a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:35.573449 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a55b66-365a-46bf-93b2-4c4f8e3cc24a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:35.580779 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a55b66-365a-46bf-93b2-4c4f8e3cc24a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:35.582234 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a55b66-365a-46bf-93b2-4c4f8e3cc24a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:35.595241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-b2a55b66-365a-46bf-93b2-4c4f8e3cc24a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:35.595241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:35.595241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:35.595241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:35.595241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:35.595241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:35.595241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:35.595241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:35.595241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:35.595241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:35.595241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:35.595241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:35.595241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:35.595241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:35.595241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:35.596414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:35.596414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:35.596414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:35.596414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:35.596414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:35.596414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:35.596414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:35.596414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:35.596414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:35.596414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:35.596414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:35.596414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:35.596414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:35.596414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:35.596414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:35.596414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:35.596414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:35.597429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:35.597429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:35.597429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:35.597429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:35.597429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:35.597429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:35.597429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:35.597429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:35.597429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 338/671] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:35.597921 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a55b66-365a-46bf-93b2-4c4f8e3cc24a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:35.622735 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340fff64-5232-46ff-9f39-f6a2b8d04f81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:35.624818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340fff64-5232-46ff-9f39-f6a2b8d04f81 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:35.720177 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:35.724982 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a55b66-365a-46bf-93b2-4c4f8e3cc24a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:35.733806 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 334/672] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:25:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:25:35.733806 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fff64-5232-46ff-9f39-f6a2b8d04f81 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:35.737413 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:35.764069 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd601cea-43ce-43cf-a61b-77cb801ec92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:35.765063 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd601cea-43ce-43cf-a61b-77cb801ec92b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:35.765566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd601cea-43ce-43cf-a61b-77cb801ec92b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:35.766348 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd601cea-43ce-43cf-a61b-77cb801ec92b None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:35.767274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd601cea-43ce-43cf-a61b-77cb801ec92b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:35.767605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd601cea-43ce-43cf-a61b-77cb801ec92b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:35.769061 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd601cea-43ce-43cf-a61b-77cb801ec92b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:35.788338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 339/673] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:35.788338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd601cea-43ce-43cf-a61b-77cb801ec92b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:35.836206 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fff64-5232-46ff-9f39-f6a2b8d04f81 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:35.871537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d46cc-dc44-4711-b43e-06044b0301eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:35.872167 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d46cc-dc44-4711-b43e-06044b0301eb None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:35.872453 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d46cc-dc44-4711-b43e-06044b0301eb None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:35.872742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d46cc-dc44-4711-b43e-06044b0301eb None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:35.873496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d46cc-dc44-4711-b43e-06044b0301eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:35.873809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d46cc-dc44-4711-b43e-06044b0301eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:35.875544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d46cc-dc44-4711-b43e-06044b0301eb None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:35.887231 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 335/674] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:35.888083 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d46cc-dc44-4711-b43e-06044b0301eb None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:35.903142 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd601cea-43ce-43cf-a61b-77cb801ec92b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:35.940862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab134b6-6e06-4afc-beb8-0e126cc79f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:35.941492 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab134b6-6e06-4afc-beb8-0e126cc79f9e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:35.941774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab134b6-6e06-4afc-beb8-0e126cc79f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:35.942052 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab134b6-6e06-4afc-beb8-0e126cc79f9e None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:35.942936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab134b6-6e06-4afc-beb8-0e126cc79f9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:35.943547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:35.944036 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab134b6-6e06-4afc-beb8-0e126cc79f9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:35.945507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab134b6-6e06-4afc-beb8-0e126cc79f9e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:35.963119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 340/675] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:35.963815 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab134b6-6e06-4afc-beb8-0e126cc79f9e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:35.995729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:35.999815 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d46cc-dc44-4711-b43e-06044b0301eb None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:36.039072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d37ec-1cf4-45a9-817e-19ed2517e0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:36.039800 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d37ec-1cf4-45a9-817e-19ed2517e0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:36.040078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d37ec-1cf4-45a9-817e-19ed2517e0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:36.040411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d37ec-1cf4-45a9-817e-19ed2517e0d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:36.051933 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d37ec-1cf4-45a9-817e-19ed2517e0d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:36.053471 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d37ec-1cf4-45a9-817e-19ed2517e0d3 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:36.067752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-b68d37ec-1cf4-45a9-817e-19ed2517e0d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:36.067752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:36.067752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:36.067752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:36.067752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:36.067752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:36.067752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:36.067752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:36.067752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:36.067752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:36.067752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:36.067752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:36.067752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:36.067752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:36.067752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:36.068683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:36.068683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:36.068683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:36.068683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:36.068683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:36.068683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:36.068683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:36.068683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:36.068683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:36.068683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:36.068683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:36.068683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:36.068683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:36.068683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:36.068683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:36.068683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:36.068683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:36.069608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:36.069608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:36.069608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:36.069608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:36.069608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 336/676] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:36.069902 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d37ec-1cf4-45a9-817e-19ed2517e0d3 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:36.078943 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab134b6-6e06-4afc-beb8-0e126cc79f9e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:36.116359 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6b60c-9cef-4cf0-ba62-8c18f25108b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:36.116978 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6b60c-9cef-4cf0-ba62-8c18f25108b5 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:36.117742 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6b60c-9cef-4cf0-ba62-8c18f25108b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:36.118023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6b60c-9cef-4cf0-ba62-8c18f25108b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:36.118816 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6b60c-9cef-4cf0-ba62-8c18f25108b5 None admin] RBAC: Adding query filter params (role.id=ff0af8236fc84d82bf84c8d2d11c11ca, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=be769d4dd016466f9174e7d5e47a2a0d) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:36.119489 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6b60c-9cef-4cf0-ba62-8c18f25108b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:36.121246 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6b60c-9cef-4cf0-ba62-8c18f25108b5 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:36.139295 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 341/677] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:25:35 2022] GET /identity/v3/role_assignments?user.id=be769d4dd016466f9174e7d5e47a2a0d&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=ff0af8236fc84d82bf84c8d2d11c11ca => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:36.139295 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6b60c-9cef-4cf0-ba62-8c18f25108b5 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:36.184902 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d37ec-1cf4-45a9-817e-19ed2517e0d3 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:36.187826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:36.222992 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531e97f-2e22-450a-8536-3c5111763cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:36.224098 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531e97f-2e22-450a-8536-3c5111763cdb None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:36.224622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531e97f-2e22-450a-8536-3c5111763cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:36.225102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531e97f-2e22-450a-8536-3c5111763cdb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:36.233550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531e97f-2e22-450a-8536-3c5111763cdb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:36.236419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531e97f-2e22-450a-8536-3c5111763cdb None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:36.250762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-4531e97f-2e22-450a-8536-3c5111763cdb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:25:36.250762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:36.250762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:36.250762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:36.250762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:36.250762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:36.250762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:36.250762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:36.250762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:36.250762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:36.250762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:36.250762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:36.250762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:36.250762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:36.250762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:36.250762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:36.251794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:36.251794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:36.251794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:36.251794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:36.251794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:36.251794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:36.251794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:36.251794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:36.251794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:36.251794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:36.251794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:36.251794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:36.251794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:36.251794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:36.251794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:36.251794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:36.251794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:36.251794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:36.252762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:36.252762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:36.252762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:36.252762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:36.252762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:36.252762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:36.252762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:36.252762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:36.252762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:25:36.252762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:36.255671 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 337/678] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:25:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:36.256833 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531e97f-2e22-450a-8536-3c5111763cdb None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:36.266709 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:36.276583 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6b60c-9cef-4cf0-ba62-8c18f25108b5 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:36.321856 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a737978-a2d1-46c8-ad96-01cf7f754c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:36.322485 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a737978-a2d1-46c8-ad96-01cf7f754c65 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:36.322761 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a737978-a2d1-46c8-ad96-01cf7f754c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:36.323034 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a737978-a2d1-46c8-ad96-01cf7f754c65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:36.323860 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a737978-a2d1-46c8-ad96-01cf7f754c65 None admin] RBAC: Adding query filter params (role.id=ff0af8236fc84d82bf84c8d2d11c11ca, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=d49a34cd99ab47bb92af6ed2f82fefde) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:36.324474 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a737978-a2d1-46c8-ad96-01cf7f754c65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:36.325602 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a737978-a2d1-46c8-ad96-01cf7f754c65 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:36.334037 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 342/679] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:25:36 2022] GET /identity/v3/role_assignments?user.id=d49a34cd99ab47bb92af6ed2f82fefde&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=ff0af8236fc84d82bf84c8d2d11c11ca => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:36.334879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a737978-a2d1-46c8-ad96-01cf7f754c65 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:36.397247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531e97f-2e22-450a-8536-3c5111763cdb None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:36.446334 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff1de0-6414-4e3d-a845-c57e07aa9d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:36.446976 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff1de0-6414-4e3d-a845-c57e07aa9d04 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:36.447283 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff1de0-6414-4e3d-a845-c57e07aa9d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:36.447569 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff1de0-6414-4e3d-a845-c57e07aa9d04 None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:36.448284 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff1de0-6414-4e3d-a845-c57e07aa9d04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:36.448589 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff1de0-6414-4e3d-a845-c57e07aa9d04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:36.450011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff1de0-6414-4e3d-a845-c57e07aa9d04 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:36.465829 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 338/680] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:36.467648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89907e-5ad9-4aa1-a160-f0f6b5cadf0d None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:36.468067 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89907e-5ad9-4aa1-a160-f0f6b5cadf0d None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:36.468682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89907e-5ad9-4aa1-a160-f0f6b5cadf0d None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:36.471294 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 339/681] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:36.472253 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89907e-5ad9-4aa1-a160-f0f6b5cadf0d None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:36.473343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a737978-a2d1-46c8-ad96-01cf7f754c65 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:36.508187 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:36.514843 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e887d-cc0b-4a6c-bce8-2cc83c069411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:36.515708 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e887d-cc0b-4a6c-bce8-2cc83c069411 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:36.516283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e887d-cc0b-4a6c-bce8-2cc83c069411 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:36.516573 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e887d-cc0b-4a6c-bce8-2cc83c069411 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:36.517475 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e887d-cc0b-4a6c-bce8-2cc83c069411 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:36.517789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e887d-cc0b-4a6c-bce8-2cc83c069411 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:36.519239 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e887d-cc0b-4a6c-bce8-2cc83c069411 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:36.548784 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 343/682] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Jul 27 18:25:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:36.549840 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78a795-fa19-4378-9472-c5963f0e5a0f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:36.550200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78a795-fa19-4378-9472-c5963f0e5a0f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:36.550532 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78a795-fa19-4378-9472-c5963f0e5a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:36.578540 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-cf78a795-fa19-4378-9472-c5963f0e5a0f None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:36.583925 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cf78a795-fa19-4378-9472-c5963f0e5a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:36.592959 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:36.618649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89907e-5ad9-4aa1-a160-f0f6b5cadf0d None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:36.664558 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ada5e-d3cb-40d6-b3c6-c4e2b42849de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:36.665873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ada5e-d3cb-40d6-b3c6-c4e2b42849de None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:36.666351 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ada5e-d3cb-40d6-b3c6-c4e2b42849de None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:36.666836 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ada5e-d3cb-40d6-b3c6-c4e2b42849de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:36.666954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 344/683] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:36.667886 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78a795-fa19-4378-9472-c5963f0e5a0f None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:36.676688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ada5e-d3cb-40d6-b3c6-c4e2b42849de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:36.683373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ada5e-d3cb-40d6-b3c6-c4e2b42849de None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:36.703775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-778ada5e-d3cb-40d6-b3c6-c4e2b42849de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:36.703775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:36.703775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:36.703775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:36.703775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:36.703775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:36.703775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:36.703775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:36.703775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:36.703775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:36.703775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:36.703775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:36.703775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:36.703775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:36.703775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:36.704746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:36.704746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:36.704746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:36.704746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:36.704746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:36.704746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:36.704746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:36.704746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:36.704746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:36.704746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:36.704746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:36.704746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:36.704746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:36.704746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:36.704746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:36.704746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:36.704746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:36.706033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:36.706033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:36.706033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:36.706033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:36.706033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:36.706033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:36.706033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:36.706033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:36.706033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 340/684] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:36.707024 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ada5e-d3cb-40d6-b3c6-c4e2b42849de None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:36.787966 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78a795-fa19-4378-9472-c5963f0e5a0f None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:36.809296 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:36.829419 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabda9c7-0ec0-49cb-b2f7-d7fb6104574b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:36.830194 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabda9c7-0ec0-49cb-b2f7-d7fb6104574b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:36.830586 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabda9c7-0ec0-49cb-b2f7-d7fb6104574b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:36.830923 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabda9c7-0ec0-49cb-b2f7-d7fb6104574b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:36.834022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ada5e-d3cb-40d6-b3c6-c4e2b42849de None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:36.849311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:36.885814 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ff9bc-f3a5-4450-828e-d747298441f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:36.886564 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ff9bc-f3a5-4450-828e-d747298441f0 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:36.886946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ff9bc-f3a5-4450-828e-d747298441f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:36.887569 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ff9bc-f3a5-4450-828e-d747298441f0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:36.887986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ff9bc-f3a5-4450-828e-d747298441f0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:36.889982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ff9bc-f3a5-4450-828e-d747298441f0 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:36.901512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-206ff9bc-f3a5-4450-828e-d747298441f0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:25:36.901512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:36.901512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:25:36.901512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:25:36.901512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:25:36.901512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:25:36.901512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:25:36.901512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:25:36.901512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:25:36.901512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:36.901512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:25:36.901512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:36.901512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:36.901512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:36.901512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:36.901512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:36.902570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:36.902570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:36.902570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:36.902570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:36.902570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:36.902570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:36.902570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:36.902570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:25:36.902570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:25:36.902570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:25:36.902570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:25:36.902570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:36.902570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:36.902570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:36.902570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:36.902570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:36.903459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:36.903459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:36.903459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:36.903459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:36.903459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:36.903459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:36.903459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:36.903459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:36.903459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:36.903459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:36.903459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:36.903459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:25:36.903459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:25:36.903459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:25:36.903459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:36.908652 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 341/685] 10.222.0.65 () {56 vars in 1129 bytes} [Wed Jul 27 18:25:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:36.909638 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ff9bc-f3a5-4450-828e-d747298441f0 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:36.924499 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabda9c7-0ec0-49cb-b2f7-d7fb6104574b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:36.926360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabda9c7-0ec0-49cb-b2f7-d7fb6104574b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:37.022660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ff9bc-f3a5-4450-828e-d747298441f0 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:37.034793 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 345/686] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:25:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:25:37.036031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabda9c7-0ec0-49cb-b2f7-d7fb6104574b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:37.064964 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749d972-a7fe-4157-afe9-4bcb2a2dd37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:37.065620 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749d972-a7fe-4157-afe9-4bcb2a2dd37b None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:37.065969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749d972-a7fe-4157-afe9-4bcb2a2dd37b None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:37.066511 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749d972-a7fe-4157-afe9-4bcb2a2dd37b None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:37.067128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749d972-a7fe-4157-afe9-4bcb2a2dd37b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:37.067593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749d972-a7fe-4157-afe9-4bcb2a2dd37b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:37.069030 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749d972-a7fe-4157-afe9-4bcb2a2dd37b None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:37.082462 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 342/687] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:37.083538 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749d972-a7fe-4157-afe9-4bcb2a2dd37b None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:37.086633 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:37.092573 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:37.146656 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabda9c7-0ec0-49cb-b2f7-d7fb6104574b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:37.183835 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa2b7f-5f4e-4a4a-9697-229e40a98d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:37.184875 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa2b7f-5f4e-4a4a-9697-229e40a98d74 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:37.185362 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa2b7f-5f4e-4a4a-9697-229e40a98d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:37.185839 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa2b7f-5f4e-4a4a-9697-229e40a98d74 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:37.186752 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa2b7f-5f4e-4a4a-9697-229e40a98d74 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:37.187292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa2b7f-5f4e-4a4a-9697-229e40a98d74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:37.189108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa2b7f-5f4e-4a4a-9697-229e40a98d74 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:37.189229 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749d972-a7fe-4157-afe9-4bcb2a2dd37b None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:37.194951 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 346/688] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Jul 27 18:25:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:37.196104 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa2b7f-5f4e-4a4a-9697-229e40a98d74 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:37.232119 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f1a85-2537-44bd-b221-763bd1e94c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:37.232784 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f1a85-2537-44bd-b221-763bd1e94c4f None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:37.233048 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f1a85-2537-44bd-b221-763bd1e94c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:37.233343 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f1a85-2537-44bd-b221-763bd1e94c4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:37.245256 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f1a85-2537-44bd-b221-763bd1e94c4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:37.246720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f1a85-2537-44bd-b221-763bd1e94c4f None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:37.262599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-b04f1a85-2537-44bd-b221-763bd1e94c4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:37.262599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:37.262599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:37.262599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:37.262599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:37.262599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:37.262599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:37.262599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:37.262599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:37.262599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:37.262599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:37.262599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:37.262599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:37.262599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:37.262599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:37.263583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:37.263583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:37.263583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:37.263583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:37.263583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:37.263583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:37.263583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:37.263583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:37.263583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:37.263583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:37.263583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:37.263583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:37.263583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:37.263583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:37.263583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:37.263583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:37.263583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:37.264503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:37.264503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:37.264503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:37.264503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:37.264503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 343/689] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:37.268088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f1a85-2537-44bd-b221-763bd1e94c4f None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:37.315572 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa2b7f-5f4e-4a4a-9697-229e40a98d74 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:37.326154 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:37.331024 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:37.353340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564135b3-ffc9-4dfe-ba1a-61ab94b5293c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:37.354358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564135b3-ffc9-4dfe-ba1a-61ab94b5293c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:37.354870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564135b3-ffc9-4dfe-ba1a-61ab94b5293c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:37.355379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564135b3-ffc9-4dfe-ba1a-61ab94b5293c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:37.356391 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564135b3-ffc9-4dfe-ba1a-61ab94b5293c None admin] RBAC: Adding query filter params (role.id=ff0af8236fc84d82bf84c8d2d11c11ca, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=ffee4a13d4fd4f86bd1c79b4535a0c55) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:37.356907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564135b3-ffc9-4dfe-ba1a-61ab94b5293c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:37.358702 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564135b3-ffc9-4dfe-ba1a-61ab94b5293c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:37.366304 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 347/690] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:25:37 2022] GET /identity/v3/role_assignments?user.id=ffee4a13d4fd4f86bd1c79b4535a0c55&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=ff0af8236fc84d82bf84c8d2d11c11ca => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:37.367451 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564135b3-ffc9-4dfe-ba1a-61ab94b5293c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:37.375944 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f1a85-2537-44bd-b221-763bd1e94c4f None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:37.412931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdca4d3-69ef-4844-bdfc-a2834785830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:37.413643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdca4d3-69ef-4844-bdfc-a2834785830c None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:37.413887 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdca4d3-69ef-4844-bdfc-a2834785830c None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:37.414132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdca4d3-69ef-4844-bdfc-a2834785830c None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:37.414821 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdca4d3-69ef-4844-bdfc-a2834785830c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:37.415126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdca4d3-69ef-4844-bdfc-a2834785830c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:37.416633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdca4d3-69ef-4844-bdfc-a2834785830c None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:37.429517 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 344/691] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Jul 27 18:25:37 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:37.495055 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564135b3-ffc9-4dfe-ba1a-61ab94b5293c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:37.544788 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae7dc2-7be0-4f52-abbf-927e904827b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:37.545842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae7dc2-7be0-4f52-abbf-927e904827b5 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:37.546369 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae7dc2-7be0-4f52-abbf-927e904827b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:37.546909 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae7dc2-7be0-4f52-abbf-927e904827b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:37.548398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae7dc2-7be0-4f52-abbf-927e904827b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:37.548938 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae7dc2-7be0-4f52-abbf-927e904827b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:37.550670 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae7dc2-7be0-4f52-abbf-927e904827b5 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:37.565935 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 348/692] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:37.571798 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdca4d3-69ef-4844-bdfc-a2834785830c None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:37.712979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdca4d3-69ef-4844-bdfc-a2834785830c None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:37.743671 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:37.750430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a778e24-e406-477c-a887-4bb3ac8248c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:37.751127 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a778e24-e406-477c-a887-4bb3ac8248c1 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:37.751533 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a778e24-e406-477c-a887-4bb3ac8248c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:37.757970 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a778e24-e406-477c-a887-4bb3ac8248c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:37.759685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a778e24-e406-477c-a887-4bb3ac8248c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:37.761148 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a778e24-e406-477c-a887-4bb3ac8248c1 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:37.773554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-3a778e24-e406-477c-a887-4bb3ac8248c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:37.773554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:37.773554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:37.773554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:37.773554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:37.773554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:37.773554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:37.773554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:37.773554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:37.773554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:37.773554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:37.773554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:37.773554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:37.773554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:37.773554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:37.774504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:37.774504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:37.774504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:37.774504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:37.774504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:37.774504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:37.774504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:37.774504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:37.774504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:37.774504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:37.774504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:37.774504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:37.774504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:37.774504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:37.774504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:37.774504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:37.774504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:37.775463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:37.775463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:37.775463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:37.775463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:37.775463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:37.775463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:37.775463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:37.775463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:37.779454 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 345/693] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:37.780832 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae7dc2-7be0-4f52-abbf-927e904827b5 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:37.814933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:37.888139 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae7dc2-7be0-4f52-abbf-927e904827b5 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:37.939312 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efe3c0-d9ab-4b95-8af4-46e68d854e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:37.939941 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efe3c0-d9ab-4b95-8af4-46e68d854e70 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:37.940218 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efe3c0-d9ab-4b95-8af4-46e68d854e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:37.940488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efe3c0-d9ab-4b95-8af4-46e68d854e70 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:37.941254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efe3c0-d9ab-4b95-8af4-46e68d854e70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:37.941555 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efe3c0-d9ab-4b95-8af4-46e68d854e70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:37.942978 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efe3c0-d9ab-4b95-8af4-46e68d854e70 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:37.960778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 349/694] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:37.965848 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a778e24-e406-477c-a887-4bb3ac8248c1 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:38.072378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a778e24-e406-477c-a887-4bb3ac8248c1 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:38.108134 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb8087-e16b-4560-9d37-4f1d73d4e754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:38.108811 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb8087-e16b-4560-9d37-4f1d73d4e754 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:38.109089 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb8087-e16b-4560-9d37-4f1d73d4e754 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:38.109450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb8087-e16b-4560-9d37-4f1d73d4e754 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:38.110254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb8087-e16b-4560-9d37-4f1d73d4e754 None admin] RBAC: Adding query filter params (role.id=ff0af8236fc84d82bf84c8d2d11c11ca, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=7832398e97af4e539e10d1eef49f6d6f) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:38.110562 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb8087-e16b-4560-9d37-4f1d73d4e754 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:38.112032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb8087-e16b-4560-9d37-4f1d73d4e754 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:38.123418 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 346/695] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:25:37 2022] GET /identity/v3/role_assignments?user.id=7832398e97af4e539e10d1eef49f6d6f&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=ff0af8236fc84d82bf84c8d2d11c11ca => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:38.615710 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01f9b7-b50f-49d9-beb4-a611dbb7a401 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:38.616248 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01f9b7-b50f-49d9-beb4-a611dbb7a401 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:38.616514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01f9b7-b50f-49d9-beb4-a611dbb7a401 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:38.618266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 350/696] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:38.623770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b72ca-3751-46c5-b338-0c3a1d00b92a None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:38.624679 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b72ca-3751-46c5-b338-0c3a1d00b92a None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:38.624679 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b72ca-3751-46c5-b338-0c3a1d00b92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:38.645451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-887b72ca-3751-46c5-b338-0c3a1d00b92a None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:38.646690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-887b72ca-3751-46c5-b338-0c3a1d00b92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:38.694005 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:38.720340 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 347/697] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:38.746508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01f9b7-b50f-49d9-beb4-a611dbb7a401 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:38.758463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b446792-8892-40b1-a72b-6d90ff665de6 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:38.758783 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b446792-8892-40b1-a72b-6d90ff665de6 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:38.759030 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b446792-8892-40b1-a72b-6d90ff665de6 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:38.760715 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 348/698] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:38.765932 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717a1a0-b753-45f9-9f56-83b846b0b932 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:38.766222 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717a1a0-b753-45f9-9f56-83b846b0b932 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:38.766503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717a1a0-b753-45f9-9f56-83b846b0b932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:38.790861 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-d717a1a0-b753-45f9-9f56-83b846b0b932 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:38.792135 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-d717a1a0-b753-45f9-9f56-83b846b0b932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:38.863571 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:38.874637 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01f9b7-b50f-49d9-beb4-a611dbb7a401 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:38.933553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 349/699] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:25:38.944943 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb94510-2ee4-4372-ade0-b9063dc8a490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:38.944943 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb94510-2ee4-4372-ade0-b9063dc8a490 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:38.944943 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb94510-2ee4-4372-ade0-b9063dc8a490 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:38.944943 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb94510-2ee4-4372-ade0-b9063dc8a490 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:38.958630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717a1a0-b753-45f9-9f56-83b846b0b932 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:38.966269 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb94510-2ee4-4372-ade0-b9063dc8a490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:38.972846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-0bb94510-2ee4-4372-ade0-b9063dc8a490 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:25:38.972846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:38.972846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:38.972846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:38.972846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:38.972846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:38.972846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:38.972846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:38.972846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:38.972846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:38.972846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:38.972846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:38.972846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:38.972846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:38.972846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:38.972846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:38.974031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:38.974031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:38.974031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:38.974031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:38.974031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:38.974031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:38.974031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:38.974031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:38.974031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:38.974031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:38.974031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:38.974031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:38.974031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:38.974031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:38.974031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:38.974031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:38.975077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:38.975077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:38.975077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:38.975077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:38.975077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:38.975077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:38.975077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:38.975077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:38.975077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:38.975077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:38.975077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:25:38.975077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:38.982567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 351/700] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:25:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:38.985343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb94510-2ee4-4372-ade0-b9063dc8a490 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:39.115595 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717a1a0-b753-45f9-9f56-83b846b0b932 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:39.131730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:39.153532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d614d7-5f98-4c1a-a0b9-e62620a2235b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:39.154333 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d614d7-5f98-4c1a-a0b9-e62620a2235b None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:39.154713 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d614d7-5f98-4c1a-a0b9-e62620a2235b None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:39.155088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d614d7-5f98-4c1a-a0b9-e62620a2235b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:39.166832 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d614d7-5f98-4c1a-a0b9-e62620a2235b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:39.168570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d614d7-5f98-4c1a-a0b9-e62620a2235b None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:39.185099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-80d614d7-5f98-4c1a-a0b9-e62620a2235b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:39.185099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:39.185099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:39.185099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:39.185099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:39.185099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:39.185099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:39.185099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:39.185099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:39.185099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:39.185099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:39.185099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:39.185099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:39.185099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:39.185099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:39.186121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:39.186121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:39.186121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:39.186121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:39.186121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:39.186121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:39.186121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:39.186121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:39.186121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:39.186121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:39.186121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:39.186121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:39.186121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:39.186121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:39.186121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:39.186121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:39.186121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:39.187020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:39.187020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:39.187020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:39.187020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:39.187020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 350/701] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:25:39.190057 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb94510-2ee4-4372-ade0-b9063dc8a490 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:39.194041 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d614d7-5f98-4c1a-a0b9-e62620a2235b None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:39.268689 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bc87a-129a-4f14-b6fa-083fee4bd71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:39.269405 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bc87a-129a-4f14-b6fa-083fee4bd71c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:39.269692 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bc87a-129a-4f14-b6fa-083fee4bd71c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:39.269966 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bc87a-129a-4f14-b6fa-083fee4bd71c None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:39.270687 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bc87a-129a-4f14-b6fa-083fee4bd71c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:39.271026 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bc87a-129a-4f14-b6fa-083fee4bd71c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:39.272534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bc87a-129a-4f14-b6fa-083fee4bd71c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:39.282541 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 352/702] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:25:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:39.287627 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bc87a-129a-4f14-b6fa-083fee4bd71c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:39.322080 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:39.377970 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d614d7-5f98-4c1a-a0b9-e62620a2235b None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:39.447234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da808c5-16ea-466b-9ad2-237f3efdab97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:39.447891 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da808c5-16ea-466b-9ad2-237f3efdab97 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:39.448174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da808c5-16ea-466b-9ad2-237f3efdab97 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:39.448453 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da808c5-16ea-466b-9ad2-237f3efdab97 None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:39.449158 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da808c5-16ea-466b-9ad2-237f3efdab97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:39.449467 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da808c5-16ea-466b-9ad2-237f3efdab97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:39.451929 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da808c5-16ea-466b-9ad2-237f3efdab97 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:39.478006 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 351/703] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:39.484136 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da808c5-16ea-466b-9ad2-237f3efdab97 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:39.503778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bc87a-129a-4f14-b6fa-083fee4bd71c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:39.519246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:39.612175 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da808c5-16ea-466b-9ad2-237f3efdab97 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:39.612862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248c9ae-633a-4dfe-97ce-c934560aef77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:39.613530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248c9ae-633a-4dfe-97ce-c934560aef77 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:39.613815 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248c9ae-633a-4dfe-97ce-c934560aef77 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:39.614096 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248c9ae-633a-4dfe-97ce-c934560aef77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:39.639618 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248c9ae-633a-4dfe-97ce-c934560aef77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:39.641839 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248c9ae-633a-4dfe-97ce-c934560aef77 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:39.664340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-3248c9ae-633a-4dfe-97ce-c934560aef77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:39.664340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:39.664340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:39.664340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:39.664340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:39.664340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:39.664340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:39.664340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:39.664340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:39.664340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:39.664340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:39.664340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:39.664340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:39.664340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:39.664340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:39.665398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:39.665398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:39.665398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:39.665398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:39.665398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:39.665398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:39.665398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:39.665398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:39.665398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:39.665398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:39.665398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:39.665398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:39.665398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:39.665398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:39.665398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:39.665398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:39.665398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:39.666297 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:39.666297 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:39.666297 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:39.666297 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:39.668563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 353/704] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:25:39.669315 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d7e9f-a876-419d-bf0e-6ef8f736808e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:39.669954 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d7e9f-a876-419d-bf0e-6ef8f736808e None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:39.670237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d7e9f-a876-419d-bf0e-6ef8f736808e None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:39.670510 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d7e9f-a876-419d-bf0e-6ef8f736808e None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:39.671199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d7e9f-a876-419d-bf0e-6ef8f736808e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:39.673399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d7e9f-a876-419d-bf0e-6ef8f736808e None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:39.674530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248c9ae-633a-4dfe-97ce-c934560aef77 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:39.752087 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:39.787948 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248c9ae-633a-4dfe-97ce-c934560aef77 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:39.808515 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 352/705] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 18:25:39 2022] POST /identity/v3/users => generated 254 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:39.847863 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2848e4a-4319-4630-8f0e-9d6e4355d33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:39.848507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2848e4a-4319-4630-8f0e-9d6e4355d33b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:39.848789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2848e4a-4319-4630-8f0e-9d6e4355d33b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:39.849058 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2848e4a-4319-4630-8f0e-9d6e4355d33b None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:39.849782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2848e4a-4319-4630-8f0e-9d6e4355d33b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:39.850085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2848e4a-4319-4630-8f0e-9d6e4355d33b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:39.851523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2848e4a-4319-4630-8f0e-9d6e4355d33b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:39.871894 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 354/706] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:39.878033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d7e9f-a876-419d-bf0e-6ef8f736808e None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:39.891886 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4548104-0cd9-415e-99c6-4452241209af None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:39.892140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4548104-0cd9-415e-99c6-4452241209af None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:39.892352 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4548104-0cd9-415e-99c6-4452241209af None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:39.894062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 355/707] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:39.901726 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba960bb-c3ed-4cfc-8b18-ca2a899a229e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:39.902052 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba960bb-c3ed-4cfc-8b18-ca2a899a229e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:39.902286 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba960bb-c3ed-4cfc-8b18-ca2a899a229e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:39.935072 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-6ba960bb-c3ed-4cfc-8b18-ca2a899a229e None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:39.935072 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6ba960bb-c3ed-4cfc-8b18-ca2a899a229e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:40.032446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:40.070149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 356/708] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:25:40.082305 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d7e9f-a876-419d-bf0e-6ef8f736808e None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:40.087478 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206cf7a-9b0c-4d7d-acec-944ae4a176e8 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:40.088029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206cf7a-9b0c-4d7d-acec-944ae4a176e8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:40.088503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206cf7a-9b0c-4d7d-acec-944ae4a176e8 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:40.092215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 357/709] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:25:40.097199 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274e0aa-11ef-4e5d-bb5b-d2610bcb4c9f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:40.097758 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274e0aa-11ef-4e5d-bb5b-d2610bcb4c9f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:40.098402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274e0aa-11ef-4e5d-bb5b-d2610bcb4c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:40.125471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-8274e0aa-11ef-4e5d-bb5b-d2610bcb4c9f None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:40.126904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8274e0aa-11ef-4e5d-bb5b-d2610bcb4c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:40.129664 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848e500-7c5d-4bb7-af4a-15989c6250f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:40.131219 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848e500-7c5d-4bb7-af4a-15989c6250f0 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:40.131547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848e500-7c5d-4bb7-af4a-15989c6250f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:40.131820 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848e500-7c5d-4bb7-af4a-15989c6250f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:40.142865 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848e500-7c5d-4bb7-af4a-15989c6250f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:40.144309 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848e500-7c5d-4bb7-af4a-15989c6250f0 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:40.159746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-e848e500-7c5d-4bb7-af4a-15989c6250f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:25:40.159746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:40.159746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:40.159746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:40.159746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:40.159746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:40.159746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:40.159746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:40.159746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:40.159746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:40.159746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:40.159746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:40.159746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:40.159746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:40.159746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:40.159746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:40.160767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:40.160767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:40.160767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:40.160767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:40.160767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:40.160767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:40.160767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:40.160767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:40.160767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:40.160767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:40.160767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:40.160767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:40.160767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:40.160767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:40.160767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:40.160767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:40.160767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:40.160767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:40.161712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:40.161712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:40.161712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:40.161712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:40.161712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:40.161712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:40.161712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:40.161712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:40.161712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:25:40.161712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:40.161712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 353/710] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 18:25:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:40.162304 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848e500-7c5d-4bb7-af4a-15989c6250f0 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:40.190918 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:40.209076 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 358/711] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:25:40.210036 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274e0aa-11ef-4e5d-bb5b-d2610bcb4c9f None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:40.300978 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848e500-7c5d-4bb7-af4a-15989c6250f0 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:40.339848 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7d6ee-5248-44fd-9bc7-8de20a7f84c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:40.340577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7d6ee-5248-44fd-9bc7-8de20a7f84c2 None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:40.340931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7d6ee-5248-44fd-9bc7-8de20a7f84c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:40.341281 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7d6ee-5248-44fd-9bc7-8de20a7f84c2 None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:40.342055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7d6ee-5248-44fd-9bc7-8de20a7f84c2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:40.343764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7d6ee-5248-44fd-9bc7-8de20a7f84c2 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:40.347563 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:40.360129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274e0aa-11ef-4e5d-bb5b-d2610bcb4c9f None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:40.398138 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73532da5-6a64-4119-8a74-6a8ac81b74d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:40.398743 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73532da5-6a64-4119-8a74-6a8ac81b74d0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:40.399005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73532da5-6a64-4119-8a74-6a8ac81b74d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:40.399329 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73532da5-6a64-4119-8a74-6a8ac81b74d0 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:40.400099 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73532da5-6a64-4119-8a74-6a8ac81b74d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:40.400438 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73532da5-6a64-4119-8a74-6a8ac81b74d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:40.401844 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73532da5-6a64-4119-8a74-6a8ac81b74d0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:40.427387 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 359/712] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 18:25:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:40.427387 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73532da5-6a64-4119-8a74-6a8ac81b74d0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:40.467814 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 354/713] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 18:25:40 2022] POST /identity/v3/services => generated 251 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:40.467814 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7d6ee-5248-44fd-9bc7-8de20a7f84c2 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:40.488581 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:40.587024 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73532da5-6a64-4119-8a74-6a8ac81b74d0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:40.646813 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400e128-ea09-4703-88a6-60114db95946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:40.647610 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400e128-ea09-4703-88a6-60114db95946 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:40.647830 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400e128-ea09-4703-88a6-60114db95946 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:40.648102 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400e128-ea09-4703-88a6-60114db95946 None admin] PATH_INFO: `/v3/services/network` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:40.648791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400e128-ea09-4703-88a6-60114db95946 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:40.650308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400e128-ea09-4703-88a6-60114db95946 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:40.663162 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7d6ee-5248-44fd-9bc7-8de20a7f84c2 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:40.665245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-5400e128-ea09-4703-88a6-60114db95946 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:25:40.665245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:40.665245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:25:40.665245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:25:40.665245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:25:40.665245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:25:40.665245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:25:40.665245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:25:40.665245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:25:40.665245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:40.665245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:25:40.665245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:40.665245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:40.665245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:40.665245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:40.665245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:40.665245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:40.666240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:40.666240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:40.666240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:40.666240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:40.666240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:40.666240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:40.666240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:25:40.666240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:25:40.666240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:25:40.666240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:25:40.666240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:40.666240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:40.666240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:40.666240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:40.666240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:40.666240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:40.667081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:40.667081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:40.667081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:40.667081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:40.667081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:40.667081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:40.667081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:40.667081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:40.667081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:40.667081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:40.667081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:25:40.667081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:25:40.667081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:25:40.667081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:40.667891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 360/714] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:40 2022] GET /identity/v3/services/network => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:40.680241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400e128-ea09-4703-88a6-60114db95946 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:40.702153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd90c0-0ad7-4cc3-b715-d0fbfa444292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:40.702823 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd90c0-0ad7-4cc3-b715-d0fbfa444292 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:40.703637 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd90c0-0ad7-4cc3-b715-d0fbfa444292 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:40.704061 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd90c0-0ad7-4cc3-b715-d0fbfa444292 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:40.807927 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd90c0-0ad7-4cc3-b715-d0fbfa444292 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:40.809428 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd90c0-0ad7-4cc3-b715-d0fbfa444292 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:40.823644 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:40.972396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 355/715] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:25:40 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:25:40.984921 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd90c0-0ad7-4cc3-b715-d0fbfa444292 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:40.993866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400e128-ea09-4703-88a6-60114db95946 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:40.997181 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:41.030671 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051267de-b039-4af6-955c-ea0c458aab30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:41.031855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051267de-b039-4af6-955c-ea0c458aab30 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:41.032350 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051267de-b039-4af6-955c-ea0c458aab30 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:41.032968 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051267de-b039-4af6-955c-ea0c458aab30 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:41.033867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051267de-b039-4af6-955c-ea0c458aab30 None admin] RBAC: Adding query filter params (name=network) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:41.034437 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051267de-b039-4af6-955c-ea0c458aab30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:41.036210 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051267de-b039-4af6-955c-ea0c458aab30 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:41.041877 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 361/716] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 18:25:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:41.048570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051267de-b039-4af6-955c-ea0c458aab30 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:41.140980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:41.148746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd90c0-0ad7-4cc3-b715-d0fbfa444292 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:41.159354 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051267de-b039-4af6-955c-ea0c458aab30 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:41.192393 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afaf910-ea4e-4422-b23f-ab56f6f629e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:41.193146 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afaf910-ea4e-4422-b23f-ab56f6f629e2 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:41.193420 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afaf910-ea4e-4422-b23f-ab56f6f629e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:41.193796 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afaf910-ea4e-4422-b23f-ab56f6f629e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:41.197847 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619a2d0-3cdc-49c2-ab66-e55888256775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:41.198712 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619a2d0-3cdc-49c2-ab66-e55888256775 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:41.199190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619a2d0-3cdc-49c2-ab66-e55888256775 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:41.199696 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619a2d0-3cdc-49c2-ab66-e55888256775 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:41.200603 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619a2d0-3cdc-49c2-ab66-e55888256775 None admin] RBAC: Adding query filter params (type=network) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:41.201107 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619a2d0-3cdc-49c2-ab66-e55888256775 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:41.202690 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619a2d0-3cdc-49c2-ab66-e55888256775 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:41.205820 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afaf910-ea4e-4422-b23f-ab56f6f629e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:41.207443 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afaf910-ea4e-4422-b23f-ab56f6f629e2 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:41.215614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 362/717] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 18:25:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:41.217417 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d79d03-0a83-493d-84dc-c0bcc12b3586 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:41.217934 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d79d03-0a83-493d-84dc-c0bcc12b3586 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:41.218409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d79d03-0a83-493d-84dc-c0bcc12b3586 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:41.220926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 363/718] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:41.224451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-6afaf910-ea4e-4422-b23f-ab56f6f629e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:41.224451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:41.224451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:41.224451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:41.224451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:41.224451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:41.224451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:41.224451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:41.224451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:41.224451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:41.224451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:41.224451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:41.224451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:41.224451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:41.224451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:41.225378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:41.225378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:41.225378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:41.225378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:41.225378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:41.225378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:41.225378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:41.225378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:41.225378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:41.225378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:41.225378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:41.225378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:41.225378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:41.225378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:41.225378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:41.225378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:41.225378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:41.226298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:41.226298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:41.226298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:41.226298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:41.226298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 356/719] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:41.228732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d73249-7a97-4690-ad17-d4c46f53fc3b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:41.229228 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d73249-7a97-4690-ad17-d4c46f53fc3b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:41.229704 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d73249-7a97-4690-ad17-d4c46f53fc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:41.236616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afaf910-ea4e-4422-b23f-ab56f6f629e2 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:41.260300 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a4d73249-7a97-4690-ad17-d4c46f53fc3b None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:41.261845 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a4d73249-7a97-4690-ad17-d4c46f53fc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:41.331648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:41.395826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afaf910-ea4e-4422-b23f-ab56f6f629e2 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:41.410093 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 364/720] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:41 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:41.433659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d73249-7a97-4690-ad17-d4c46f53fc3b None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:41.439985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188e0c6-5dcd-480d-b23a-035420817e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:41.440643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188e0c6-5dcd-480d-b23a-035420817e80 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:41.440928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188e0c6-5dcd-480d-b23a-035420817e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:41.441206 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188e0c6-5dcd-480d-b23a-035420817e80 None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:41.441931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188e0c6-5dcd-480d-b23a-035420817e80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:41.442242 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188e0c6-5dcd-480d-b23a-035420817e80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:41.443695 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188e0c6-5dcd-480d-b23a-035420817e80 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:41.468283 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 357/721] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:41.476378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188e0c6-5dcd-480d-b23a-035420817e80 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:41.488010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:41.598699 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d73249-7a97-4690-ad17-d4c46f53fc3b None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:41.646500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188e0c6-5dcd-480d-b23a-035420817e80 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:41.663596 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74e1fc-8892-48c0-bf4b-6da12fe175b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:41.664986 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74e1fc-8892-48c0-bf4b-6da12fe175b8 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:41.665517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74e1fc-8892-48c0-bf4b-6da12fe175b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:41.666007 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74e1fc-8892-48c0-bf4b-6da12fe175b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:41.695093 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e74e1fc-8892-48c0-bf4b-6da12fe175b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:41.695530 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4028d-13eb-47e9-89c0-9ff0dcd81819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:41.696447 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4028d-13eb-47e9-89c0-9ff0dcd81819 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:41.696937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4028d-13eb-47e9-89c0-9ff0dcd81819 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:41.697422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4028d-13eb-47e9-89c0-9ff0dcd81819 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:41.700274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-1e74e1fc-8892-48c0-bf4b-6da12fe175b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:25:41.700274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:41.700274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:41.700274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:41.700274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:41.700274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:41.700274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:41.700274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:41.700274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:41.700274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:41.700274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:41.700274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:41.700274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:41.700274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:41.700274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:41.700274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:41.701259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:41.701259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:41.701259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:41.701259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:41.701259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:41.701259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:41.701259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:41.701259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:41.701259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:41.701259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:41.701259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:41.701259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:41.701259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:41.701259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:41.701259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:41.701259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:41.702185 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:41.702185 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:41.702185 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:41.702185 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:41.702185 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:41.702185 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:41.702185 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:41.702185 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:41.702185 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:41.702185 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:41.702185 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:25:41.702185 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:41.711289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 365/722] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:25:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:25:41.712328 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4028d-13eb-47e9-89c0-9ff0dcd81819 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:41.714359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4028d-13eb-47e9-89c0-9ff0dcd81819 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:41.717331 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74e1fc-8892-48c0-bf4b-6da12fe175b8 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:41.731195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-72f4028d-13eb-47e9-89c0-9ff0dcd81819 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:41.731195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:41.731195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:41.731195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:41.731195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:41.731195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:41.731195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:41.731195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:41.731195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:41.731195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:41.731195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:41.731195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:41.731195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:41.731195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:41.731195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:41.732151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:41.732151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:41.732151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:41.732151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:41.732151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:41.732151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:41.732151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:41.732151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:41.732151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:41.732151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:41.732151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:41.732151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:41.732151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:41.732151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:41.732151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:41.732151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:41.732151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:41.733062 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:41.733062 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:41.733062 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:41.733062 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:41.733062 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:41.733062 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:41.733062 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:41.733062 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:41.742690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 358/723] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:41.747897 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4028d-13eb-47e9-89c0-9ff0dcd81819 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:41.769961 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:41.871720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:41.914386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74e1fc-8892-48c0-bf4b-6da12fe175b8 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:41.935289 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4028d-13eb-47e9-89c0-9ff0dcd81819 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:41.989398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03d3c7-655e-44e6-b49b-d7eb2dc9c3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:41.989943 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03d3c7-655e-44e6-b49b-d7eb2dc9c3ef None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:41.990228 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03d3c7-655e-44e6-b49b-d7eb2dc9c3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:41.990504 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03d3c7-655e-44e6-b49b-d7eb2dc9c3ef None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:41.991236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03d3c7-655e-44e6-b49b-d7eb2dc9c3ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:41.991565 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03d3c7-655e-44e6-b49b-d7eb2dc9c3ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:41.992942 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03d3c7-655e-44e6-b49b-d7eb2dc9c3ef None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:42.004762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f12c5-dd4c-491e-903f-c4c22538f5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:42.005404 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f12c5-dd4c-491e-903f-c4c22538f5dd None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:42.005691 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f12c5-dd4c-491e-903f-c4c22538f5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:42.005971 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f12c5-dd4c-491e-903f-c4c22538f5dd None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:42.006737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f12c5-dd4c-491e-903f-c4c22538f5dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:42.007051 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f12c5-dd4c-491e-903f-c4c22538f5dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:42.008528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f12c5-dd4c-491e-903f-c4c22538f5dd None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:42.023888 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 366/724] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:25:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:42.024830 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03d3c7-655e-44e6-b49b-d7eb2dc9c3ef None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:42.041425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 359/725] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:42.048230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f12c5-dd4c-491e-903f-c4c22538f5dd None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:42.117989 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:42.135900 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03d3c7-655e-44e6-b49b-d7eb2dc9c3ef None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:42.161737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f12c5-dd4c-491e-903f-c4c22538f5dd None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:42.173192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593de666-07f4-4992-9fcd-1e657d45833c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:42.173830 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593de666-07f4-4992-9fcd-1e657d45833c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:42.174351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593de666-07f4-4992-9fcd-1e657d45833c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:42.174729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593de666-07f4-4992-9fcd-1e657d45833c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:42.189999 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593de666-07f4-4992-9fcd-1e657d45833c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:42.189999 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593de666-07f4-4992-9fcd-1e657d45833c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:42.203601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-593de666-07f4-4992-9fcd-1e657d45833c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:42.203601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:42.203601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:42.203601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:42.203601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:42.203601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:42.203601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:42.203601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:42.203601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:42.203601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:42.203601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:42.203601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:42.203601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:42.203601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:42.203601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:42.204630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:42.204630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:42.204630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:42.204630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:42.204630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:42.204630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:42.204630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:42.204630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:42.204630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:42.204630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:42.204630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:42.204630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:42.204630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:42.204630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:42.204630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:42.204630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:42.204630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:42.205533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:42.205533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:42.205533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:42.205533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:42.205533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 367/726] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:42.210497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593de666-07f4-4992-9fcd-1e657d45833c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:42.219365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:42.241039 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6495451-5399-4547-876e-49fa4f0fba1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:42.241602 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6495451-5399-4547-876e-49fa4f0fba1e None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:42.241886 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6495451-5399-4547-876e-49fa4f0fba1e None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:42.242170 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6495451-5399-4547-876e-49fa4f0fba1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:42.242970 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6495451-5399-4547-876e-49fa4f0fba1e None admin] RBAC: Adding query filter params (role.id=4ae8d11d74f14bcc80117d897ba2f5b6, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=be769d4dd016466f9174e7d5e47a2a0d) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:42.243298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6495451-5399-4547-876e-49fa4f0fba1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:42.244791 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6495451-5399-4547-876e-49fa4f0fba1e None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:42.260092 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 360/727] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:25:42 2022] GET /identity/v3/role_assignments?user.id=be769d4dd016466f9174e7d5e47a2a0d&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=4ae8d11d74f14bcc80117d897ba2f5b6 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:42.323753 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593de666-07f4-4992-9fcd-1e657d45833c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:42.365085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736df0b8-7d07-493f-9a96-cf2527eada47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:42.365729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736df0b8-7d07-493f-9a96-cf2527eada47 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:42.366015 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736df0b8-7d07-493f-9a96-cf2527eada47 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:42.366293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736df0b8-7d07-493f-9a96-cf2527eada47 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:42.367006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736df0b8-7d07-493f-9a96-cf2527eada47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:42.367341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736df0b8-7d07-493f-9a96-cf2527eada47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:42.368771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736df0b8-7d07-493f-9a96-cf2527eada47 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:42.371688 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:42.383296 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 368/728] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:42.389212 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6495451-5399-4547-876e-49fa4f0fba1e None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:42.465316 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ea8a8-8504-4331-8a7a-b0dc64b0f1fa None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:42.465625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ea8a8-8504-4331-8a7a-b0dc64b0f1fa None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:42.465882 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ea8a8-8504-4331-8a7a-b0dc64b0f1fa None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:42.467511 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 369/729] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:25:42.474036 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed34c9d-dc57-4db8-aaa9-4d7eb4d5418c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:42.474036 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed34c9d-dc57-4db8-aaa9-4d7eb4d5418c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:42.474275 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed34c9d-dc57-4db8-aaa9-4d7eb4d5418c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:42.492595 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-6ed34c9d-dc57-4db8-aaa9-4d7eb4d5418c None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:42.493734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6ed34c9d-dc57-4db8-aaa9-4d7eb4d5418c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:42.554371 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6495451-5399-4547-876e-49fa4f0fba1e None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:42.585000 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 370/730] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:42.600435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc3127-0892-4b8a-a23b-337bc4c431b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:42.601086 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc3127-0892-4b8a-a23b-337bc4c431b2 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:42.601365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc3127-0892-4b8a-a23b-337bc4c431b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:42.601641 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc3127-0892-4b8a-a23b-337bc4c431b2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:42.610193 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc3127-0892-4b8a-a23b-337bc4c431b2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:42.611739 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc3127-0892-4b8a-a23b-337bc4c431b2 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:42.623643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-3acc3127-0892-4b8a-a23b-337bc4c431b2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:25:42.623643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:42.623643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:42.623643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:42.623643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:42.623643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:42.623643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:42.623643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:42.623643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:42.623643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:42.623643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:42.623643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:42.623643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:42.623643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:42.623643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:42.623643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:42.628544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:42.628544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:42.628544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:42.628544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:42.628544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:42.628544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:42.628544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:42.628544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:42.628544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:42.628544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:42.628544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:42.628544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:42.628544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:42.628544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:42.628544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:42.628544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:42.628544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:42.628544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:42.629550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:42.629550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:42.629550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:42.629550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:42.629550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:42.629550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:42.629550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:42.629550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:42.629550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:25:42.629550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:42.629550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 361/731] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:25:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:42.634513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed34c9d-dc57-4db8-aaa9-4d7eb4d5418c None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:42.638104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc3127-0892-4b8a-a23b-337bc4c431b2 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:42.697698 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:42.764018 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc3127-0892-4b8a-a23b-337bc4c431b2 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:42.814156 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed34c9d-dc57-4db8-aaa9-4d7eb4d5418c None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:42.828901 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48286594-7f55-4dcb-bff3-ac5ce4e7d49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:42.829962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48286594-7f55-4dcb-bff3-ac5ce4e7d49d None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:42.830457 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48286594-7f55-4dcb-bff3-ac5ce4e7d49d None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:42.830939 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48286594-7f55-4dcb-bff3-ac5ce4e7d49d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:42.841538 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:42.846575 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48286594-7f55-4dcb-bff3-ac5ce4e7d49d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:42.852931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-48286594-7f55-4dcb-bff3-ac5ce4e7d49d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:42.852931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:42.852931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:42.852931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:42.852931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:42.852931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:42.852931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:42.852931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:42.852931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:42.852931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:42.852931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:42.852931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:42.852931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:42.852931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:42.852931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:42.852931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:42.860554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:42.860554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:42.860554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:42.860554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:42.860554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:42.860554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:42.860554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:42.860554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:42.860554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:42.860554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:42.860554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:42.860554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:42.860554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:42.860554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:42.860554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:42.860554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:42.861432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:42.861432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:42.861432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:42.861432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:42.861432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:42.861432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:42.861432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:42.861432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:42.861432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:42.861432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:42.861432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:42.861432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:42.861432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 362/732] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:25:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:25:42.865166 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48286594-7f55-4dcb-bff3-ac5ce4e7d49d None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:42.871585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc88c4-606f-40cc-a5a5-06450eb191e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:42.872227 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc88c4-606f-40cc-a5a5-06450eb191e1 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:42.872509 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc88c4-606f-40cc-a5a5-06450eb191e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:42.872791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc88c4-606f-40cc-a5a5-06450eb191e1 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:42.873608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc88c4-606f-40cc-a5a5-06450eb191e1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:42.879738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc88c4-606f-40cc-a5a5-06450eb191e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:42.881214 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc88c4-606f-40cc-a5a5-06450eb191e1 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:42.915821 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 371/733] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Jul 27 18:25:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:42.928325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc88c4-606f-40cc-a5a5-06450eb191e1 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:43.052501 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48286594-7f55-4dcb-bff3-ac5ce4e7d49d None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:43.079649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:43.088624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c418227-c36a-4036-8269-19ef8cbb0376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:43.089340 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c418227-c36a-4036-8269-19ef8cbb0376 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:43.089526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c418227-c36a-4036-8269-19ef8cbb0376 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:43.089807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c418227-c36a-4036-8269-19ef8cbb0376 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:43.090530 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c418227-c36a-4036-8269-19ef8cbb0376 None admin] RBAC: Adding query filter params (name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:43.090854 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c418227-c36a-4036-8269-19ef8cbb0376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:43.092247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c418227-c36a-4036-8269-19ef8cbb0376 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:43.099717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc88c4-606f-40cc-a5a5-06450eb191e1 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:43.101609 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 363/734] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 18:25:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:43.108342 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5475820-21b5-40d5-ae2b-8600adaec005 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:43.108342 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5475820-21b5-40d5-ae2b-8600adaec005 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:43.108342 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5475820-21b5-40d5-ae2b-8600adaec005 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:43.108724 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 364/735] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:43.109905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5475820-21b5-40d5-ae2b-8600adaec005 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:43.143739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa98a8-ca51-4d71-b729-ac1be9e05022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:43.144883 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa98a8-ca51-4d71-b729-ac1be9e05022 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:43.145472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa98a8-ca51-4d71-b729-ac1be9e05022 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:43.146044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa98a8-ca51-4d71-b729-ac1be9e05022 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:43.202521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:43.219847 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5475820-21b5-40d5-ae2b-8600adaec005 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:43.222203 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa98a8-ca51-4d71-b729-ac1be9e05022 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:43.223921 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa98a8-ca51-4d71-b729-ac1be9e05022 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:43.256552 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4101c62-0b0c-4ee1-8c30-6d4ea531ff0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:43.257203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4101c62-0b0c-4ee1-8c30-6d4ea531ff0f None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:43.257491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4101c62-0b0c-4ee1-8c30-6d4ea531ff0f None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:43.257771 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4101c62-0b0c-4ee1-8c30-6d4ea531ff0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:43.269625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4101c62-0b0c-4ee1-8c30-6d4ea531ff0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:43.270998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4101c62-0b0c-4ee1-8c30-6d4ea531ff0f None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:43.287742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-f4101c62-0b0c-4ee1-8c30-6d4ea531ff0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:43.287742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:43.287742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:43.287742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:43.287742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:43.287742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:43.287742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:43.287742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:43.287742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:43.287742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:43.287742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:43.287742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:43.287742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:43.287742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:43.287742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:43.288761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:43.288761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:43.288761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:43.288761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:43.288761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:43.288761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:43.288761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:43.288761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:43.288761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:43.288761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:43.288761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:43.288761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:43.288761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:43.288761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:43.288761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:43.288761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:43.288761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:43.289764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:43.289764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:43.289764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:43.289764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:43.293715 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 365/736] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:25:43.295040 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c14ec-dd46-46e8-8d7b-c7e418aa43a4 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:43.295357 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c14ec-dd46-46e8-8d7b-c7e418aa43a4 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:43.295645 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c14ec-dd46-46e8-8d7b-c7e418aa43a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:43.315523 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-233c14ec-dd46-46e8-8d7b-c7e418aa43a4 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:43.316558 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-233c14ec-dd46-46e8-8d7b-c7e418aa43a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:43.336337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:43.347470 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 372/737] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:25:42 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:25:43.348479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa98a8-ca51-4d71-b729-ac1be9e05022 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:43.411668 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 366/738] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:43 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:43.412975 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c14ec-dd46-46e8-8d7b-c7e418aa43a4 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:43.449490 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:43.467151 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa98a8-ca51-4d71-b729-ac1be9e05022 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:43.508571 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f43caf-f2bf-43cc-ba5e-6a139b5c1760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:43.509691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f43caf-f2bf-43cc-ba5e-6a139b5c1760 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:43.510183 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f43caf-f2bf-43cc-ba5e-6a139b5c1760 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:43.510669 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f43caf-f2bf-43cc-ba5e-6a139b5c1760 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:43.511620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f43caf-f2bf-43cc-ba5e-6a139b5c1760 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:43.512177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f43caf-f2bf-43cc-ba5e-6a139b5c1760 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:43.513833 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f43caf-f2bf-43cc-ba5e-6a139b5c1760 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:43.527131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 373/739] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:43.528432 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f43caf-f2bf-43cc-ba5e-6a139b5c1760 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:43.545369 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c14ec-dd46-46e8-8d7b-c7e418aa43a4 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:43.588747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84d29e-95f1-4735-ad93-a2f28f6350ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:43.588747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84d29e-95f1-4735-ad93-a2f28f6350ef None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:43.588747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84d29e-95f1-4735-ad93-a2f28f6350ef None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:43.588747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84d29e-95f1-4735-ad93-a2f28f6350ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:43.601718 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84d29e-95f1-4735-ad93-a2f28f6350ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:43.603366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84d29e-95f1-4735-ad93-a2f28f6350ef None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:43.621365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-2c84d29e-95f1-4735-ad93-a2f28f6350ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:43.621365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:43.621365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:43.621365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:43.621365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:43.621365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:43.621365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:43.621365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:43.621365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:43.621365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:43.621365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:43.621365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:43.621365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:43.621365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:43.621365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:43.622306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:43.622306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:43.622306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:43.622306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:43.622306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:43.622306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:43.622306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:43.622306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:43.622306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:43.622306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:43.622306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:43.622306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:43.622306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:43.622306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:43.622306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:43.622306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:43.622306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:43.623221 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:43.623221 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:43.623221 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:43.623221 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:43.627622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 367/740] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:43.628504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84d29e-95f1-4735-ad93-a2f28f6350ef None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:43.638261 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:43.658132 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f43caf-f2bf-43cc-ba5e-6a139b5c1760 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:43.697202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c228ac-7cd9-4daa-810f-8dddf86d6fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:43.698309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c228ac-7cd9-4daa-810f-8dddf86d6fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:43.698808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c228ac-7cd9-4daa-810f-8dddf86d6fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:43.699346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c228ac-7cd9-4daa-810f-8dddf86d6fd0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:43.700183 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c228ac-7cd9-4daa-810f-8dddf86d6fd0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:43.701868 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c228ac-7cd9-4daa-810f-8dddf86d6fd0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:43.712127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-68c228ac-7cd9-4daa-810f-8dddf86d6fd0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:25:43.712127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:43.712127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:25:43.712127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:25:43.712127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:25:43.712127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:25:43.712127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:25:43.712127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:25:43.712127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:25:43.712127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:43.712127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:25:43.712127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:43.712127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:43.712127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:43.712127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:43.712127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:43.713109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:43.713109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:43.713109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:43.713109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:43.713109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:43.713109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:43.713109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:43.713109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:25:43.713109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:25:43.713109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:25:43.713109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:25:43.713109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:43.713109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:43.713109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:43.713109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:43.713109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:43.713967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:43.713967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:43.713967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:43.713967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:43.713967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:43.713967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:43.713967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:43.713967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:43.713967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:43.713967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:43.713967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:43.713967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:25:43.713967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:25:43.713967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:25:43.713967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:43.722316 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 374/741] 10.222.0.65 () {56 vars in 1129 bytes} [Wed Jul 27 18:25:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:43.723647 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c228ac-7cd9-4daa-810f-8dddf86d6fd0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:43.736883 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:43.740331 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84d29e-95f1-4735-ad93-a2f28f6350ef None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:43.776058 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34b8e0-d9c2-4322-9aef-84e078ba2832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:43.777422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34b8e0-d9c2-4322-9aef-84e078ba2832 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:43.777872 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34b8e0-d9c2-4322-9aef-84e078ba2832 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:43.778289 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34b8e0-d9c2-4322-9aef-84e078ba2832 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:43.787515 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34b8e0-d9c2-4322-9aef-84e078ba2832 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:43.789191 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34b8e0-d9c2-4322-9aef-84e078ba2832 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:43.802192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-ef34b8e0-d9c2-4322-9aef-84e078ba2832 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:25:43.802192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:43.802192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:43.802192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:43.802192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:43.802192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:43.802192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:43.802192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:43.802192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:43.802192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:43.802192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:43.802192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:43.802192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:43.802192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:43.802192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:43.802192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:43.803368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:43.803368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:43.803368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:43.803368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:43.803368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:43.803368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:43.803368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:43.803368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:43.803368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:43.803368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:43.803368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:43.803368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:43.803368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:43.803368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:43.803368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:43.803368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:43.803368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:43.803368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:43.804562 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:43.804562 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:43.804562 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:43.804562 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:43.804562 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:43.804562 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:43.804562 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:43.804562 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:43.804562 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:25:43.804562 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:43.806755 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 368/742] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 18:25:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:43.811801 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34b8e0-d9c2-4322-9aef-84e078ba2832 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:43.843810 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c228ac-7cd9-4daa-810f-8dddf86d6fd0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:43.881107 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbb739-2d23-4a18-9406-097eaebf7d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:43.881875 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbb739-2d23-4a18-9406-097eaebf7d81 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:43.882262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbb739-2d23-4a18-9406-097eaebf7d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:43.882676 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbb739-2d23-4a18-9406-097eaebf7d81 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:43.883452 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbb739-2d23-4a18-9406-097eaebf7d81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:43.883759 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbb739-2d23-4a18-9406-097eaebf7d81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:43.885141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbb739-2d23-4a18-9406-097eaebf7d81 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:43.886587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:43.902002 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 375/743] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:43.902002 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbb739-2d23-4a18-9406-097eaebf7d81 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:43.932138 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34b8e0-d9c2-4322-9aef-84e078ba2832 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:43.969057 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5c14a-8214-495a-aba9-61b500450744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:43.969712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5c14a-8214-495a-aba9-61b500450744 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:43.970058 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5c14a-8214-495a-aba9-61b500450744 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:43.970407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5c14a-8214-495a-aba9-61b500450744 None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:43.970516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:43.971229 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5c14a-8214-495a-aba9-61b500450744 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:43.971619 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5c14a-8214-495a-aba9-61b500450744 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:43.973010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5c14a-8214-495a-aba9-61b500450744 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:43.982767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 369/744] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Jul 27 18:25:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:43.982767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afdb5e-e949-4940-8c00-99d771f07722 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:43.982767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afdb5e-e949-4940-8c00-99d771f07722 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:43.982767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afdb5e-e949-4940-8c00-99d771f07722 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:43.982767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 370/745] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:43.982767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afdb5e-e949-4940-8c00-99d771f07722 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:44.013339 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbb739-2d23-4a18-9406-097eaebf7d81 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:44.048690 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7a348-f047-476f-a1b3-65a064d7649d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:44.049323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7a348-f047-476f-a1b3-65a064d7649d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:44.049608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7a348-f047-476f-a1b3-65a064d7649d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:44.049880 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7a348-f047-476f-a1b3-65a064d7649d None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:44.050685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7a348-f047-476f-a1b3-65a064d7649d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:44.050996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7a348-f047-476f-a1b3-65a064d7649d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:44.052471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7a348-f047-476f-a1b3-65a064d7649d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:44.075926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 376/746] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Jul 27 18:25:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:44.075926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7a348-f047-476f-a1b3-65a064d7649d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:44.098377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afdb5e-e949-4940-8c00-99d771f07722 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:44.132544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:44.138748 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5060ab-fb65-47a2-aace-5b93d3cff751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:44.139485 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5060ab-fb65-47a2-aace-5b93d3cff751 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:44.139805 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5060ab-fb65-47a2-aace-5b93d3cff751 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:44.157302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5060ab-fb65-47a2-aace-5b93d3cff751 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:44.157302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5060ab-fb65-47a2-aace-5b93d3cff751 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:44.157302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5060ab-fb65-47a2-aace-5b93d3cff751 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:44.159682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-fc5060ab-fb65-47a2-aace-5b93d3cff751 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:44.159682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:44.159682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:44.159682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:44.159682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:44.159682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:44.159682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:44.159682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:44.159682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:44.159682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:44.159682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:44.159682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:44.159682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:44.159682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:44.159682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:44.160571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:44.160571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:44.160571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:44.160571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:44.160571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:44.160571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:44.160571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:44.160571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:44.160571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:44.160571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:44.160571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:44.160571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:44.160571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:44.160571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:44.160571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:44.160571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:44.160571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:44.161468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:44.161468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:44.161468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:44.161468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:44.161468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:44.161468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:44.161468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:44.161468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:44.161468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 371/747] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:44.163794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc159e3a-e1ef-4524-820e-91ac7da11b61 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:44.163794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc159e3a-e1ef-4524-820e-91ac7da11b61 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:44.163794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc159e3a-e1ef-4524-820e-91ac7da11b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:44.186319 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-bc159e3a-e1ef-4524-820e-91ac7da11b61 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:44.188094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-bc159e3a-e1ef-4524-820e-91ac7da11b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:44.190760 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7a348-f047-476f-a1b3-65a064d7649d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:44.220705 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:44.230181 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eead65-3109-45a2-8a01-4d24569b8a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:44.230803 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eead65-3109-45a2-8a01-4d24569b8a8a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:44.232995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eead65-3109-45a2-8a01-4d24569b8a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:44.232995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eead65-3109-45a2-8a01-4d24569b8a8a None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:44.232995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eead65-3109-45a2-8a01-4d24569b8a8a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:44.232995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eead65-3109-45a2-8a01-4d24569b8a8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:44.233772 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eead65-3109-45a2-8a01-4d24569b8a8a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:44.243925 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 377/748] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Jul 27 18:25:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:44.243925 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eead65-3109-45a2-8a01-4d24569b8a8a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:44.291286 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 372/749] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:25:44.291286 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc159e3a-e1ef-4524-820e-91ac7da11b61 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:44.370175 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eead65-3109-45a2-8a01-4d24569b8a8a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:44.388268 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc159e3a-e1ef-4524-820e-91ac7da11b61 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:44.411086 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e88a6-3508-478e-8d89-06657a7e3fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:44.412414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e88a6-3508-478e-8d89-06657a7e3fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:44.412877 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e88a6-3508-478e-8d89-06657a7e3fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:44.413335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e88a6-3508-478e-8d89-06657a7e3fc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:44.416466 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:44.437429 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32c5df-fa3a-4473-9f9c-b70ddfc2a767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:44.438231 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32c5df-fa3a-4473-9f9c-b70ddfc2a767 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:44.438511 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32c5df-fa3a-4473-9f9c-b70ddfc2a767 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:44.438784 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32c5df-fa3a-4473-9f9c-b70ddfc2a767 None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:44.439704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32c5df-fa3a-4473-9f9c-b70ddfc2a767 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:44.440010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32c5df-fa3a-4473-9f9c-b70ddfc2a767 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:44.441447 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32c5df-fa3a-4473-9f9c-b70ddfc2a767 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:44.453600 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 373/750] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:44.454411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32c5df-fa3a-4473-9f9c-b70ddfc2a767 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:44.478049 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:44.489507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e88a6-3508-478e-8d89-06657a7e3fc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:44.490978 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e88a6-3508-478e-8d89-06657a7e3fc0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:44.563658 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32c5df-fa3a-4473-9f9c-b70ddfc2a767 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:44.597469 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 378/751] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:25:44 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:25:44.602088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc26f1-1c4e-4b11-b844-c5b094403df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:44.602226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e88a6-3508-478e-8d89-06657a7e3fc0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:44.602339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc26f1-1c4e-4b11-b844-c5b094403df8 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:44.602339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc26f1-1c4e-4b11-b844-c5b094403df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:44.602339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc26f1-1c4e-4b11-b844-c5b094403df8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:44.602339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc26f1-1c4e-4b11-b844-c5b094403df8 None admin] RBAC: Adding query filter params (interface=public, service_id=81babe5e2f9a488ead8155e7449dd528, region_id=RegionOne) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:44.602339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc26f1-1c4e-4b11-b844-c5b094403df8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:44.602339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc26f1-1c4e-4b11-b844-c5b094403df8 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:44.610707 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 374/752] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 18:25:44 2022] GET /identity/v3/endpoints?service_id=81babe5e2f9a488ead8155e7449dd528&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:44.611988 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a3a52-7cbd-45d7-ab18-1310e01bc3d6 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:44.612280 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a3a52-7cbd-45d7-ab18-1310e01bc3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:44.612555 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a3a52-7cbd-45d7-ab18-1310e01bc3d6 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:44.615118 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 375/753] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:44.615118 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a3a52-7cbd-45d7-ab18-1310e01bc3d6 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:44.701821 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:44.748214 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:44.757951 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a3a52-7cbd-45d7-ab18-1310e01bc3d6 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:44.758652 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e88a6-3508-478e-8d89-06657a7e3fc0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:44.793205 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8b42a-3bdc-4580-a8c9-be1c9267f6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:44.793872 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8b42a-3bdc-4580-a8c9-be1c9267f6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:44.794109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768271f-fb4f-4aaa-b93b-f458b5d1c36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:44.794223 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8b42a-3bdc-4580-a8c9-be1c9267f6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:44.794417 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8b42a-3bdc-4580-a8c9-be1c9267f6a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:44.794709 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768271f-fb4f-4aaa-b93b-f458b5d1c36f None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:44.794993 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768271f-fb4f-4aaa-b93b-f458b5d1c36f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:44.795206 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8b42a-3bdc-4580-a8c9-be1c9267f6a8 None admin] RBAC: Adding query filter params (role.id=4ae8d11d74f14bcc80117d897ba2f5b6, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=7832398e97af4e539e10d1eef49f6d6f) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:44.795315 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768271f-fb4f-4aaa-b93b-f458b5d1c36f None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:44.795572 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8b42a-3bdc-4580-a8c9-be1c9267f6a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:44.795988 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768271f-fb4f-4aaa-b93b-f458b5d1c36f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:44.797318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8b42a-3bdc-4580-a8c9-be1c9267f6a8 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:44.797417 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768271f-fb4f-4aaa-b93b-f458b5d1c36f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:44.803129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 376/754] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:25:44 2022] GET /identity/v3/role_assignments?user.id=7832398e97af4e539e10d1eef49f6d6f&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=4ae8d11d74f14bcc80117d897ba2f5b6 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:44.803952 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8b42a-3bdc-4580-a8c9-be1c9267f6a8 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:44.915050 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8b42a-3bdc-4580-a8c9-be1c9267f6a8 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:44.925805 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:44.953126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b7f4c-bb3c-4e51-8ab4-333d7fdcfe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:44.953786 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 379/755] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 18:25:44 2022] POST /identity/v3/services => generated 240 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:44.955196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b7f4c-bb3c-4e51-8ab4-333d7fdcfe50 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:44.955360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768271f-fb4f-4aaa-b93b-f458b5d1c36f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:44.955472 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b7f4c-bb3c-4e51-8ab4-333d7fdcfe50 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:44.955472 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b7f4c-bb3c-4e51-8ab4-333d7fdcfe50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:44.972846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b7f4c-bb3c-4e51-8ab4-333d7fdcfe50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:44.974583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b7f4c-bb3c-4e51-8ab4-333d7fdcfe50 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:44.996858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-2f4b7f4c-bb3c-4e51-8ab4-333d7fdcfe50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:44.996858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:44.996858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:44.996858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:44.996858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:44.996858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:44.996858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:44.996858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:44.996858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:44.996858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:44.996858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:44.996858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:44.996858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:44.996858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:44.996858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:44.997858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:44.997858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:44.997858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:44.997858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:44.997858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:44.997858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:44.997858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:44.997858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:44.997858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:44.997858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:44.997858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:44.997858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:44.997858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:44.997858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:44.997858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:44.997858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:44.997858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:44.999050 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:44.999050 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:44.999050 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:44.999050 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:44.999050 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 377/756] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:45.000886 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d863c7-8180-4214-8c0c-a29a06374cd8 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:45.001168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d863c7-8180-4214-8c0c-a29a06374cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:45.001448 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d863c7-8180-4214-8c0c-a29a06374cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:45.025800 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-36d863c7-8180-4214-8c0c-a29a06374cd8 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:45.027456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-36d863c7-8180-4214-8c0c-a29a06374cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:45.095248 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768271f-fb4f-4aaa-b93b-f458b5d1c36f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:45.123064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 378/757] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:25:45.123064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d863c7-8180-4214-8c0c-a29a06374cd8 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:45.146294 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bbfb8-2c65-4168-b2e2-a1162a67d989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:45.146921 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bbfb8-2c65-4168-b2e2-a1162a67d989 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:45.147198 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bbfb8-2c65-4168-b2e2-a1162a67d989 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:45.147505 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bbfb8-2c65-4168-b2e2-a1162a67d989 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:45.148162 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bbfb8-2c65-4168-b2e2-a1162a67d989 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:45.149701 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bbfb8-2c65-4168-b2e2-a1162a67d989 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:45.155449 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 380/758] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 18:25:44 2022] GET /identity/v3/services => generated 772 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:45.156538 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bbfb8-2c65-4168-b2e2-a1162a67d989 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:45.173930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:45.261673 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d863c7-8180-4214-8c0c-a29a06374cd8 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:45.272353 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:45.304462 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3916064-d3a9-4c14-a297-e2bbc7b761e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:45.305122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3916064-d3a9-4c14-a297-e2bbc7b761e7 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:45.305404 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3916064-d3a9-4c14-a297-e2bbc7b761e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:45.305675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3916064-d3a9-4c14-a297-e2bbc7b761e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:45.306397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3916064-d3a9-4c14-a297-e2bbc7b761e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:45.306703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3916064-d3a9-4c14-a297-e2bbc7b761e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:45.308212 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3916064-d3a9-4c14-a297-e2bbc7b761e7 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:45.310369 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bbfb8-2c65-4168-b2e2-a1162a67d989 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:45.322117 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 379/759] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:45.329882 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3916064-d3a9-4c14-a297-e2bbc7b761e7 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:45.350458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc70b31-f868-4bd2-97d0-88a7792dcaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:45.351118 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc70b31-f868-4bd2-97d0-88a7792dcaa8 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:45.351497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc70b31-f868-4bd2-97d0-88a7792dcaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:45.351777 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc70b31-f868-4bd2-97d0-88a7792dcaa8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:45.367502 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc70b31-f868-4bd2-97d0-88a7792dcaa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:45.373163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-adc70b31-f868-4bd2-97d0-88a7792dcaa8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:25:45.373163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:45.373163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:45.373163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:45.373163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:45.373163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:45.373163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:45.373163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:45.373163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:45.373163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:45.373163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:45.373163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:45.373163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:45.373163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:45.373163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:45.373163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:45.374996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:45.374996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:45.374996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:45.374996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:45.374996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:45.374996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:45.374996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:45.374996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:45.374996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:45.374996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:45.374996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:45.374996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:45.374996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:45.374996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:45.374996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:45.374996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:45.376140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:45.376140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:45.376140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:45.376140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:45.376140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:45.376140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:45.376140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:45.376140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:45.376140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:45.376140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:45.376140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:25:45.376140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:45.379688 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 381/760] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:25:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:45.381946 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc70b31-f868-4bd2-97d0-88a7792dcaa8 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:45.443185 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3916064-d3a9-4c14-a297-e2bbc7b761e7 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:45.477237 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:45.479254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5f9d0-f4e8-40fb-81a0-2a0066f35e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:45.479932 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5f9d0-f4e8-40fb-81a0-2a0066f35e41 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:45.480214 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5f9d0-f4e8-40fb-81a0-2a0066f35e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:45.480483 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5f9d0-f4e8-40fb-81a0-2a0066f35e41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:45.489549 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5f9d0-f4e8-40fb-81a0-2a0066f35e41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:45.491084 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5f9d0-f4e8-40fb-81a0-2a0066f35e41 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:45.502984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc70b31-f868-4bd2-97d0-88a7792dcaa8 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:45.504979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-08a5f9d0-f4e8-40fb-81a0-2a0066f35e41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:45.504979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:45.504979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:45.504979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:45.504979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:45.504979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:45.504979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:45.504979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:45.504979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:45.504979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:45.504979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:45.504979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:45.504979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:45.504979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:45.504979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:45.505875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:45.505875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:45.505875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:45.505875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:45.505875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:45.505875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:45.505875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:45.505875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:45.505875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:45.505875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:45.505875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:45.505875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:45.505875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:45.505875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:45.505875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:45.505875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:45.505875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:45.506985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:45.506985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:45.506985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:45.506985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:45.506985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:45.506985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:45.506985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:45.506985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:45.506985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 380/761] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:25:45.512275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5f9d0-f4e8-40fb-81a0-2a0066f35e41 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:45.527997 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:45.593032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb96679-1221-48de-91ae-512bc37e6ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:45.594368 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb96679-1221-48de-91ae-512bc37e6ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:45.594652 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb96679-1221-48de-91ae-512bc37e6ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:45.594920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb96679-1221-48de-91ae-512bc37e6ff4 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:45.595698 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb96679-1221-48de-91ae-512bc37e6ff4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:45.596006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb96679-1221-48de-91ae-512bc37e6ff4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:45.597461 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb96679-1221-48de-91ae-512bc37e6ff4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:45.615766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 382/762] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:25:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:45.621801 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb96679-1221-48de-91ae-512bc37e6ff4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:45.627157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5f9d0-f4e8-40fb-81a0-2a0066f35e41 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:45.668711 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589a626-af59-4ced-826c-ae1ff68116eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:45.669348 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589a626-af59-4ced-826c-ae1ff68116eb None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:45.669630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589a626-af59-4ced-826c-ae1ff68116eb None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:45.669905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589a626-af59-4ced-826c-ae1ff68116eb None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:45.670672 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589a626-af59-4ced-826c-ae1ff68116eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:45.670984 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589a626-af59-4ced-826c-ae1ff68116eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:45.673193 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589a626-af59-4ced-826c-ae1ff68116eb None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:45.701590 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 381/763] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:45.703534 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589a626-af59-4ced-826c-ae1ff68116eb None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:45.774431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb96679-1221-48de-91ae-512bc37e6ff4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:45.815331 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:45.849815 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589a626-af59-4ced-826c-ae1ff68116eb None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:45.851213 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:45.863147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164efdbc-88ef-407b-9a0b-f0cd25b4cd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:45.863839 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164efdbc-88ef-407b-9a0b-f0cd25b4cd2b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:45.864364 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164efdbc-88ef-407b-9a0b-f0cd25b4cd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:45.864364 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164efdbc-88ef-407b-9a0b-f0cd25b4cd2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:45.889225 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164efdbc-88ef-407b-9a0b-f0cd25b4cd2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:45.890849 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164efdbc-88ef-407b-9a0b-f0cd25b4cd2b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:45.891254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2f7a6-e1c7-4417-9593-a5b63291f105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:45.892139 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2f7a6-e1c7-4417-9593-a5b63291f105 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:45.892638 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2f7a6-e1c7-4417-9593-a5b63291f105 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:45.893133 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2f7a6-e1c7-4417-9593-a5b63291f105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:45.894341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2f7a6-e1c7-4417-9593-a5b63291f105 None admin] RBAC: Adding query filter params (role.id=ff0af8236fc84d82bf84c8d2d11c11ca, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=5b4c4184e87b4dc5a4047310cd0122ba) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:45.894897 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2f7a6-e1c7-4417-9593-a5b63291f105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:45.896643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2f7a6-e1c7-4417-9593-a5b63291f105 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:45.903962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 382/764] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:25:45 2022] GET /identity/v3/role_assignments?user.id=5b4c4184e87b4dc5a4047310cd0122ba&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=ff0af8236fc84d82bf84c8d2d11c11ca => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:45.918472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-164efdbc-88ef-407b-9a0b-f0cd25b4cd2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:45.918472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:45.918472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:45.918472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:45.918472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:45.918472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:45.918472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:45.918472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:45.918472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:45.918472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:45.918472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:45.918472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:45.918472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:45.918472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:45.918472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:45.919500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:45.919500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:45.919500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:45.919500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:45.919500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:45.919500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:45.919500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:45.919500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:45.919500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:45.919500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:45.919500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:45.919500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:45.919500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:45.919500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:45.919500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:45.919500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:45.919500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:45.920405 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:45.920405 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:45.920405 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:45.920405 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:45.923605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 383/765] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:45.929076 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2f7a6-e1c7-4417-9593-a5b63291f105 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:46.049521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2f7a6-e1c7-4417-9593-a5b63291f105 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:46.089417 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51461ad5-c9f3-4d86-bede-65ce24100b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:46.090430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51461ad5-c9f3-4d86-bede-65ce24100b58 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:46.090919 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51461ad5-c9f3-4d86-bede-65ce24100b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:46.091434 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51461ad5-c9f3-4d86-bede-65ce24100b58 None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:46.092387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51461ad5-c9f3-4d86-bede-65ce24100b58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:46.092939 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51461ad5-c9f3-4d86-bede-65ce24100b58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:46.095356 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51461ad5-c9f3-4d86-bede-65ce24100b58 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:46.097337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:46.111633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 383/766] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:46.120431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164efdbc-88ef-407b-9a0b-f0cd25b4cd2b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:46.265913 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164efdbc-88ef-407b-9a0b-f0cd25b4cd2b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:46.320032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086f71b-e810-4f28-b9b6-83d1b6da739d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:46.321033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086f71b-e810-4f28-b9b6-83d1b6da739d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:46.321549 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086f71b-e810-4f28-b9b6-83d1b6da739d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:46.322027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086f71b-e810-4f28-b9b6-83d1b6da739d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:46.336329 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086f71b-e810-4f28-b9b6-83d1b6da739d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:46.338085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086f71b-e810-4f28-b9b6-83d1b6da739d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:46.356774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-6086f71b-e810-4f28-b9b6-83d1b6da739d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:25:46.356774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:46.356774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:46.356774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:46.356774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:46.356774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:46.356774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:46.356774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:46.356774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:46.356774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:46.356774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:46.356774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:46.356774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:46.356774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:46.356774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:46.356774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:46.357773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:46.357773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:46.357773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:46.357773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:46.357773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:46.357773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:46.357773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:46.357773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:46.357773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:46.357773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:46.357773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:46.357773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:46.357773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:46.357773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:46.357773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:46.357773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:46.357773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:46.357773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:46.358738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:46.358738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:46.358738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:46.358738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:46.358738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:46.358738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:46.358738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:46.358738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:46.358738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:25:46.358738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:46.361081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 384/767] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 18:25:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:46.366885 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51461ad5-c9f3-4d86-bede-65ce24100b58 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:46.478027 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51461ad5-c9f3-4d86-bede-65ce24100b58 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:46.514545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7c9b1-96ea-417c-a3ba-d2312fb0d5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:46.515605 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7c9b1-96ea-417c-a3ba-d2312fb0d5bc None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:46.516133 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7c9b1-96ea-417c-a3ba-d2312fb0d5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:46.516608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7c9b1-96ea-417c-a3ba-d2312fb0d5bc None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:46.517622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7c9b1-96ea-417c-a3ba-d2312fb0d5bc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:46.518136 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7c9b1-96ea-417c-a3ba-d2312fb0d5bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:46.519808 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7c9b1-96ea-417c-a3ba-d2312fb0d5bc None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:46.539078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 384/768] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 18:25:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:46.554439 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086f71b-e810-4f28-b9b6-83d1b6da739d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:46.605339 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:46.684482 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086f71b-e810-4f28-b9b6-83d1b6da739d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:46.719559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f34c9c-61a5-4ab2-a20b-e2bfaff7d1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:46.720249 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f34c9c-61a5-4ab2-a20b-e2bfaff7d1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:46.720530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f34c9c-61a5-4ab2-a20b-e2bfaff7d1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:46.720801 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f34c9c-61a5-4ab2-a20b-e2bfaff7d1a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:46.732162 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f34c9c-61a5-4ab2-a20b-e2bfaff7d1a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:46.733697 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f34c9c-61a5-4ab2-a20b-e2bfaff7d1a8 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:46.749344 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-33f34c9c-61a5-4ab2-a20b-e2bfaff7d1a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:46.749344 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:46.749344 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:46.749344 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:46.749344 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:46.749344 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:46.749344 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:46.749344 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:46.749344 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:46.749344 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:46.749344 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:46.749344 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:46.749344 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:46.749344 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:46.749344 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:46.750338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:46.750338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:46.750338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:46.750338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:46.750338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:46.750338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:46.750338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:46.750338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:46.750338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:46.750338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:46.750338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:46.750338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:46.750338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:46.750338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:46.750338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:46.750338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:46.750338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:46.751392 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:46.751392 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:46.751392 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:46.751392 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:46.751392 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 385/769] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:46.756783 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7c9b1-96ea-417c-a3ba-d2312fb0d5bc None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:46.839370 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:46.915743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7c9b1-96ea-417c-a3ba-d2312fb0d5bc None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:46.971027 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ec445-c087-4f36-a7fb-0021c08d298e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:46.971773 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ec445-c087-4f36-a7fb-0021c08d298e None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:46.972067 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ec445-c087-4f36-a7fb-0021c08d298e None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:46.972343 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ec445-c087-4f36-a7fb-0021c08d298e None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:46.973535 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ec445-c087-4f36-a7fb-0021c08d298e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:46.973851 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ec445-c087-4f36-a7fb-0021c08d298e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:46.976398 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ec445-c087-4f36-a7fb-0021c08d298e None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:47.004838 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 385/770] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:47.012798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f34c9c-61a5-4ab2-a20b-e2bfaff7d1a8 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:47.141084 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:47.151546 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f34c9c-61a5-4ab2-a20b-e2bfaff7d1a8 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:47.193426 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d076c0c-5b56-44f7-865d-e7ef050650b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:47.193988 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d076c0c-5b56-44f7-865d-e7ef050650b7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:47.194265 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d076c0c-5b56-44f7-865d-e7ef050650b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:47.194540 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d076c0c-5b56-44f7-865d-e7ef050650b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:47.207216 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d076c0c-5b56-44f7-865d-e7ef050650b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:47.208798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d076c0c-5b56-44f7-865d-e7ef050650b7 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:47.227791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-2d076c0c-5b56-44f7-865d-e7ef050650b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:47.227791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:47.227791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:47.227791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:47.227791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:47.227791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:47.227791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:47.227791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:47.227791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:47.227791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:47.227791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:47.227791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:47.227791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:47.227791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:47.227791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:47.228750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:47.228750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:47.228750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:47.228750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:47.228750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:47.228750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:47.228750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:47.228750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:47.228750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:47.228750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:47.228750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:47.228750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:47.228750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:47.228750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:47.228750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:47.228750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:47.228750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:47.229659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:47.229659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:47.229659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:47.229659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:47.229659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:47.229659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:47.229659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:47.229659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:47.229659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 386/771] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:47.235642 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ec445-c087-4f36-a7fb-0021c08d298e None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:47.332359 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151a3e0-8606-44ad-bfbd-1b483555e5f8 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:47.332716 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151a3e0-8606-44ad-bfbd-1b483555e5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:47.332910 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151a3e0-8606-44ad-bfbd-1b483555e5f8 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:47.334673 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 387/772] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:25:47.340313 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633265f2-aee2-4bea-8b6b-2897898f9b5e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:47.340592 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633265f2-aee2-4bea-8b6b-2897898f9b5e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:47.340863 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633265f2-aee2-4bea-8b6b-2897898f9b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:47.380680 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-633265f2-aee2-4bea-8b6b-2897898f9b5e None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:47.383427 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-633265f2-aee2-4bea-8b6b-2897898f9b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:47.408071 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ec445-c087-4f36-a7fb-0021c08d298e None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:47.435646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:47.475365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da110745-dcdd-4241-82ae-2b98b11348d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:47.475966 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da110745-dcdd-4241-82ae-2b98b11348d4 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:47.476279 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da110745-dcdd-4241-82ae-2b98b11348d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:47.476560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da110745-dcdd-4241-82ae-2b98b11348d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:47.477334 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da110745-dcdd-4241-82ae-2b98b11348d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:47.477646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da110745-dcdd-4241-82ae-2b98b11348d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:47.479119 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da110745-dcdd-4241-82ae-2b98b11348d4 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:47.506425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 386/773] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:47.511502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da110745-dcdd-4241-82ae-2b98b11348d4 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:47.532213 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 388/774] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Jul 27 18:25:47.555884 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633265f2-aee2-4bea-8b6b-2897898f9b5e None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:47.667932 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:47.688895 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633265f2-aee2-4bea-8b6b-2897898f9b5e None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:47.724659 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da110745-dcdd-4241-82ae-2b98b11348d4 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:47.763501 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9146e-65db-4556-8683-dddac9ec5511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:47.764539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9146e-65db-4556-8683-dddac9ec5511 None admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:47.765566 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9146e-65db-4556-8683-dddac9ec5511 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:47.766220 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9146e-65db-4556-8683-dddac9ec5511 None admin] PATH_INFO: `/v3/projects/2880a34079d742c38bfdace2c04564c7/users/be769d4dd016466f9174e7d5e47a2a0d/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:47.770068 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9146e-65db-4556-8683-dddac9ec5511 None admin] RBAC: Authorizing `identity:create_grant(project_id=2880a34079d742c38bfdace2c04564c7, user_id=be769d4dd016466f9174e7d5e47a2a0d, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:47.771842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9146e-65db-4556-8683-dddac9ec5511 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:47.786914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c218018-7d98-4fe4-96d4-b0e61f0d8904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:47.787990 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c218018-7d98-4fe4-96d4-b0e61f0d8904 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:47.788482 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c218018-7d98-4fe4-96d4-b0e61f0d8904 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:47.788962 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c218018-7d98-4fe4-96d4-b0e61f0d8904 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:47.800533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c218018-7d98-4fe4-96d4-b0e61f0d8904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:47.805879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-9c218018-7d98-4fe4-96d4-b0e61f0d8904 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:25:47.805879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:47.805879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:47.805879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:47.805879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:47.805879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:47.805879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:47.805879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:47.805879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:47.805879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:47.805879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:47.805879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:47.805879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:47.805879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:47.805879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:47.805879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:47.806842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:47.806842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:47.806842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:47.806842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:47.806842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:47.806842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:47.806842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:47.806842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:47.806842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:47.806842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:47.806842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:47.806842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:47.806842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:47.806842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:47.806842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:47.806842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:47.807739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:47.807739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:47.807739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:47.807739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:47.807739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:47.807739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:47.807739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:47.807739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:47.807739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:47.807739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:47.807739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:25:47.807739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:47.810455 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 389/775] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:25:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:25:47.816868 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c218018-7d98-4fe4-96d4-b0e61f0d8904 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:47.857243 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 387/776] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:25:47 2022] PUT /identity/v3/projects/2880a34079d742c38bfdace2c04564c7/users/be769d4dd016466f9174e7d5e47a2a0d/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:47.872432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff334f-0d82-45b1-a6ce-93b83dbd2da0 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:47.872750 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff334f-0d82-45b1-a6ce-93b83dbd2da0 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:47.873000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff334f-0d82-45b1-a6ce-93b83dbd2da0 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:47.879346 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 388/777] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:25:47.882048 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4f4a2-5972-4b54-b712-1fba473bb02b None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:47.882337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4f4a2-5972-4b54-b712-1fba473bb02b None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:47.882616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4f4a2-5972-4b54-b712-1fba473bb02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:47.906522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-eda4f4a2-5972-4b54-b712-1fba473bb02b None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:47.910791 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-eda4f4a2-5972-4b54-b712-1fba473bb02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:47.972931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:48.002566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c218018-7d98-4fe4-96d4-b0e61f0d8904 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:48.049365 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46b315-d6e6-4379-ab67-556faafde38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:48.049714 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 389/778] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:25:48.049890 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46b315-d6e6-4379-ab67-556faafde38b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:48.050130 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46b315-d6e6-4379-ab67-556faafde38b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:48.050409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46b315-d6e6-4379-ab67-556faafde38b None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:48.051144 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46b315-d6e6-4379-ab67-556faafde38b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:48.051483 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46b315-d6e6-4379-ab67-556faafde38b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:48.052320 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb4975-d5e8-4618-b3c6-45c499c18fe6 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:48.052849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb4975-d5e8-4618-b3c6-45c499c18fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:48.053041 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46b315-d6e6-4379-ab67-556faafde38b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:48.053528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb4975-d5e8-4618-b3c6-45c499c18fe6 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:48.055116 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 390/779] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:48.060692 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65e00f-2b17-432e-bdd2-2a6c7e1577b7 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:48.061137 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65e00f-2b17-432e-bdd2-2a6c7e1577b7 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:48.061523 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65e00f-2b17-432e-bdd2-2a6c7e1577b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:48.068867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 390/780] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:25:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:48.078629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46b315-d6e6-4379-ab67-556faafde38b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:48.085016 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-9f65e00f-2b17-432e-bdd2-2a6c7e1577b7 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:48.086430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-9f65e00f-2b17-432e-bdd2-2a6c7e1577b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:48.092155 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:48.163871 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 391/781] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:25:48.164778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65e00f-2b17-432e-bdd2-2a6c7e1577b7 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:48.216138 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46b315-d6e6-4379-ab67-556faafde38b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:48.254373 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69406f-2454-47c2-8271-e47f0af4a878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:48.255027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69406f-2454-47c2-8271-e47f0af4a878 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:48.255342 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69406f-2454-47c2-8271-e47f0af4a878 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:48.255621 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69406f-2454-47c2-8271-e47f0af4a878 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:48.267889 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69406f-2454-47c2-8271-e47f0af4a878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:48.269381 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69406f-2454-47c2-8271-e47f0af4a878 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:48.286949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-3e69406f-2454-47c2-8271-e47f0af4a878 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:48.286949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:48.286949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:48.286949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:48.286949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:48.286949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:48.286949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:48.286949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:48.286949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:48.286949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:48.286949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:48.286949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:48.286949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:48.286949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:48.286949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:48.287980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:48.287980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:48.287980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:48.287980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:48.287980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:48.287980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:48.287980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:48.287980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:48.287980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:48.287980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:48.287980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:48.287980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:48.287980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:48.287980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:48.287980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:48.287980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:48.287980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:48.288892 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:48.288892 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:48.288892 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:48.288892 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:48.292601 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:48.293412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 391/782] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:48.294079 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69406f-2454-47c2-8271-e47f0af4a878 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:48.305971 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65e00f-2b17-432e-bdd2-2a6c7e1577b7 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:48.353616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e64c5-ade7-4ee2-8248-cda602517d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:48.354930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e64c5-ade7-4ee2-8248-cda602517d0a None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:48.355735 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e64c5-ade7-4ee2-8248-cda602517d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:48.356230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e64c5-ade7-4ee2-8248-cda602517d0a None admin] PATH_INFO: `/v3/services/network` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:48.357874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e64c5-ade7-4ee2-8248-cda602517d0a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:48.360142 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:48.361059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e64c5-ade7-4ee2-8248-cda602517d0a None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:48.374962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-7e9e64c5-ade7-4ee2-8248-cda602517d0a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:25:48.374962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:48.374962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:25:48.374962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:25:48.374962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:25:48.374962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:25:48.374962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:25:48.374962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:25:48.374962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:25:48.374962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:48.374962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:25:48.374962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:48.374962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:48.374962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:48.374962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:48.374962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:48.374962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:48.376055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:48.376055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:48.376055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:48.376055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:48.376055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:48.376055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:48.376055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:25:48.376055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:25:48.376055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:25:48.376055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:25:48.376055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:48.376055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:48.376055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:48.376055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:48.376055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:48.376055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:48.376883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:48.376883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:48.376883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:48.376883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:48.376883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:48.376883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:48.376883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:48.376883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:48.376883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:48.376883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:48.376883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:25:48.376883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:25:48.376883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:25:48.376883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:48.380085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 392/783] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:48 2022] GET /identity/v3/services/network => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:48.381625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e64c5-ade7-4ee2-8248-cda602517d0a None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:48.407609 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69406f-2454-47c2-8271-e47f0af4a878 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:48.446961 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973bd2c-4bf6-41c3-b18a-c94ecb443430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:48.447654 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973bd2c-4bf6-41c3-b18a-c94ecb443430 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:48.447938 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973bd2c-4bf6-41c3-b18a-c94ecb443430 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:48.448216 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973bd2c-4bf6-41c3-b18a-c94ecb443430 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:48.448857 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973bd2c-4bf6-41c3-b18a-c94ecb443430 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:48.450249 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973bd2c-4bf6-41c3-b18a-c94ecb443430 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:48.460108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-e973bd2c-4bf6-41c3-b18a-c94ecb443430 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:25:48.460108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:48.460108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:25:48.460108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:25:48.460108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:25:48.460108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:25:48.460108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:25:48.460108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:25:48.460108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:25:48.460108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:48.460108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:25:48.460108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:48.460108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:48.460108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:48.460108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:48.460108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:48.461129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:48.461129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:48.461129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:48.461129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:48.461129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:48.461129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:48.461129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:48.461129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:25:48.461129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:25:48.461129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:25:48.461129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:25:48.461129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:48.461129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:48.461129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:48.461129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:48.461129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:48.461979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:48.461979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:48.461979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:48.461979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:48.461979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:48.461979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:48.461979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:48.461979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:48.461979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:48.461979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:48.461979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:48.461979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:25:48.461979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:25:48.461979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:25:48.461979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:48.461979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 392/784] 10.222.0.65 () {56 vars in 1129 bytes} [Wed Jul 27 18:25:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:48.462864 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed16b7-7556-4cc7-bb12-9ae3524786ee None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:48.463549 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed16b7-7556-4cc7-bb12-9ae3524786ee None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:48.463549 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed16b7-7556-4cc7-bb12-9ae3524786ee None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:48.467564 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 393/785] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:48.467564 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed16b7-7556-4cc7-bb12-9ae3524786ee None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:48.501045 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e64c5-ade7-4ee2-8248-cda602517d0a None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:48.537693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc83bcd-a893-4d09-a8a5-424bfd04e1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:48.538316 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc83bcd-a893-4d09-a8a5-424bfd04e1eb None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:48.538589 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc83bcd-a893-4d09-a8a5-424bfd04e1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:48.538862 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc83bcd-a893-4d09-a8a5-424bfd04e1eb None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:48.539582 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc83bcd-a893-4d09-a8a5-424bfd04e1eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:48.539883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc83bcd-a893-4d09-a8a5-424bfd04e1eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:48.541253 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc83bcd-a893-4d09-a8a5-424bfd04e1eb None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:48.557053 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 393/786] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:48.557796 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc83bcd-a893-4d09-a8a5-424bfd04e1eb None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:48.575643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:48.596363 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed16b7-7556-4cc7-bb12-9ae3524786ee None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:48.624834 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:48.636620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26b6a9-a314-4592-a1a9-378fac5f5cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:48.637357 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26b6a9-a314-4592-a1a9-378fac5f5cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:48.637873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26b6a9-a314-4592-a1a9-378fac5f5cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:48.638155 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26b6a9-a314-4592-a1a9-378fac5f5cb2 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:48.639069 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26b6a9-a314-4592-a1a9-378fac5f5cb2 None admin] RBAC: Adding query filter params (name=network) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:48.639410 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26b6a9-a314-4592-a1a9-378fac5f5cb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:48.641355 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26b6a9-a314-4592-a1a9-378fac5f5cb2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:48.651093 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 394/787] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 18:25:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:48.652445 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643996b-a324-4bcf-bb6e-6bc218dd09a0 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:48.652738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643996b-a324-4bcf-bb6e-6bc218dd09a0 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:48.653028 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643996b-a324-4bcf-bb6e-6bc218dd09a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:48.661574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc83bcd-a893-4d09-a8a5-424bfd04e1eb None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:48.678823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c643996b-a324-4bcf-bb6e-6bc218dd09a0 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:48.680058 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c643996b-a324-4bcf-bb6e-6bc218dd09a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:48.701054 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0071049-4fa7-4b68-8135-0e33cc472f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:48.701784 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0071049-4fa7-4b68-8135-0e33cc472f26 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:48.702139 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0071049-4fa7-4b68-8135-0e33cc472f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:48.703038 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0071049-4fa7-4b68-8135-0e33cc472f26 None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:48.703899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0071049-4fa7-4b68-8135-0e33cc472f26 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:48.704279 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0071049-4fa7-4b68-8135-0e33cc472f26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:48.705725 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0071049-4fa7-4b68-8135-0e33cc472f26 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:48.710998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 394/788] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Jul 27 18:25:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:48.712271 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0071049-4fa7-4b68-8135-0e33cc472f26 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:48.754440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 395/789] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:25:48.755318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643996b-a324-4bcf-bb6e-6bc218dd09a0 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:48.817962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:48.837228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0071049-4fa7-4b68-8135-0e33cc472f26 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:48.871320 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643996b-a324-4bcf-bb6e-6bc218dd09a0 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:48.873817 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de02538-cca8-4d22-9a66-522500b3ee3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:48.874727 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de02538-cca8-4d22-9a66-522500b3ee3b None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:48.875138 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de02538-cca8-4d22-9a66-522500b3ee3b None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:48.875481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de02538-cca8-4d22-9a66-522500b3ee3b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:48.883756 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de02538-cca8-4d22-9a66-522500b3ee3b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:48.885306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de02538-cca8-4d22-9a66-522500b3ee3b None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:48.890900 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:48.897606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-2de02538-cca8-4d22-9a66-522500b3ee3b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:25:48.897606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:48.897606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:48.897606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:48.897606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:48.897606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:48.897606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:48.897606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:48.897606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:48.897606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:48.897606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:48.897606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:48.897606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:48.897606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:48.897606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:48.897606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:48.898743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:48.898743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:48.898743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:48.898743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:48.898743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:48.898743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:48.898743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:48.898743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:48.898743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:48.898743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:48.898743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:48.898743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:48.898743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:48.898743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:48.898743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:48.898743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:48.898743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:48.898743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:48.910013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:48.910013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:48.910013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:48.910013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:48.910013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:48.910013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:48.910013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:48.910013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:48.910013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:25:48.910013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:48.910013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 395/790] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:25:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:48.910013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de02538-cca8-4d22-9a66-522500b3ee3b None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:48.912187 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d26a3d-f5db-4eeb-a85a-69d1609da465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:48.912873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d26a3d-f5db-4eeb-a85a-69d1609da465 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:48.913221 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d26a3d-f5db-4eeb-a85a-69d1609da465 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:48.913552 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d26a3d-f5db-4eeb-a85a-69d1609da465 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:48.914307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d26a3d-f5db-4eeb-a85a-69d1609da465 None admin] RBAC: Adding query filter params (type=network) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:48.914667 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d26a3d-f5db-4eeb-a85a-69d1609da465 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:48.916132 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d26a3d-f5db-4eeb-a85a-69d1609da465 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:48.930071 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 396/791] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 18:25:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:48.930071 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d26a3d-f5db-4eeb-a85a-69d1609da465 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:49.011204 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de02538-cca8-4d22-9a66-522500b3ee3b None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:49.044171 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d26a3d-f5db-4eeb-a85a-69d1609da465 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:49.045818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8685dc9-bcfe-462e-8251-0b063275de4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:49.047615 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8685dc9-bcfe-462e-8251-0b063275de4d None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:49.047915 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8685dc9-bcfe-462e-8251-0b063275de4d None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:49.048201 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8685dc9-bcfe-462e-8251-0b063275de4d None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:49.048952 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8685dc9-bcfe-462e-8251-0b063275de4d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:49.049270 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8685dc9-bcfe-462e-8251-0b063275de4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:49.050830 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8685dc9-bcfe-462e-8251-0b063275de4d None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:49.056410 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 396/792] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Jul 27 18:25:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:49.057398 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8685dc9-bcfe-462e-8251-0b063275de4d None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:49.064408 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:49.092696 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c9596-665f-495c-b2f1-3c7a9920e49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:49.093285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c9596-665f-495c-b2f1-3c7a9920e49e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:49.093577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c9596-665f-495c-b2f1-3c7a9920e49e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:49.093843 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c9596-665f-495c-b2f1-3c7a9920e49e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:49.104788 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c9596-665f-495c-b2f1-3c7a9920e49e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:49.109862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-7e0c9596-665f-495c-b2f1-3c7a9920e49e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:49.109862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:49.109862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:49.109862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:49.109862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:49.109862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:49.109862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:49.109862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:49.109862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:49.109862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:49.109862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:49.109862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:49.109862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:49.109862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:49.109862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:49.109862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:49.111113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:49.111113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:49.111113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:49.111113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:49.111113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:49.111113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:49.111113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:49.111113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:49.111113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:49.111113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:49.111113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:49.111113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:49.111113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:49.111113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:49.111113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:49.111113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:49.112616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:49.112616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:49.112616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:49.112616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:49.112616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:49.112616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:49.112616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:49.112616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:49.112616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:49.112616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:49.112616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:49.112616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:49.112616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 397/793] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:25:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:49.112616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c9596-665f-495c-b2f1-3c7a9920e49e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:49.162693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:49.180694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8685dc9-bcfe-462e-8251-0b063275de4d None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:49.216645 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a78c20-c694-4352-993b-a45dc3d88478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:49.217278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a78c20-c694-4352-993b-a45dc3d88478 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:49.217567 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a78c20-c694-4352-993b-a45dc3d88478 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:49.217873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a78c20-c694-4352-993b-a45dc3d88478 None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:49.219481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a78c20-c694-4352-993b-a45dc3d88478 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:49.219798 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a78c20-c694-4352-993b-a45dc3d88478 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:49.221243 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a78c20-c694-4352-993b-a45dc3d88478 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:49.224778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c9596-665f-495c-b2f1-3c7a9920e49e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:49.239953 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 397/794] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Jul 27 18:25:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:49.244981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a78c20-c694-4352-993b-a45dc3d88478 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:49.262491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68daa01-525f-4984-929f-ee38e8325836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:49.263125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68daa01-525f-4984-929f-ee38e8325836 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:49.263450 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68daa01-525f-4984-929f-ee38e8325836 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:49.263731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68daa01-525f-4984-929f-ee38e8325836 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:49.264497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68daa01-525f-4984-929f-ee38e8325836 None admin] RBAC: Adding query filter params (interface=public, service_id=edcdcb466e77492cacae7f8ddbd8536a, region_id=RegionOne) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:49.264814 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68daa01-525f-4984-929f-ee38e8325836 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:49.266973 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68daa01-525f-4984-929f-ee38e8325836 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:49.278864 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 398/795] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 18:25:49 2022] GET /identity/v3/endpoints?service_id=edcdcb466e77492cacae7f8ddbd8536a&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:49.278864 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68daa01-525f-4984-929f-ee38e8325836 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:49.317225 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:49.356204 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a78c20-c694-4352-993b-a45dc3d88478 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:49.391844 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68daa01-525f-4984-929f-ee38e8325836 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:49.394226 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62aff14-4150-472e-848c-9039907d07e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:49.394863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62aff14-4150-472e-848c-9039907d07e5 None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:49.395149 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62aff14-4150-472e-848c-9039907d07e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:49.395456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62aff14-4150-472e-848c-9039907d07e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:49.396170 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62aff14-4150-472e-848c-9039907d07e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:49.397545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62aff14-4150-472e-848c-9039907d07e5 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:49.400791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:49.444204 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17165760-8e47-4d2d-9856-77b4abc58b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:49.444854 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17165760-8e47-4d2d-9856-77b4abc58b3a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:49.445141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17165760-8e47-4d2d-9856-77b4abc58b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:49.445422 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17165760-8e47-4d2d-9856-77b4abc58b3a None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:49.446184 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17165760-8e47-4d2d-9856-77b4abc58b3a None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:49.446497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17165760-8e47-4d2d-9856-77b4abc58b3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:49.447919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17165760-8e47-4d2d-9856-77b4abc58b3a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:49.458136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 399/796] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 18:25:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:49.458973 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17165760-8e47-4d2d-9856-77b4abc58b3a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:49.566277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17165760-8e47-4d2d-9856-77b4abc58b3a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:49.572219 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 398/797] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:49.573058 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62aff14-4150-472e-848c-9039907d07e5 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:49.627697 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd16354-4941-4705-b44e-60eea6b178c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:49.627905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd16354-4941-4705-b44e-60eea6b178c2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:49.628097 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd16354-4941-4705-b44e-60eea6b178c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:49.628385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd16354-4941-4705-b44e-60eea6b178c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:49.642190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd16354-4941-4705-b44e-60eea6b178c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:49.643857 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd16354-4941-4705-b44e-60eea6b178c2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:49.661029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-fbd16354-4941-4705-b44e-60eea6b178c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:49.661029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:49.661029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:49.661029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:49.661029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:49.661029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:49.661029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:49.661029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:49.661029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:49.661029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:49.661029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:49.661029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:49.661029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:49.661029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:49.661029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:49.662648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:49.662648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:49.662648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:49.662648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:49.662648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:49.662648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:49.662648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:49.662648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:49.662648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:49.662648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:49.662648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:49.662648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:49.662648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:49.662648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:49.662648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:49.662648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:49.662648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:49.663752 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:49.663752 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:49.663752 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:49.663752 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:49.667083 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 400/798] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:49.668115 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd16354-4941-4705-b44e-60eea6b178c2 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:49.690742 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:49.734681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62aff14-4150-472e-848c-9039907d07e5 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:49.759647 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:49.779561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2fb9b-490f-4b8f-8341-844d50464e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:49.780324 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2fb9b-490f-4b8f-8341-844d50464e4e None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:49.781231 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2fb9b-490f-4b8f-8341-844d50464e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:49.781578 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2fb9b-490f-4b8f-8341-844d50464e4e None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:49.782317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2fb9b-490f-4b8f-8341-844d50464e4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:49.783822 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2fb9b-490f-4b8f-8341-844d50464e4e None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:49.789995 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 399/799] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 18:25:49 2022] GET /identity/v3/services => generated 772 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:49.790256 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd16354-4941-4705-b44e-60eea6b178c2 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:49.790877 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2fb9b-490f-4b8f-8341-844d50464e4e None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:49.837310 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a21979-1d6f-4d13-87d2-39bc56ec6828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:49.838037 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a21979-1d6f-4d13-87d2-39bc56ec6828 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:49.838321 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a21979-1d6f-4d13-87d2-39bc56ec6828 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:49.838647 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a21979-1d6f-4d13-87d2-39bc56ec6828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:49.854112 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a21979-1d6f-4d13-87d2-39bc56ec6828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:49.855638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a21979-1d6f-4d13-87d2-39bc56ec6828 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:49.880853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-b7a21979-1d6f-4d13-87d2-39bc56ec6828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:49.880853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:49.880853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:49.880853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:49.880853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:49.880853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:49.880853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:49.880853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:49.880853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:49.880853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:49.880853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:49.880853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:49.880853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:49.880853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:49.880853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:49.881808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:49.881808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:49.881808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:49.881808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:49.881808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:49.881808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:49.881808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:49.881808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:49.881808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:49.881808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:49.881808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:49.881808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:49.881808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:49.881808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:49.881808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:49.881808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:49.881808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:49.882807 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:49.882807 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:49.882807 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:49.882807 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:49.882807 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 401/800] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:49.887741 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a21979-1d6f-4d13-87d2-39bc56ec6828 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:49.920072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2fb9b-490f-4b8f-8341-844d50464e4e None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:49.961355 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82161f66-ea46-4f35-a886-03e0c53b9799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:49.962100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82161f66-ea46-4f35-a886-03e0c53b9799 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:49.962457 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82161f66-ea46-4f35-a886-03e0c53b9799 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:49.962810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82161f66-ea46-4f35-a886-03e0c53b9799 None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:49.963647 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82161f66-ea46-4f35-a886-03e0c53b9799 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:49.964035 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82161f66-ea46-4f35-a886-03e0c53b9799 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:49.967121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82161f66-ea46-4f35-a886-03e0c53b9799 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:49.985408 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 400/801] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:49.986848 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82161f66-ea46-4f35-a886-03e0c53b9799 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:50.012024 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:50.045162 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:50.056500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a21979-1d6f-4d13-87d2-39bc56ec6828 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:50.109280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5083e-efea-44af-a932-e04926c4c473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:50.109280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5083e-efea-44af-a932-e04926c4c473 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:50.109280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5083e-efea-44af-a932-e04926c4c473 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:50.109720 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5083e-efea-44af-a932-e04926c4c473 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:50.110649 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5083e-efea-44af-a932-e04926c4c473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:50.110970 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5083e-efea-44af-a932-e04926c4c473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:50.113311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5083e-efea-44af-a932-e04926c4c473 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:50.120234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82161f66-ea46-4f35-a886-03e0c53b9799 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:50.128565 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 402/802] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:50.130046 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d9167-aaec-491e-a29f-07ab7c9d5e65 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:50.130407 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d9167-aaec-491e-a29f-07ab7c9d5e65 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:50.130970 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d9167-aaec-491e-a29f-07ab7c9d5e65 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:50.132588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 403/803] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:50.136459 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d9167-aaec-491e-a29f-07ab7c9d5e65 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:50.162219 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1c14f-c56e-4133-80b6-8409e7e79792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:50.162983 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1c14f-c56e-4133-80b6-8409e7e79792 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:50.163369 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1c14f-c56e-4133-80b6-8409e7e79792 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:50.163710 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1c14f-c56e-4133-80b6-8409e7e79792 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:50.174451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1c14f-c56e-4133-80b6-8409e7e79792 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:50.176794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1c14f-c56e-4133-80b6-8409e7e79792 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:50.191980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-5ce1c14f-c56e-4133-80b6-8409e7e79792 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:50.191980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:50.191980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:50.191980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:50.191980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:50.191980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:50.191980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:50.191980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:50.191980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:50.191980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:50.191980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:50.191980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:50.191980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:50.191980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:50.191980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:50.192981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:50.192981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:50.192981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:50.192981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:50.192981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:50.192981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:50.192981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:50.192981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:50.192981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:50.192981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:50.192981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:50.192981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:50.192981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:50.192981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:50.192981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:50.192981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:50.192981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:50.193917 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:50.193917 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:50.193917 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:50.193917 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:50.193917 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:50.193917 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:50.193917 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:50.193917 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:50.194839 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 401/804] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:50.199350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e873e-342f-4c24-8814-97989420a1a1 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:50.199350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e873e-342f-4c24-8814-97989420a1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:50.199350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e873e-342f-4c24-8814-97989420a1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:50.219839 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-6a6e873e-342f-4c24-8814-97989420a1a1 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:50.221643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-6a6e873e-342f-4c24-8814-97989420a1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:50.259341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d9167-aaec-491e-a29f-07ab7c9d5e65 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:50.288820 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:50.297861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19aaf6d-c018-44c9-8171-1de92b5b9a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:50.298715 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aaf6d-c018-44c9-8171-1de92b5b9a10 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:50.299069 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aaf6d-c018-44c9-8171-1de92b5b9a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:50.299451 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aaf6d-c018-44c9-8171-1de92b5b9a10 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:50.307679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19aaf6d-c018-44c9-8171-1de92b5b9a10 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:50.309270 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19aaf6d-c018-44c9-8171-1de92b5b9a10 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:50.316035 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 402/805] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:25:50.316918 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e873e-342f-4c24-8814-97989420a1a1 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:50.322440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-a19aaf6d-c018-44c9-8171-1de92b5b9a10 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:25:50.322440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:50.322440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:50.322440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:50.322440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:50.322440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:50.322440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:50.322440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:50.322440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:50.322440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:50.322440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:50.322440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:50.322440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:50.322440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:50.322440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:50.322440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:50.324491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:50.324491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:50.324491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:50.324491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:50.324491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:50.324491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:50.324491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:50.324491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:50.324491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:50.324491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:50.324491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:50.324491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:50.324491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:50.324491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:50.324491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:50.324491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:50.324491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:50.324491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:50.325901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:50.325901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:50.325901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:50.325901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:50.325901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:50.325901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:50.325901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:50.325901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:50.325901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:25:50.325901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:50.325901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 404/806] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 18:25:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:50.332425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19aaf6d-c018-44c9-8171-1de92b5b9a10 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:50.375191 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:50.456825 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e873e-342f-4c24-8814-97989420a1a1 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:50.484494 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19aaf6d-c018-44c9-8171-1de92b5b9a10 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:50.498390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6e665-8535-41e7-aab2-ca690783d9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:50.500455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6e665-8535-41e7-aab2-ca690783d9fe None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:50.500774 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6e665-8535-41e7-aab2-ca690783d9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:50.501275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6e665-8535-41e7-aab2-ca690783d9fe None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:50.501837 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6e665-8535-41e7-aab2-ca690783d9fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:50.502153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6e665-8535-41e7-aab2-ca690783d9fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:50.503635 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6e665-8535-41e7-aab2-ca690783d9fe None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:50.522351 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 403/807] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:50.523398 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6e665-8535-41e7-aab2-ca690783d9fe None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:50.525946 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0af47-18bd-4bbd-b97f-6bc7964d691e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:50.527025 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0af47-18bd-4bbd-b97f-6bc7964d691e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:50.528392 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0af47-18bd-4bbd-b97f-6bc7964d691e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:50.528880 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0af47-18bd-4bbd-b97f-6bc7964d691e None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:50.529908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0af47-18bd-4bbd-b97f-6bc7964d691e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:50.530417 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0af47-18bd-4bbd-b97f-6bc7964d691e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:50.532697 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0af47-18bd-4bbd-b97f-6bc7964d691e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:50.555115 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 405/808] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Jul 27 18:25:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:50.556445 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0af47-18bd-4bbd-b97f-6bc7964d691e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:50.614651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:50.653133 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:50.664555 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6e665-8535-41e7-aab2-ca690783d9fe None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:50.677600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0af47-18bd-4bbd-b97f-6bc7964d691e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:50.711755 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5771222-0953-408d-8254-37cd5805ab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:50.712710 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5771222-0953-408d-8254-37cd5805ab40 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:50.712996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5771222-0953-408d-8254-37cd5805ab40 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:50.713272 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5771222-0953-408d-8254-37cd5805ab40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:50.718708 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7830cf-d0ba-4ddb-ae3c-befe97ae7283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:50.719823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7830cf-d0ba-4ddb-ae3c-befe97ae7283 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:50.720326 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7830cf-d0ba-4ddb-ae3c-befe97ae7283 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:50.720797 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7830cf-d0ba-4ddb-ae3c-befe97ae7283 None admin] PATH_INFO: `/v3/projects/2880a34079d742c38bfdace2c04564c7/users/7832398e97af4e539e10d1eef49f6d6f/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:50.723209 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7830cf-d0ba-4ddb-ae3c-befe97ae7283 None admin] RBAC: Authorizing `identity:create_grant(project_id=2880a34079d742c38bfdace2c04564c7, user_id=7832398e97af4e539e10d1eef49f6d6f, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:50.724997 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7830cf-d0ba-4ddb-ae3c-befe97ae7283 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:50.725515 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5771222-0953-408d-8254-37cd5805ab40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:50.731416 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-b5771222-0953-408d-8254-37cd5805ab40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:25:50.731416 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:50.731416 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:50.731416 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:50.731416 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:50.731416 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:50.731416 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:50.731416 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:50.731416 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:50.731416 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:50.731416 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:50.731416 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:50.731416 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:50.731416 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:50.731416 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:50.731416 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:50.732431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:50.732431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:50.732431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:50.732431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:50.732431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:50.732431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:50.732431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:50.732431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:50.732431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:50.732431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:50.732431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:50.732431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:50.732431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:50.732431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:50.732431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:50.732431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:50.733273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:50.733273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:50.733273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:50.733273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:50.733273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:50.733273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:50.733273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:50.733273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:50.733273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:50.733273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:50.733273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:25:50.733273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:50.738394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 404/809] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:25:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:50.739709 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5771222-0953-408d-8254-37cd5805ab40 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:50.797806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 406/810] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:25:50 2022] PUT /identity/v3/projects/2880a34079d742c38bfdace2c04564c7/users/7832398e97af4e539e10d1eef49f6d6f/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:50.798837 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7830cf-d0ba-4ddb-ae3c-befe97ae7283 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:50.938526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5771222-0953-408d-8254-37cd5805ab40 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:50.951793 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7830cf-d0ba-4ddb-ae3c-befe97ae7283 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:50.963331 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:50.997984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6284e0-3ec9-4392-bc01-28a0d1636fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:50.999893 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6284e0-3ec9-4392-bc01-28a0d1636fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:51.000497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6284e0-3ec9-4392-bc01-28a0d1636fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:51.001675 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6284e0-3ec9-4392-bc01-28a0d1636fa0 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:51.002681 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6284e0-3ec9-4392-bc01-28a0d1636fa0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:51.003212 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6284e0-3ec9-4392-bc01-28a0d1636fa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:51.005379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6284e0-3ec9-4392-bc01-28a0d1636fa0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:51.016877 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 407/811] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:25:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:51.026046 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6284e0-3ec9-4392-bc01-28a0d1636fa0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:51.042773 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc0f7b-0eda-4329-8d47-8bf31352a280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:51.043457 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc0f7b-0eda-4329-8d47-8bf31352a280 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:51.043736 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc0f7b-0eda-4329-8d47-8bf31352a280 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:51.044079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc0f7b-0eda-4329-8d47-8bf31352a280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:51.061464 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc0f7b-0eda-4329-8d47-8bf31352a280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:51.063166 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc0f7b-0eda-4329-8d47-8bf31352a280 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:51.084246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-28cc0f7b-0eda-4329-8d47-8bf31352a280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:51.084246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:51.084246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:51.084246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:51.084246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:51.084246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:51.084246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:51.084246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:51.084246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:51.084246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:51.084246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:51.084246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:51.084246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:51.084246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:51.084246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:51.085411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:51.085411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:51.085411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:51.085411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:51.085411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:51.085411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:51.085411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:51.085411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:51.085411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:51.085411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:51.085411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:51.085411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:51.085411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:51.085411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:51.085411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:51.085411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:51.085411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:51.086526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:51.086526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:51.086526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:51.086526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:51.088297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 405/812] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:51.095290 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc0f7b-0eda-4329-8d47-8bf31352a280 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:51.101077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:51.167193 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6284e0-3ec9-4392-bc01-28a0d1636fa0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:51.233377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc0f7b-0eda-4329-8d47-8bf31352a280 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:51.240789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f7eac-d3c1-44df-a6f2-96399dbad57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:51.241457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f7eac-d3c1-44df-a6f2-96399dbad57a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:51.241743 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f7eac-d3c1-44df-a6f2-96399dbad57a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:51.242021 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f7eac-d3c1-44df-a6f2-96399dbad57a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:51.269397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f7eac-d3c1-44df-a6f2-96399dbad57a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:51.270876 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f7eac-d3c1-44df-a6f2-96399dbad57a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:51.273117 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cad1e5-f3df-4e7e-ab07-d47124ea660c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:51.273740 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cad1e5-f3df-4e7e-ab07-d47124ea660c None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:51.274021 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cad1e5-f3df-4e7e-ab07-d47124ea660c None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:51.274292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cad1e5-f3df-4e7e-ab07-d47124ea660c None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:51.274988 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cad1e5-f3df-4e7e-ab07-d47124ea660c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:51.275306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cad1e5-f3df-4e7e-ab07-d47124ea660c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:51.277060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cad1e5-f3df-4e7e-ab07-d47124ea660c None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:51.291347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 406/813] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:51.300312 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cad1e5-f3df-4e7e-ab07-d47124ea660c None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:51.309001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-298f7eac-d3c1-44df-a6f2-96399dbad57a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:51.309001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:51.309001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:51.309001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:51.309001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:51.309001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:51.309001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:51.309001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:51.309001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:51.309001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:51.309001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:51.309001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:51.309001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:51.309001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:51.309001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:51.309949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:51.309949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:51.309949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:51.309949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:51.309949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:51.309949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:51.309949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:51.309949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:51.309949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:51.309949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:51.309949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:51.309949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:51.309949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:51.309949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:51.309949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:51.309949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:51.309949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:51.311562 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:51.311562 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:51.311562 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:51.311562 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:51.311562 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 408/814] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:51.317346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f7eac-d3c1-44df-a6f2-96399dbad57a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:51.353522 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:51.423653 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:51.476960 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cad1e5-f3df-4e7e-ab07-d47124ea660c None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:51.523207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f2709-5766-44bd-8c50-70c39bc08ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:51.523925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f2709-5766-44bd-8c50-70c39bc08ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:51.524287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f2709-5766-44bd-8c50-70c39bc08ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:51.524638 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f2709-5766-44bd-8c50-70c39bc08ab2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:51.525262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f7eac-d3c1-44df-a6f2-96399dbad57a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:51.533688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f2709-5766-44bd-8c50-70c39bc08ab2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:51.535228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f2709-5766-44bd-8c50-70c39bc08ab2 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:51.550102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-182f2709-5766-44bd-8c50-70c39bc08ab2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:51.550102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:51.550102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:51.550102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:51.550102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:51.550102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:51.550102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:51.550102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:51.550102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:51.550102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:51.550102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:51.550102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:51.550102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:51.550102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:51.550102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:51.551077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:51.551077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:51.551077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:51.551077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:51.551077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:51.551077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:51.551077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:51.551077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:51.551077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:51.551077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:51.551077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:51.551077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:51.551077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:51.551077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:51.551077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:51.551077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:51.551077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:51.552032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:51.552032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:51.552032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:51.552032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:51.552032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:51.552032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:51.552032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:51.552032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:51.556216 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 407/815] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:51.559655 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f2709-5766-44bd-8c50-70c39bc08ab2 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:51.615998 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a060c19-90f3-43e5-8b13-b4ced330ad99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:51.616757 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a060c19-90f3-43e5-8b13-b4ced330ad99 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:51.617040 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a060c19-90f3-43e5-8b13-b4ced330ad99 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:51.617439 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a060c19-90f3-43e5-8b13-b4ced330ad99 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:51.618203 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a060c19-90f3-43e5-8b13-b4ced330ad99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:51.618513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a060c19-90f3-43e5-8b13-b4ced330ad99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:51.619941 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a060c19-90f3-43e5-8b13-b4ced330ad99 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:51.649788 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 409/816] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:51.656996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a060c19-90f3-43e5-8b13-b4ced330ad99 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:51.676776 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f2709-5766-44bd-8c50-70c39bc08ab2 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:51.705434 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:51.719294 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fadfac-4223-4122-85ba-336462233c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:51.720757 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fadfac-4223-4122-85ba-336462233c45 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:51.721348 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fadfac-4223-4122-85ba-336462233c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:51.724473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fadfac-4223-4122-85ba-336462233c45 None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:51.724473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fadfac-4223-4122-85ba-336462233c45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:51.724473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fadfac-4223-4122-85ba-336462233c45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:51.724473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fadfac-4223-4122-85ba-336462233c45 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:51.740703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 408/817] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:51.748111 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fadfac-4223-4122-85ba-336462233c45 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:51.847979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:51.887901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a060c19-90f3-43e5-8b13-b4ced330ad99 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:51.940708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fadfac-4223-4122-85ba-336462233c45 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:51.959771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2434f79-bc54-44ba-b897-824143c51705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:51.960425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2434f79-bc54-44ba-b897-824143c51705 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:51.960707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2434f79-bc54-44ba-b897-824143c51705 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:51.960980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2434f79-bc54-44ba-b897-824143c51705 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:51.975134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2434f79-bc54-44ba-b897-824143c51705 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:51.977538 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2434f79-bc54-44ba-b897-824143c51705 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:51.997060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5f8ef-9120-4360-a39c-45292fd44fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:51.997738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5f8ef-9120-4360-a39c-45292fd44fc1 None admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:51.998020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5f8ef-9120-4360-a39c-45292fd44fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:51.998301 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5f8ef-9120-4360-a39c-45292fd44fc1 None admin] PATH_INFO: `/v3/projects/2880a34079d742c38bfdace2c04564c7/users/5b4c4184e87b4dc5a4047310cd0122ba/roles/ff0af8236fc84d82bf84c8d2d11c11ca` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:52.000458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-d2434f79-bc54-44ba-b897-824143c51705 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:25:52.000458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:52.000458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:52.000458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:52.000458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:52.000458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:52.000458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:52.000458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:52.000458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:52.000458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:52.000458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:52.000458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:52.000458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:52.000458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:52.000458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:52.000458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:52.001641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:52.001641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:52.001641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:52.001641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:52.001641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:52.001641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:52.001641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:52.001641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:52.001641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:52.001641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:52.001641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:52.001641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:52.001641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:52.001641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:52.001641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:52.001641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:52.001641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:52.001641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:52.002605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:52.002605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:52.002605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:52.002605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:52.002605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:52.002605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:52.002605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:52.002605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:52.002605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:25:52.002605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:52.007054 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 410/818] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 18:25:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:52.007957 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2434f79-bc54-44ba-b897-824143c51705 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:52.016292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5f8ef-9120-4360-a39c-45292fd44fc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2880a34079d742c38bfdace2c04564c7, user_id=5b4c4184e87b4dc5a4047310cd0122ba, role_id=ff0af8236fc84d82bf84c8d2d11c11ca)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:52.017776 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5f8ef-9120-4360-a39c-45292fd44fc1 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:52.092587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 409/819] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:25:51 2022] PUT /identity/v3/projects/2880a34079d742c38bfdace2c04564c7/users/5b4c4184e87b4dc5a4047310cd0122ba/roles/ff0af8236fc84d82bf84c8d2d11c11ca => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:52.111082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf80df-981b-4c33-85d2-cfbea1611b50 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:52.111402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf80df-981b-4c33-85d2-cfbea1611b50 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:52.111644 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf80df-981b-4c33-85d2-cfbea1611b50 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:52.114514 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 410/820] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:52.123157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebbdca-942f-4df6-b448-39b5768896cd None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:52.123781 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebbdca-942f-4df6-b448-39b5768896cd None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:52.124063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebbdca-942f-4df6-b448-39b5768896cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:52.138727 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2434f79-bc54-44ba-b897-824143c51705 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:52.165599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-65ebbdca-942f-4df6-b448-39b5768896cd None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:52.166810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-65ebbdca-942f-4df6-b448-39b5768896cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:52.179471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f2ab8-6cd8-4d95-add6-157c268dfde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:52.180118 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f2ab8-6cd8-4d95-add6-157c268dfde2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:52.180400 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f2ab8-6cd8-4d95-add6-157c268dfde2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:52.180675 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f2ab8-6cd8-4d95-add6-157c268dfde2 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:52.181512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f2ab8-6cd8-4d95-add6-157c268dfde2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:52.181826 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f2ab8-6cd8-4d95-add6-157c268dfde2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:52.183433 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f2ab8-6cd8-4d95-add6-157c268dfde2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:52.211583 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:52.227471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 411/821] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 18:25:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:52.232174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:52.239327 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f2ab8-6cd8-4d95-add6-157c268dfde2 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:52.297372 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 411/822] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:25:52.304202 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5586c-1422-432a-a97f-e005e4f6eb67 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:52.304982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5586c-1422-432a-a97f-e005e4f6eb67 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:52.305435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5586c-1422-432a-a97f-e005e4f6eb67 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:52.307088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 412/823] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:52.315375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a707e-2204-4ce2-a592-70acdf069254 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:52.316689 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a707e-2204-4ce2-a592-70acdf069254 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:52.317321 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a707e-2204-4ce2-a592-70acdf069254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:52.344136 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-439a707e-2204-4ce2-a592-70acdf069254 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:52.345434 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-439a707e-2204-4ce2-a592-70acdf069254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:52.377470 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f2ab8-6cd8-4d95-add6-157c268dfde2 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:52.421503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de6887-8792-42c8-bbe1-8d71433500a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:52.422155 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de6887-8792-42c8-bbe1-8d71433500a0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:52.422662 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de6887-8792-42c8-bbe1-8d71433500a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:52.422953 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de6887-8792-42c8-bbe1-8d71433500a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:52.436429 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 413/824] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:25:52.438593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a707e-2204-4ce2-a592-70acdf069254 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:52.513809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:52.519468 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de6887-8792-42c8-bbe1-8d71433500a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:52.521661 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de6887-8792-42c8-bbe1-8d71433500a0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:52.569971 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:52.580882 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a707e-2204-4ce2-a592-70acdf069254 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:52.674992 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5759d-a0de-440e-826e-ff8030dd4031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:52.675706 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5759d-a0de-440e-826e-ff8030dd4031 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:52.675987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5759d-a0de-440e-826e-ff8030dd4031 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:52.676260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5759d-a0de-440e-826e-ff8030dd4031 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:52.676909 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5759d-a0de-440e-826e-ff8030dd4031 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:52.679034 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5759d-a0de-440e-826e-ff8030dd4031 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:52.695293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 412/825] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:25:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:25:52.695293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de6887-8792-42c8-bbe1-8d71433500a0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:52.707297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-d4d5759d-a0de-440e-826e-ff8030dd4031 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:25:52.707297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:52.707297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:25:52.707297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:25:52.707297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:25:52.707297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:25:52.707297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:25:52.707297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:25:52.707297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:25:52.707297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:52.707297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:25:52.707297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:52.707297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:52.707297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:52.707297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:52.707297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:52.707297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:52.708377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:52.708377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:52.708377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:52.708377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:52.708377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:52.708377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:52.708377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:25:52.708377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:25:52.708377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:25:52.708377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:25:52.708377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:52.708377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:52.708377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:52.708377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:52.708377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:52.708377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:52.709239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:52.709239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:52.709239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:52.709239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:52.709239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:52.709239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:52.709239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:52.709239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:52.709239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:52.709239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:52.709239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:25:52.709239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:25:52.709239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:25:52.709239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:52.722148 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 414/826] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 18:25:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:52.722148 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5759d-a0de-440e-826e-ff8030dd4031 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:52.827285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de6887-8792-42c8-bbe1-8d71433500a0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:52.831285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:52.899288 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438de82-6dba-496c-9ccf-efbf666ef854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:52.899288 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438de82-6dba-496c-9ccf-efbf666ef854 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:52.899288 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438de82-6dba-496c-9ccf-efbf666ef854 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:52.899288 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438de82-6dba-496c-9ccf-efbf666ef854 None admin] PATH_INFO: `/v3/services/network` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:52.899729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438de82-6dba-496c-9ccf-efbf666ef854 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:52.899729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438de82-6dba-496c-9ccf-efbf666ef854 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:52.920252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-8438de82-6dba-496c-9ccf-efbf666ef854 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:25:52.920252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:52.920252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:25:52.920252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:25:52.920252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:25:52.920252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:25:52.920252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:25:52.920252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:25:52.920252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:25:52.920252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:52.920252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:25:52.920252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:52.920252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:52.920252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:52.920252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:52.920252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:52.920252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:52.921376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:52.921376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:52.921376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:52.921376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:52.921376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:52.921376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:52.921376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:25:52.921376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:25:52.921376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:25:52.921376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:25:52.921376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:52.921376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:52.921376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:52.921376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:52.921376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:52.921376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:52.922559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:52.922559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:52.922559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:52.922559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:52.922559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:52.922559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:52.922559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:52.922559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:52.922559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:52.922559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:52.922559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:25:52.922559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:25:52.922559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:25:52.922559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:52.924048 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5759d-a0de-440e-826e-ff8030dd4031 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:52.924219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 413/827] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:52 2022] GET /identity/v3/services/network => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:52.924219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438de82-6dba-496c-9ccf-efbf666ef854 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:52.972224 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232122f-ed7a-4eac-81bd-b81503e41543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:52.974739 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232122f-ed7a-4eac-81bd-b81503e41543 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:52.974739 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232122f-ed7a-4eac-81bd-b81503e41543 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:52.974739 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232122f-ed7a-4eac-81bd-b81503e41543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:52.987973 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232122f-ed7a-4eac-81bd-b81503e41543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:52.989695 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232122f-ed7a-4eac-81bd-b81503e41543 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:53.008072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-e232122f-ed7a-4eac-81bd-b81503e41543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:53.008072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:53.008072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:53.008072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:53.008072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:53.008072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:53.008072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:53.008072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:53.008072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:53.008072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:53.008072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:53.008072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:53.008072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:53.008072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:53.008072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:53.010176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:53.010176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:53.010176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:53.010176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:53.010176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:53.010176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:53.010176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:53.010176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:53.010176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:53.010176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:53.010176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:53.010176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:53.010176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:53.010176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:53.010176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:53.010176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:53.010176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:53.012354 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:53.012354 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:53.012354 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:53.012354 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:53.019304 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 415/828] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:53.019304 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232122f-ed7a-4eac-81bd-b81503e41543 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:53.043936 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:53.153581 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232122f-ed7a-4eac-81bd-b81503e41543 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:53.175639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438de82-6dba-496c-9ccf-efbf666ef854 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:53.204339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cea9a-7197-40cd-92fc-2407dd17515f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:53.205957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cea9a-7197-40cd-92fc-2407dd17515f None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:53.206476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cea9a-7197-40cd-92fc-2407dd17515f None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:53.207220 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cea9a-7197-40cd-92fc-2407dd17515f None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:53.208436 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cea9a-7197-40cd-92fc-2407dd17515f None admin] RBAC: Adding query filter params (name=network) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:53.209417 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cea9a-7197-40cd-92fc-2407dd17515f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:53.211690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cea9a-7197-40cd-92fc-2407dd17515f None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:53.219679 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 416/829] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 18:25:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:53.220929 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cea9a-7197-40cd-92fc-2407dd17515f None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:53.221499 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c88938-e39c-41c4-94d1-3e878654f997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:53.222117 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c88938-e39c-41c4-94d1-3e878654f997 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:53.222456 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c88938-e39c-41c4-94d1-3e878654f997 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:53.222670 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c88938-e39c-41c4-94d1-3e878654f997 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:53.223371 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c88938-e39c-41c4-94d1-3e878654f997 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:53.223676 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c88938-e39c-41c4-94d1-3e878654f997 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:53.225114 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c88938-e39c-41c4-94d1-3e878654f997 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:53.235617 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 414/830] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 18:25:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:53.237463 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c88938-e39c-41c4-94d1-3e878654f997 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:53.269481 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:53.305227 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:53.332391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cea9a-7197-40cd-92fc-2407dd17515f None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:53.350182 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c88938-e39c-41c4-94d1-3e878654f997 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:53.371954 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe7ca1-ccfd-4127-9b08-00be50c4db05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:53.372723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe7ca1-ccfd-4127-9b08-00be50c4db05 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:53.373010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe7ca1-ccfd-4127-9b08-00be50c4db05 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:53.373287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe7ca1-ccfd-4127-9b08-00be50c4db05 None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:53.374920 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe7ca1-ccfd-4127-9b08-00be50c4db05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:53.375409 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe7ca1-ccfd-4127-9b08-00be50c4db05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:53.377138 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe7ca1-ccfd-4127-9b08-00be50c4db05 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:53.389082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c6126-1774-4b8e-a845-d8a48a4db890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:53.390379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c6126-1774-4b8e-a845-d8a48a4db890 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:53.390557 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c6126-1774-4b8e-a845-d8a48a4db890 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:53.390806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c6126-1774-4b8e-a845-d8a48a4db890 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:53.391725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c6126-1774-4b8e-a845-d8a48a4db890 None admin] RBAC: Adding query filter params (type=network) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:53.392038 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c6126-1774-4b8e-a845-d8a48a4db890 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:53.393427 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c6126-1774-4b8e-a845-d8a48a4db890 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:53.395413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 417/831] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:53.397191 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe7ca1-ccfd-4127-9b08-00be50c4db05 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:53.403900 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 415/832] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 18:25:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:53.405114 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda77983-73c2-46d0-b533-abc9ec801a25 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:53.405456 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda77983-73c2-46d0-b533-abc9ec801a25 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:53.405741 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda77983-73c2-46d0-b533-abc9ec801a25 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:53.411635 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 416/833] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:53.412516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda77983-73c2-46d0-b533-abc9ec801a25 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:53.510378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe7ca1-ccfd-4127-9b08-00be50c4db05 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:53.511524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:53.522855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda77983-73c2-46d0-b533-abc9ec801a25 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:53.555948 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316307bd-3a48-4062-94ce-447b4dd3497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:53.556517 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316307bd-3a48-4062-94ce-447b4dd3497e None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:53.556769 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316307bd-3a48-4062-94ce-447b4dd3497e None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:53.557074 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316307bd-3a48-4062-94ce-447b4dd3497e None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:53.557763 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316307bd-3a48-4062-94ce-447b4dd3497e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:53.558070 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316307bd-3a48-4062-94ce-447b4dd3497e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:53.559549 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316307bd-3a48-4062-94ce-447b4dd3497e None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:53.560887 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:53.562305 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196e3d0-d052-409b-92ea-0e59e3401556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:53.563301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196e3d0-d052-409b-92ea-0e59e3401556 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:53.563663 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196e3d0-d052-409b-92ea-0e59e3401556 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:53.564211 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196e3d0-d052-409b-92ea-0e59e3401556 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:53.575586 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 418/834] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 18:25:53 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:53.575586 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316307bd-3a48-4062-94ce-447b4dd3497e None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:53.584129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196e3d0-d052-409b-92ea-0e59e3401556 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:53.586294 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196e3d0-d052-409b-92ea-0e59e3401556 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:53.602678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-1196e3d0-d052-409b-92ea-0e59e3401556 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:53.602678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:53.602678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:53.602678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:53.602678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:53.602678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:53.602678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:53.602678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:53.602678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:53.602678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:53.602678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:53.602678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:53.602678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:53.602678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:53.602678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:53.603785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:53.603785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:53.603785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:53.603785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:53.603785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:53.603785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:53.603785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:53.603785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:53.603785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:53.603785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:53.603785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:53.603785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:53.603785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:53.603785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:53.603785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:53.603785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:53.603785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:53.604691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:53.604691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:53.604691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:53.604691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:53.604691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:53.604691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:53.604691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:53.604691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:53.607436 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 417/835] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:53.609183 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351e7da-74a2-4920-82ec-5bdc709d8d05 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:53.609481 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351e7da-74a2-4920-82ec-5bdc709d8d05 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:53.610559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351e7da-74a2-4920-82ec-5bdc709d8d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:53.631541 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-3351e7da-74a2-4920-82ec-5bdc709d8d05 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:53.632806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-3351e7da-74a2-4920-82ec-5bdc709d8d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:53.703575 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316307bd-3a48-4062-94ce-447b4dd3497e None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:53.714129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 418/836] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:25:53.715166 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351e7da-74a2-4920-82ec-5bdc709d8d05 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:53.750712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d8378-ca36-4c4c-943a-45080ea008c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:53.751503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d8378-ca36-4c4c-943a-45080ea008c7 None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:53.751805 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d8378-ca36-4c4c-943a-45080ea008c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:53.752069 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d8378-ca36-4c4c-943a-45080ea008c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:53.752911 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d8378-ca36-4c4c-943a-45080ea008c7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:53.754305 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d8378-ca36-4c4c-943a-45080ea008c7 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:53.813620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:53.832996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351e7da-74a2-4920-82ec-5bdc709d8d05 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:53.846611 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 419/837] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:53 2022] POST /identity/v3/endpoints => generated 327 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:53.852412 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d8378-ca36-4c4c-943a-45080ea008c7 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:53.882305 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d7ffd-1af0-4c18-a5bb-935810450719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:53.884467 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d7ffd-1af0-4c18-a5bb-935810450719 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:53.885055 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d7ffd-1af0-4c18-a5bb-935810450719 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:53.885055 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d7ffd-1af0-4c18-a5bb-935810450719 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:53.888277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d7ffd-1af0-4c18-a5bb-935810450719 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:53.888277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d7ffd-1af0-4c18-a5bb-935810450719 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:53.888890 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d7ffd-1af0-4c18-a5bb-935810450719 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:53.918224 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 419/838] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:53.923746 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d7ffd-1af0-4c18-a5bb-935810450719 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:53.988646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:54.080511 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d8378-ca36-4c4c-943a-45080ea008c7 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:54.116147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d7ffd-1af0-4c18-a5bb-935810450719 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:54.122547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737cdb0-eed1-4b4d-b28d-3cfbb802068c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:54.123563 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737cdb0-eed1-4b4d-b28d-3cfbb802068c None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:54.123937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737cdb0-eed1-4b4d-b28d-3cfbb802068c None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:54.125237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737cdb0-eed1-4b4d-b28d-3cfbb802068c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:54.138564 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737cdb0-eed1-4b4d-b28d-3cfbb802068c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:54.144491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-3737cdb0-eed1-4b4d-b28d-3cfbb802068c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:25:54.144491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:54.144491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:54.144491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:54.144491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:54.144491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:54.144491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:54.144491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:54.144491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:54.144491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:54.144491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:54.144491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:54.144491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:54.144491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:54.144491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:54.144491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:54.145497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:54.145497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:54.145497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:54.145497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:54.145497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:54.145497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:54.145497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:54.145497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:54.145497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:54.145497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:54.145497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:54.145497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:54.145497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:54.145497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:54.145497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:54.145497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:54.146350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:54.146350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:54.146350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:54.146350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:54.146350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:54.146350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:54.146350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:54.146350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:54.146350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:54.146350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:54.146350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:25:54.146350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:54.146350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 420/839] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:25:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:54.151934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737cdb0-eed1-4b4d-b28d-3cfbb802068c None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:54.160802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b635807-5e5e-4894-80a3-d3dc4873c10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:54.161724 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b635807-5e5e-4894-80a3-d3dc4873c10d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:54.162190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b635807-5e5e-4894-80a3-d3dc4873c10d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:54.162646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b635807-5e5e-4894-80a3-d3dc4873c10d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:54.164140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b635807-5e5e-4894-80a3-d3dc4873c10d None admin] RBAC: Adding query filter params (role.id=4ae8d11d74f14bcc80117d897ba2f5b6, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=be769d4dd016466f9174e7d5e47a2a0d) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:54.164665 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b635807-5e5e-4894-80a3-d3dc4873c10d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:54.166673 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b635807-5e5e-4894-80a3-d3dc4873c10d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:54.171150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:54.177313 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 420/840] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:25:53 2022] GET /identity/v3/role_assignments?user.id=be769d4dd016466f9174e7d5e47a2a0d&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=4ae8d11d74f14bcc80117d897ba2f5b6 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:54.289196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737cdb0-eed1-4b4d-b28d-3cfbb802068c None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:54.309071 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:54.318147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0c2e9-d0f4-4aa0-8a70-1e66ededd7a9 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:54.318435 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0c2e9-d0f4-4aa0-8a70-1e66ededd7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:54.318719 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0c2e9-d0f4-4aa0-8a70-1e66ededd7a9 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:54.320387 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 421/841] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:25:54.325877 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd30eb-2170-43b2-9f8d-b5993d194997 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:54.326163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd30eb-2170-43b2-9f8d-b5993d194997 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:54.326442 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd30eb-2170-43b2-9f8d-b5993d194997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:54.343391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42754271-fe53-40de-a00e-fe81c2a2b379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:54.344294 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42754271-fe53-40de-a00e-fe81c2a2b379 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:54.344751 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42754271-fe53-40de-a00e-fe81c2a2b379 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:54.345178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42754271-fe53-40de-a00e-fe81c2a2b379 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:54.346075 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42754271-fe53-40de-a00e-fe81c2a2b379 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:54.346533 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42754271-fe53-40de-a00e-fe81c2a2b379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:54.348286 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42754271-fe53-40de-a00e-fe81c2a2b379 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:54.348986 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-67bd30eb-2170-43b2-9f8d-b5993d194997 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:54.350310 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-67bd30eb-2170-43b2-9f8d-b5993d194997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:54.360251 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 421/842] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:25:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:54.366240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42754271-fe53-40de-a00e-fe81c2a2b379 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:54.459162 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 422/843] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:25:54.487850 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd30eb-2170-43b2-9f8d-b5993d194997 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:54.509069 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42754271-fe53-40de-a00e-fe81c2a2b379 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:54.556630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039e2e5-8603-4b59-8dee-efc78381fe54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:54.557625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039e2e5-8603-4b59-8dee-efc78381fe54 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:54.557913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039e2e5-8603-4b59-8dee-efc78381fe54 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:54.558247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039e2e5-8603-4b59-8dee-efc78381fe54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:54.576752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039e2e5-8603-4b59-8dee-efc78381fe54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:54.579713 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039e2e5-8603-4b59-8dee-efc78381fe54 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:54.600287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-a039e2e5-8603-4b59-8dee-efc78381fe54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:54.600287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:54.600287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:54.600287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:54.600287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:54.600287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:54.600287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:54.600287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:54.600287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:54.600287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:54.600287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:54.600287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:54.600287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:54.600287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:54.600287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:54.601384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:54.601384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:54.601384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:54.601384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:54.601384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:54.601384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:54.601384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:54.601384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:54.601384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:54.601384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:54.601384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:54.601384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:54.601384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:54.601384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:54.601384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:54.601384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:54.601384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:54.602336 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:54.602336 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:54.602336 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:54.602336 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:54.602336 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 422/844] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:25:54.607608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039e2e5-8603-4b59-8dee-efc78381fe54 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:54.608905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd30eb-2170-43b2-9f8d-b5993d194997 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:54.641321 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:54.645402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:54.649342 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70727d-a617-4fa7-8870-44ccd4dc7533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:54.650184 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70727d-a617-4fa7-8870-44ccd4dc7533 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:54.650676 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70727d-a617-4fa7-8870-44ccd4dc7533 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:54.651188 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70727d-a617-4fa7-8870-44ccd4dc7533 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:54.664493 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70727d-a617-4fa7-8870-44ccd4dc7533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:25:54.669870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-8a70727d-a617-4fa7-8870-44ccd4dc7533 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:54.669870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:54.669870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:54.669870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:54.669870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:54.669870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:54.669870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:54.669870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:54.669870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:54.669870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:54.669870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:54.669870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:54.669870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:25:54.669870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:25:54.669870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:25:54.669870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:25:54.673190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:25:54.673190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:25:54.673190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:25:54.673190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:25:54.673190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:54.673190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:54.673190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:54.673190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:54.673190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:54.673190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:54.673190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:54.673190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:54.673190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:54.673190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:54.673190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:54.673190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:54.674060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:54.674060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:54.674060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:54.674060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:54.674060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:25:54.674060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:25:54.674060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:25:54.674060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:25:54.674060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:25:54.674060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:25:54.674060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:25:54.674060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:54.674060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 423/845] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:25:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:25:54.679071 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70727d-a617-4fa7-8870-44ccd4dc7533 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:54.750734 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039e2e5-8603-4b59-8dee-efc78381fe54 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:54.809143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70727d-a617-4fa7-8870-44ccd4dc7533 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:54.816009 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305c10e-4112-4593-93f6-43d2d521bf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:54.816987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305c10e-4112-4593-93f6-43d2d521bf87 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:54.817957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305c10e-4112-4593-93f6-43d2d521bf87 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:54.818488 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305c10e-4112-4593-93f6-43d2d521bf87 None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:54.819830 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305c10e-4112-4593-93f6-43d2d521bf87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:54.820361 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305c10e-4112-4593-93f6-43d2d521bf87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:54.822645 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305c10e-4112-4593-93f6-43d2d521bf87 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:54.840263 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 423/846] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:54.846128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305c10e-4112-4593-93f6-43d2d521bf87 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:54.856233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21056399-1ebe-4827-b56b-5efcf1f364d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:54.856850 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21056399-1ebe-4827-b56b-5efcf1f364d4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:54.857190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21056399-1ebe-4827-b56b-5efcf1f364d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:54.857651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21056399-1ebe-4827-b56b-5efcf1f364d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:54.859403 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21056399-1ebe-4827-b56b-5efcf1f364d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:54.859775 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21056399-1ebe-4827-b56b-5efcf1f364d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:54.861601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21056399-1ebe-4827-b56b-5efcf1f364d4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:54.873507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 424/847] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 18:25:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:54.884798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21056399-1ebe-4827-b56b-5efcf1f364d4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:54.962316 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:54.972705 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:54.989780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305c10e-4112-4593-93f6-43d2d521bf87 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:55.019363 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21056399-1ebe-4827-b56b-5efcf1f364d4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:55.037032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cf382-f637-4387-bec1-fe8d5e558292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:55.037688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cf382-f637-4387-bec1-fe8d5e558292 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:55.038446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cf382-f637-4387-bec1-fe8d5e558292 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:55.038737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cf382-f637-4387-bec1-fe8d5e558292 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:55.050074 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41cf382-f637-4387-bec1-fe8d5e558292 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:55.052448 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41cf382-f637-4387-bec1-fe8d5e558292 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:55.069874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-d41cf382-f637-4387-bec1-fe8d5e558292 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:25:55.069874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:55.069874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:55.069874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:55.069874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:55.069874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:55.069874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:55.069874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:55.069874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:55.069874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:55.069874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:55.069874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:55.069874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:55.069874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:55.069874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:55.069874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:55.075561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:55.075561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:55.075561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:55.075561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:55.075561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:55.075561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:55.075561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:55.075561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:55.075561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:55.075561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:55.075561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:55.075561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:55.075561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:55.075561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:55.075561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:55.075561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:55.075561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:55.075561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:55.076616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:55.076616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:55.076616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:55.076616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:55.076616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:55.076616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:55.076616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:55.076616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:55.076616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:25:55.076616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:55.076616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 424/848] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:25:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:25:55.076616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cf382-f637-4387-bec1-fe8d5e558292 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:55.083757 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68cbde-1eb8-4a85-93b3-162dae2d5e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:55.084416 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68cbde-1eb8-4a85-93b3-162dae2d5e85 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:55.084702 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68cbde-1eb8-4a85-93b3-162dae2d5e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:55.084983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68cbde-1eb8-4a85-93b3-162dae2d5e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:55.099352 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68cbde-1eb8-4a85-93b3-162dae2d5e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:55.101159 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68cbde-1eb8-4a85-93b3-162dae2d5e85 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:55.120567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-4b68cbde-1eb8-4a85-93b3-162dae2d5e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:55.120567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:55.120567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:55.120567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:55.120567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:55.120567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:55.120567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:55.120567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:55.120567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:55.120567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:55.120567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:55.120567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:55.120567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:55.120567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:55.120567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:55.121638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:55.121638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:55.121638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:55.121638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:55.121638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:55.121638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:55.121638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:55.121638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:55.121638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:55.121638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:55.121638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:55.121638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:55.121638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:55.121638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:55.121638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:55.121638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:55.121638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:55.122622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:55.122622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:55.122622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:55.122622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:55.127277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 425/849] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:55.128874 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68cbde-1eb8-4a85-93b3-162dae2d5e85 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:55.228826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cf382-f637-4387-bec1-fe8d5e558292 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:55.257047 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68cbde-1eb8-4a85-93b3-162dae2d5e85 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:55.260146 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:55.268541 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb164c46-42a8-4e00-896e-f30fe61006d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:55.269465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb164c46-42a8-4e00-896e-f30fe61006d2 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:55.269921 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb164c46-42a8-4e00-896e-f30fe61006d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:55.272963 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb164c46-42a8-4e00-896e-f30fe61006d2 None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:55.272963 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb164c46-42a8-4e00-896e-f30fe61006d2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:55.272963 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb164c46-42a8-4e00-896e-f30fe61006d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:55.273528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb164c46-42a8-4e00-896e-f30fe61006d2 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:55.293625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 425/850] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Jul 27 18:25:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:55.299724 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb164c46-42a8-4e00-896e-f30fe61006d2 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:55.302446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a85b1-c49a-4479-8a22-3b2ced24a3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:55.303083 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a85b1-c49a-4479-8a22-3b2ced24a3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:55.303394 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a85b1-c49a-4479-8a22-3b2ced24a3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:55.303670 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a85b1-c49a-4479-8a22-3b2ced24a3a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:55.304495 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a85b1-c49a-4479-8a22-3b2ced24a3a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:55.304810 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a85b1-c49a-4479-8a22-3b2ced24a3a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:55.306576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a85b1-c49a-4479-8a22-3b2ced24a3a2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:55.312318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:55.321586 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 426/851] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:55.328136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a85b1-c49a-4479-8a22-3b2ced24a3a2 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:55.415884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb164c46-42a8-4e00-896e-f30fe61006d2 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:55.442195 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a85b1-c49a-4479-8a22-3b2ced24a3a2 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:55.455434 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b692d9-f9eb-4999-a7cf-caa6aec49662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:55.456340 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b692d9-f9eb-4999-a7cf-caa6aec49662 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:55.456727 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b692d9-f9eb-4999-a7cf-caa6aec49662 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:55.457197 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b692d9-f9eb-4999-a7cf-caa6aec49662 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:55.483859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed908033-db51-45a1-b23b-29bd3fa63550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:55.487102 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed908033-db51-45a1-b23b-29bd3fa63550 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:55.487571 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed908033-db51-45a1-b23b-29bd3fa63550 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:55.488254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed908033-db51-45a1-b23b-29bd3fa63550 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:55.497655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed908033-db51-45a1-b23b-29bd3fa63550 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:55.499898 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed908033-db51-45a1-b23b-29bd3fa63550 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:55.513219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-ed908033-db51-45a1-b23b-29bd3fa63550 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:25:55.513219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:55.513219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:55.513219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:55.513219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:55.513219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:55.513219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:55.513219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:55.513219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:55.513219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:55.513219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:55.513219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:55.513219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:25:55.513219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:25:55.513219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:25:55.513219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:25:55.514318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:55.514318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:55.514318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:25:55.514318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:55.514318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:25:55.514318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:25:55.514318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:55.514318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:55.514318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:55.514318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:55.514318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:55.514318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:55.514318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:55.514318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:55.514318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:55.514318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:55.514318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:55.514318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:55.515525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:55.515525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:55.515525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:25:55.515525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:25:55.515525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:25:55.515525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:25:55.515525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:25:55.515525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:25:55.515525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:25:55.515525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:55.522784 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 427/852] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 18:25:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:55.524032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed908033-db51-45a1-b23b-29bd3fa63550 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:55.543381 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b692d9-f9eb-4999-a7cf-caa6aec49662 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:55.544724 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b692d9-f9eb-4999-a7cf-caa6aec49662 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:55.554633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:55.565620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:55.650069 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed908033-db51-45a1-b23b-29bd3fa63550 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:55.658658 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 426/853] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:25:55 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:25:55.664035 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b692d9-f9eb-4999-a7cf-caa6aec49662 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:55.700371 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca6725-c167-464c-b747-ccc74cbb7e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:55.701189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca6725-c167-464c-b747-ccc74cbb7e9d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:55.701489 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca6725-c167-464c-b747-ccc74cbb7e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:55.701768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca6725-c167-464c-b747-ccc74cbb7e9d None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:55.703125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca6725-c167-464c-b747-ccc74cbb7e9d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:55.703464 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca6725-c167-464c-b747-ccc74cbb7e9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:55.705420 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca6725-c167-464c-b747-ccc74cbb7e9d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:55.732271 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 428/854] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Jul 27 18:25:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:55.733782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca6725-c167-464c-b747-ccc74cbb7e9d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:55.792118 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b692d9-f9eb-4999-a7cf-caa6aec49662 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:55.801045 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:55.829315 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1b987-2972-4090-b88a-3db5ab128549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:55.829975 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1b987-2972-4090-b88a-3db5ab128549 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:55.830261 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1b987-2972-4090-b88a-3db5ab128549 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:55.830543 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1b987-2972-4090-b88a-3db5ab128549 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:55.839445 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:55.841959 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1b987-2972-4090-b88a-3db5ab128549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:55.844130 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1b987-2972-4090-b88a-3db5ab128549 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:55.858452 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca6725-c167-464c-b747-ccc74cbb7e9d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:55.860227 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-00e1b987-2972-4090-b88a-3db5ab128549 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:55.860227 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:55.860227 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:55.860227 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:55.860227 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:55.860227 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:55.860227 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:55.860227 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:55.860227 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:55.860227 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:55.860227 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:55.860227 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:55.860227 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:55.860227 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:55.860227 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:55.861096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:55.861096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:55.861096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:55.861096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:55.861096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:55.861096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:55.861096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:55.861096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:55.861096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:55.861096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:55.861096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:55.861096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:55.861096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:55.861096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:55.861096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:55.861096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:55.861096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:55.862043 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:55.862043 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:55.862043 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:55.862043 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:55.862043 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 427/855] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:55.863045 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662fc5a-086a-4912-94a3-01097e5ed903 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:55.863355 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662fc5a-086a-4912-94a3-01097e5ed903 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:55.863636 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662fc5a-086a-4912-94a3-01097e5ed903 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:55.865076 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 428/856] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:55.868119 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662fc5a-086a-4912-94a3-01097e5ed903 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:55.902350 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc291d11-42ae-46b2-9049-7ae3782a1dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:55.902972 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc291d11-42ae-46b2-9049-7ae3782a1dce None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:55.903250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc291d11-42ae-46b2-9049-7ae3782a1dce None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:55.903554 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc291d11-42ae-46b2-9049-7ae3782a1dce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:55.985057 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc291d11-42ae-46b2-9049-7ae3782a1dce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:55.985933 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662fc5a-086a-4912-94a3-01097e5ed903 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:55.986626 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc291d11-42ae-46b2-9049-7ae3782a1dce None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:56.025792 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7776811-c0eb-4001-9477-31eb5bf440b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:56.026549 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7776811-c0eb-4001-9477-31eb5bf440b1 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:56.026841 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7776811-c0eb-4001-9477-31eb5bf440b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:56.027119 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7776811-c0eb-4001-9477-31eb5bf440b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:56.027850 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7776811-c0eb-4001-9477-31eb5bf440b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:56.028155 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7776811-c0eb-4001-9477-31eb5bf440b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:56.029653 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7776811-c0eb-4001-9477-31eb5bf440b1 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:56.044067 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 429/857] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:56.045366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce7946-7b45-4f78-bd67-50750ef1e0d4 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:56.045653 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce7946-7b45-4f78-bd67-50750ef1e0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:56.046036 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce7946-7b45-4f78-bd67-50750ef1e0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:56.065807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-4dce7946-7b45-4f78-bd67-50750ef1e0d4 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:56.067012 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4dce7946-7b45-4f78-bd67-50750ef1e0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:56.076091 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:56.084389 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:56.104764 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 429/858] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:25:55 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:25:56.104764 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc291d11-42ae-46b2-9049-7ae3782a1dce None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:56.157389 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 430/859] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:25:56.157389 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce7946-7b45-4f78-bd67-50750ef1e0d4 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:56.212670 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc291d11-42ae-46b2-9049-7ae3782a1dce None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:56.251158 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796280bc-0a00-4acb-9686-db6573bf3148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:56.251753 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796280bc-0a00-4acb-9686-db6573bf3148 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:56.252031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796280bc-0a00-4acb-9686-db6573bf3148 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:56.252298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796280bc-0a00-4acb-9686-db6573bf3148 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:56.259165 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796280bc-0a00-4acb-9686-db6573bf3148 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:56.260639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796280bc-0a00-4acb-9686-db6573bf3148 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:56.270188 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce7946-7b45-4f78-bd67-50750ef1e0d4 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:56.273100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-796280bc-0a00-4acb-9686-db6573bf3148 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:56.273100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:56.273100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:56.273100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:56.273100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:56.273100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:56.273100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:56.273100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:56.273100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:56.273100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:56.273100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:56.273100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:56.273100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:56.273100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:56.273100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:56.274192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:56.274192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:56.274192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:56.274192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:56.274192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:56.274192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:56.274192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:56.274192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:56.274192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:56.274192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:56.274192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:56.274192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:56.274192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:56.274192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:56.274192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:56.274192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:56.274192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:56.275161 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:56.275161 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:56.275161 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:56.275161 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:56.275161 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:56.275161 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:56.275161 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:56.275161 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:56.275161 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 430/860] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:56.275696 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796280bc-0a00-4acb-9686-db6573bf3148 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:56.313481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524a8f8-b38e-4c3f-9113-317f6dc07a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:56.314393 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524a8f8-b38e-4c3f-9113-317f6dc07a49 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:56.314676 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524a8f8-b38e-4c3f-9113-317f6dc07a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:56.314948 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524a8f8-b38e-4c3f-9113-317f6dc07a49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:56.325527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524a8f8-b38e-4c3f-9113-317f6dc07a49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:56.327131 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524a8f8-b38e-4c3f-9113-317f6dc07a49 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:56.328079 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:56.336593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:56.343982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-1524a8f8-b38e-4c3f-9113-317f6dc07a49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:56.343982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:56.343982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:56.343982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:56.343982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:56.343982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:56.343982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:56.343982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:56.343982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:56.343982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:56.343982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:56.343982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:56.343982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:25:56.343982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:25:56.343982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:25:56.345413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:25:56.345413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:56.345413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:56.345413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:56.345413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:56.345413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:56.345413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:56.345413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:56.345413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:56.345413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:56.345413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:56.345413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:56.345413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:56.345413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:56.345413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:56.345413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:56.345413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:56.346363 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:25:56.346363 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:25:56.346363 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:25:56.346363 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:56.346363 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 431/861] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:56.346363 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524a8f8-b38e-4c3f-9113-317f6dc07a49 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:56.400592 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796280bc-0a00-4acb-9686-db6573bf3148 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:56.436909 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d3b17-2933-4f67-90ee-6bfb41983553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:56.437644 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d3b17-2933-4f67-90ee-6bfb41983553 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:56.437918 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d3b17-2933-4f67-90ee-6bfb41983553 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:56.438190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d3b17-2933-4f67-90ee-6bfb41983553 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:56.438995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d3b17-2933-4f67-90ee-6bfb41983553 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:56.440578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d3b17-2933-4f67-90ee-6bfb41983553 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:56.452370 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524a8f8-b38e-4c3f-9113-317f6dc07a49 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:56.492470 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae5cd2-e450-4a1b-b19c-5e6736f8e66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:56.493373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae5cd2-e450-4a1b-b19c-5e6736f8e66f None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:56.493788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae5cd2-e450-4a1b-b19c-5e6736f8e66f None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:56.494198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae5cd2-e450-4a1b-b19c-5e6736f8e66f None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:56.495387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae5cd2-e450-4a1b-b19c-5e6736f8e66f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:56.495906 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae5cd2-e450-4a1b-b19c-5e6736f8e66f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:56.497670 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae5cd2-e450-4a1b-b19c-5e6736f8e66f None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:56.513383 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 431/862] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 18:25:56 2022] POST /identity/v3/services => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:56.521343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d3b17-2933-4f67-90ee-6bfb41983553 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:56.522207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 432/863] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:56.522207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e416135-e963-4357-bfe5-8c97e75190a7 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:56.522207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e416135-e963-4357-bfe5-8c97e75190a7 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:56.522207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e416135-e963-4357-bfe5-8c97e75190a7 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:56.522207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 433/864] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:56.523628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e19a2a-4bed-4d91-a18f-53f7c935fbcf None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:56.523922 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e19a2a-4bed-4d91-a18f-53f7c935fbcf None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:56.524199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e19a2a-4bed-4d91-a18f-53f7c935fbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:56.544939 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-39e19a2a-4bed-4d91-a18f-53f7c935fbcf None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:56.546951 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-39e19a2a-4bed-4d91-a18f-53f7c935fbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:56.614957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:56.635354 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 434/865] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:56 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:25:56.636491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e19a2a-4bed-4d91-a18f-53f7c935fbcf None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:56.675501 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d3b17-2933-4f67-90ee-6bfb41983553 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:56.677237 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:56.712977 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6b2c2-5dc7-40f6-932a-cfd920397e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:56.713608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6b2c2-5dc7-40f6-932a-cfd920397e58 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:56.713898 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6b2c2-5dc7-40f6-932a-cfd920397e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:56.714175 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6b2c2-5dc7-40f6-932a-cfd920397e58 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:56.714878 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6b2c2-5dc7-40f6-932a-cfd920397e58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:56.715190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6b2c2-5dc7-40f6-932a-cfd920397e58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:56.716621 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6b2c2-5dc7-40f6-932a-cfd920397e58 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:56.740454 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 432/866] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:56.740454 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6b2c2-5dc7-40f6-932a-cfd920397e58 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:56.760733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e19a2a-4bed-4d91-a18f-53f7c935fbcf None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:56.799556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8757d-56e1-4e6b-9384-216ab120a77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:56.800106 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8757d-56e1-4e6b-9384-216ab120a77a None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:56.800390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8757d-56e1-4e6b-9384-216ab120a77a None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:56.800667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8757d-56e1-4e6b-9384-216ab120a77a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:56.801460 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8757d-56e1-4e6b-9384-216ab120a77a None admin] RBAC: Adding query filter params (role.id=4ae8d11d74f14bcc80117d897ba2f5b6, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=7832398e97af4e539e10d1eef49f6d6f) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:56.801770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8757d-56e1-4e6b-9384-216ab120a77a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:56.803207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8757d-56e1-4e6b-9384-216ab120a77a None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:56.809385 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 435/867] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:25:56 2022] GET /identity/v3/role_assignments?user.id=7832398e97af4e539e10d1eef49f6d6f&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=4ae8d11d74f14bcc80117d897ba2f5b6 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:56.810176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8757d-56e1-4e6b-9384-216ab120a77a None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:56.870015 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6b2c2-5dc7-40f6-932a-cfd920397e58 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:56.878381 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:56.920620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a806841-623b-4224-abf9-2be98d5ac4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:56.922612 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a806841-623b-4224-abf9-2be98d5ac4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:56.923156 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a806841-623b-4224-abf9-2be98d5ac4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:56.923635 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a806841-623b-4224-abf9-2be98d5ac4a4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:56.924762 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a806841-623b-4224-abf9-2be98d5ac4a4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:56.926392 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a806841-623b-4224-abf9-2be98d5ac4a4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:56.939103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-8a806841-623b-4224-abf9-2be98d5ac4a4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:25:56.939103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:56.939103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:25:56.939103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:25:56.939103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:25:56.939103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:25:56.939103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:25:56.939103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:25:56.939103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:25:56.939103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:56.939103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:25:56.939103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:56.939103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:56.939103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:56.939103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:56.939103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:56.940178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:56.940178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:56.940178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:56.940178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:56.940178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:56.940178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:56.940178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:56.940178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:25:56.940178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:25:56.940178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:25:56.940178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:25:56.940178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:56.940178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:56.940178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:56.940178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:56.940178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:56.941022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:56.941022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:56.941022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:56.941022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:56.941022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:56.941022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:56.941022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:56.941022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:56.941022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:56.941022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:56.941022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:56.941022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:25:56.941022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:25:56.941022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:25:56.941022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:56.944559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 433/868] 10.222.0.65 () {56 vars in 1132 bytes} [Wed Jul 27 18:25:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:56.950407 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a806841-623b-4224-abf9-2be98d5ac4a4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:56.962799 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8757d-56e1-4e6b-9384-216ab120a77a None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:56.984191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:57.021076 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6a98b-fe3a-4f30-a267-443c6cda9830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:57.022626 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6a98b-fe3a-4f30-a267-443c6cda9830 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:57.023099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6a98b-fe3a-4f30-a267-443c6cda9830 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:57.023800 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6a98b-fe3a-4f30-a267-443c6cda9830 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:57.033401 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6a98b-fe3a-4f30-a267-443c6cda9830 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:57.035953 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6a98b-fe3a-4f30-a267-443c6cda9830 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:57.053708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-44c6a98b-fe3a-4f30-a267-443c6cda9830 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:57.053708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:57.053708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:57.053708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:57.053708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:57.053708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:57.053708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:57.053708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:57.053708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:57.053708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:57.053708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:57.053708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:57.053708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:25:57.053708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:25:57.053708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:25:57.055064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:25:57.055064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:57.055064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:57.055064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:57.055064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:57.055064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:57.055064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:57.055064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:57.055064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:57.055064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:57.055064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:57.055064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:57.055064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:57.055064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:57.055064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:57.055064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:57.055064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:57.056364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:25:57.056364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:25:57.056364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:25:57.056364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:25:57.056364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:25:57.056364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:25:57.056364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:25:57.056364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:57.056364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 436/869] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:25:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:57.061279 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6a98b-fe3a-4f30-a267-443c6cda9830 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:57.092387 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a806841-623b-4224-abf9-2be98d5ac4a4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:57.130615 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91ecdd-a436-4859-95fe-a74a10561916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:57.131367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91ecdd-a436-4859-95fe-a74a10561916 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:57.131709 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91ecdd-a436-4859-95fe-a74a10561916 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:57.132049 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91ecdd-a436-4859-95fe-a74a10561916 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:57.132800 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91ecdd-a436-4859-95fe-a74a10561916 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:57.133186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91ecdd-a436-4859-95fe-a74a10561916 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:57.134893 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91ecdd-a436-4859-95fe-a74a10561916 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:57.140938 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 434/870] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 18:25:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:57.146507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91ecdd-a436-4859-95fe-a74a10561916 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:57.180116 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6a98b-fe3a-4f30-a267-443c6cda9830 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:57.193807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:57.226899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d524c-7cef-4042-b756-4d0b7c43770b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:57.227582 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d524c-7cef-4042-b756-4d0b7c43770b None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:57.227870 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d524c-7cef-4042-b756-4d0b7c43770b None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:57.228152 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d524c-7cef-4042-b756-4d0b7c43770b None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:57.229176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d524c-7cef-4042-b756-4d0b7c43770b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:57.229497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d524c-7cef-4042-b756-4d0b7c43770b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:57.231901 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d524c-7cef-4042-b756-4d0b7c43770b None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:57.249542 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 437/871] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:25:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:57.254202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:57.255249 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d524c-7cef-4042-b756-4d0b7c43770b None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:57.266217 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91ecdd-a436-4859-95fe-a74a10561916 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:57.308891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ab561-3d15-4254-a5a6-09c651809c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:57.309434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ab561-3d15-4254-a5a6-09c651809c1c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:57.309710 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ab561-3d15-4254-a5a6-09c651809c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:57.309975 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ab561-3d15-4254-a5a6-09c651809c1c None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:57.310659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ab561-3d15-4254-a5a6-09c651809c1c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:57.310954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ab561-3d15-4254-a5a6-09c651809c1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:57.313051 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ab561-3d15-4254-a5a6-09c651809c1c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:57.323357 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 435/872] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 18:25:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:57.385313 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d524c-7cef-4042-b756-4d0b7c43770b None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:57.429529 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513cf71-9699-4845-9e7e-970cf8c79eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:57.430553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513cf71-9699-4845-9e7e-970cf8c79eed None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:57.431072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513cf71-9699-4845-9e7e-970cf8c79eed None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:57.431580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513cf71-9699-4845-9e7e-970cf8c79eed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:57.432626 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513cf71-9699-4845-9e7e-970cf8c79eed None admin] RBAC: Adding query filter params (role.id=ff0af8236fc84d82bf84c8d2d11c11ca, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=5b4c4184e87b4dc5a4047310cd0122ba) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:57.433170 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513cf71-9699-4845-9e7e-970cf8c79eed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:57.434865 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513cf71-9699-4845-9e7e-970cf8c79eed None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:57.443313 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 438/873] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:25:57 2022] GET /identity/v3/role_assignments?user.id=5b4c4184e87b4dc5a4047310cd0122ba&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=ff0af8236fc84d82bf84c8d2d11c11ca => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:58.628431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252758e-1467-42b3-931f-88125a8147bf None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:58.628992 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252758e-1467-42b3-931f-88125a8147bf None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:58.628992 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252758e-1467-42b3-931f-88125a8147bf None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:58.630663 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 436/874] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:58.636005 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5635f0a-8ecd-4d07-b69d-de23b6a19ceb None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:58.636448 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5635f0a-8ecd-4d07-b69d-de23b6a19ceb None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:58.636551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5635f0a-8ecd-4d07-b69d-de23b6a19ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:58.655875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-d5635f0a-8ecd-4d07-b69d-de23b6a19ceb None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:58.657109 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-d5635f0a-8ecd-4d07-b69d-de23b6a19ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:58.689185 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:58.737767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 439/875] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:58 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:25:58.760791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252758e-1467-42b3-931f-88125a8147bf None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:58.871881 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252758e-1467-42b3-931f-88125a8147bf None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:58.908507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5ae0c-44a9-436a-885b-db47e52482ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:58.909532 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5ae0c-44a9-436a-885b-db47e52482ca None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:58.910021 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5ae0c-44a9-436a-885b-db47e52482ca None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:58.910496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5ae0c-44a9-436a-885b-db47e52482ca None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:58.911357 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5ae0c-44a9-436a-885b-db47e52482ca None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:58.912949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5ae0c-44a9-436a-885b-db47e52482ca None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:58.923341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-c4c5ae0c-44a9-436a-885b-db47e52482ca None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:25:58.923341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:58.923341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:25:58.923341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:25:58.923341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:25:58.923341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:25:58.923341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:25:58.923341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:25:58.923341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:25:58.923341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:58.923341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:25:58.923341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:58.923341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:58.923341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:58.923341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:58.923341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:58.923341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:58.924457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:58.924457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:58.924457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:58.924457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:58.924457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:58.924457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:58.924457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:25:58.924457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:25:58.924457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:25:58.924457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:25:58.924457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:58.924457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:58.924457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:58.924457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:58.924457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:58.924457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:58.925360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:58.925360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:58.925360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:58.925360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:58.925360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:58.925360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:58.925360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:58.925360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:58.925360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:58.925360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:58.925360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:25:58.925360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:25:58.925360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:25:58.925360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:25:58.928346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 437/876] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 18:25:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:25:58.939300 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5635f0a-8ecd-4d07-b69d-de23b6a19ceb None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:59.040858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5635f0a-8ecd-4d07-b69d-de23b6a19ceb None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:59.077946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede0c7a-2fb5-4882-b64d-2cc054fe8362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:59.078581 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede0c7a-2fb5-4882-b64d-2cc054fe8362 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:59.078865 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede0c7a-2fb5-4882-b64d-2cc054fe8362 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:59.079141 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede0c7a-2fb5-4882-b64d-2cc054fe8362 None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:59.079867 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede0c7a-2fb5-4882-b64d-2cc054fe8362 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:59.080174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede0c7a-2fb5-4882-b64d-2cc054fe8362 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:59.081550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede0c7a-2fb5-4882-b64d-2cc054fe8362 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:59.086940 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 440/877] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 18:25:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:59.092538 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5ae0c-44a9-436a-885b-db47e52482ca None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:59.106638 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7c0da-7593-47da-a351-dd5fd76359b3 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:59.106943 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7c0da-7593-47da-a351-dd5fd76359b3 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:59.107197 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7c0da-7593-47da-a351-dd5fd76359b3 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:59.111235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 441/878] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:25:59.116697 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:59.118584 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac686717-2d31-4aa8-8faf-ed3f93276830 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:59.118874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac686717-2d31-4aa8-8faf-ed3f93276830 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:59.119150 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac686717-2d31-4aa8-8faf-ed3f93276830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:59.143688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-ac686717-2d31-4aa8-8faf-ed3f93276830 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:59.144913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ac686717-2d31-4aa8-8faf-ed3f93276830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:59.175520 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:59.212034 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5ae0c-44a9-436a-885b-db47e52482ca None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:59.240285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 442/879] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:59 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:25:59.258695 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578cace-dd73-4a2e-8592-fc494e6e444e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:59.259694 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578cace-dd73-4a2e-8592-fc494e6e444e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:59.260249 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578cace-dd73-4a2e-8592-fc494e6e444e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:59.260757 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578cace-dd73-4a2e-8592-fc494e6e444e None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:59.261699 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578cace-dd73-4a2e-8592-fc494e6e444e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:59.262217 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578cace-dd73-4a2e-8592-fc494e6e444e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:59.263668 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac686717-2d31-4aa8-8faf-ed3f93276830 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:59.264778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578cace-dd73-4a2e-8592-fc494e6e444e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:59.276473 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 438/880] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 18:25:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:59.280720 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578cace-dd73-4a2e-8592-fc494e6e444e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:59.376661 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:59.397008 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac686717-2d31-4aa8-8faf-ed3f93276830 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:59.399042 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578cace-dd73-4a2e-8592-fc494e6e444e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:59.438356 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fdc98-c78c-4764-8e8f-f40a5e50df11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:59.439024 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fdc98-c78c-4764-8e8f-f40a5e50df11 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:59.439327 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fdc98-c78c-4764-8e8f-f40a5e50df11 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:59.439611 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fdc98-c78c-4764-8e8f-f40a5e50df11 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:59.440247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fdc98-c78c-4764-8e8f-f40a5e50df11 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:59.440497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb839c54-5176-4495-bb33-1aa65799a6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:59.441126 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb839c54-5176-4495-bb33-1aa65799a6aa None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:59.441413 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb839c54-5176-4495-bb33-1aa65799a6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:59.441637 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fdc98-c78c-4764-8e8f-f40a5e50df11 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:59.441757 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb839c54-5176-4495-bb33-1aa65799a6aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:59.442510 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb839c54-5176-4495-bb33-1aa65799a6aa None admin] RBAC: Adding query filter params (interface=public, service_id=3c52ff5f53ec4814a26c5811e6f60fe5, region_id=RegionOne) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:59.442830 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb839c54-5176-4495-bb33-1aa65799a6aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:59.444215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb839c54-5176-4495-bb33-1aa65799a6aa None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:59.451624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-066fdc98-c78c-4764-8e8f-f40a5e50df11 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:25:59.451624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:59.451624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:25:59.451624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:25:59.451624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:25:59.451624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:25:59.451624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:25:59.451624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:25:59.451624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:25:59.451624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:59.451624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:25:59.451624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:59.451624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:25:59.451624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:25:59.451624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:25:59.451624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:25:59.451624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:25:59.452704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:25:59.452704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:25:59.452704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:25:59.452704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:25:59.452704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:25:59.452704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:25:59.452704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:25:59.452704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:25:59.452704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:25:59.452704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:25:59.452704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:25:59.452704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:25:59.452704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:25:59.452704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:25:59.452704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:25:59.452704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:25:59.459458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:25:59.459458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:25:59.459458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:25:59.459458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:25:59.459458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:25:59.459458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:25:59.459458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:25:59.459458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:25:59.459458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:25:59.459458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:25:59.459458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:25:59.459458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:25:59.459458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:25:59.459458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:25:59.459458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 443/881] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 18:25:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:25:59.460261 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 439/882] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 18:25:59 2022] GET /identity/v3/endpoints?service_id=3c52ff5f53ec4814a26c5811e6f60fe5&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:59.460345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70aa53a-adbd-408f-bbf8-3e3f835ee432 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:59.460345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70aa53a-adbd-408f-bbf8-3e3f835ee432 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:59.460345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70aa53a-adbd-408f-bbf8-3e3f835ee432 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:59.460547 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb839c54-5176-4495-bb33-1aa65799a6aa None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:59.460617 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 444/883] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:59.461290 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70aa53a-adbd-408f-bbf8-3e3f835ee432 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:59.488470 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:59.577996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb839c54-5176-4495-bb33-1aa65799a6aa None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:59.580736 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70aa53a-adbd-408f-bbf8-3e3f835ee432 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:59.612707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a9d64-da11-4809-a936-6d9521f03742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:59.616124 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a9d64-da11-4809-a936-6d9521f03742 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:59.616124 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a9d64-da11-4809-a936-6d9521f03742 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:59.616124 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a9d64-da11-4809-a936-6d9521f03742 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:59.616124 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a9d64-da11-4809-a936-6d9521f03742 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:59.616583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f8042-1be3-41e7-94dc-90c81ecbb00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:59.616725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a9d64-da11-4809-a936-6d9521f03742 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:59.616820 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8042-1be3-41e7-94dc-90c81ecbb00d None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:59.617031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8042-1be3-41e7-94dc-90c81ecbb00d None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:59.617303 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8042-1be3-41e7-94dc-90c81ecbb00d None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:59.617986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f8042-1be3-41e7-94dc-90c81ecbb00d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:59.618300 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f8042-1be3-41e7-94dc-90c81ecbb00d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:59.619698 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f8042-1be3-41e7-94dc-90c81ecbb00d None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:59.622144 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 440/884] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 18:25:59 2022] GET /identity/v3/services => generated 1011 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:25:59.623577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd735b-2daf-4647-8e47-37a2d54b8a4f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:59.624356 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd735b-2daf-4647-8e47-37a2d54b8a4f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:59.624636 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd735b-2daf-4647-8e47-37a2d54b8a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:59.631028 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 445/885] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Jul 27 18:25:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:59.631028 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517a56c-d4fc-4748-9cf0-590c535437f0 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:59.631028 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517a56c-d4fc-4748-9cf0-590c535437f0 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:59.631028 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517a56c-d4fc-4748-9cf0-590c535437f0 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:59.631028 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 446/886] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:59.637382 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56c513-2330-42ca-9e05-3c24fd38a80f None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:59.638017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56c513-2330-42ca-9e05-3c24fd38a80f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:59.638017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56c513-2330-42ca-9e05-3c24fd38a80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:59.649998 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-e7cd735b-2daf-4647-8e47-37a2d54b8a4f None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:59.651153 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e7cd735b-2daf-4647-8e47-37a2d54b8a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:59.655750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:59.659311 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-0d56c513-2330-42ca-9e05-3c24fd38a80f None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:59.660559 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-0d56c513-2330-42ca-9e05-3c24fd38a80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:59.728950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 441/887] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:59 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:25:59.729833 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd735b-2daf-4647-8e47-37a2d54b8a4f None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:59.747878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 447/888] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:25:59 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:25:59.758699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56c513-2330-42ca-9e05-3c24fd38a80f None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:59.785191 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:59.866957 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd735b-2daf-4647-8e47-37a2d54b8a4f None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:59.888761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56c513-2330-42ca-9e05-3c24fd38a80f None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:59.906506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e0d4f-a170-4da2-a1fa-a96e5d2ea94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:59.907058 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e0d4f-a170-4da2-a1fa-a96e5d2ea94b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:59.907366 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e0d4f-a170-4da2-a1fa-a96e5d2ea94b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:59.907646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e0d4f-a170-4da2-a1fa-a96e5d2ea94b None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:59.908331 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e0d4f-a170-4da2-a1fa-a96e5d2ea94b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:59.908642 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e0d4f-a170-4da2-a1fa-a96e5d2ea94b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:59.910026 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e0d4f-a170-4da2-a1fa-a96e5d2ea94b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:59.923431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 442/889] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Jul 27 18:25:59 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:59.923431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e0d4f-a170-4da2-a1fa-a96e5d2ea94b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:59.928019 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:59.944440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fa3a5-999d-41ee-a217-6f035c10caa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:59.945227 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fa3a5-999d-41ee-a217-6f035c10caa4 None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:59.945515 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fa3a5-999d-41ee-a217-6f035c10caa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:59.945797 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fa3a5-999d-41ee-a217-6f035c10caa4 None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:59.946734 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fa3a5-999d-41ee-a217-6f035c10caa4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:59.948613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fa3a5-999d-41ee-a217-6f035c10caa4 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:00.047175 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e0d4f-a170-4da2-a1fa-a96e5d2ea94b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:00.065991 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 448/890] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 18:25:59 2022] POST /identity/v3/services => generated 269 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:26:00.107374 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc5d85-95d4-4876-8795-b9396f7859dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:00.108419 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc5d85-95d4-4876-8795-b9396f7859dc None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:00.108890 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc5d85-95d4-4876-8795-b9396f7859dc None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:00.109383 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc5d85-95d4-4876-8795-b9396f7859dc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:00.121913 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc5d85-95d4-4876-8795-b9396f7859dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:26:00.128740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-30dc5d85-95d4-4876-8795-b9396f7859dc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:26:00.128740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:00.128740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:00.128740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:00.128740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:00.128740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:00.128740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:00.128740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:00.128740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:00.128740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:00.128740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:00.128740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:00.128740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:26:00.128740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:26:00.128740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:26:00.128740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:26:00.129798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:26:00.129798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:26:00.129798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:26:00.129798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:26:00.129798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:00.129798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:00.129798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:00.129798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:00.129798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:00.129798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:00.129798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:00.129798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:00.129798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:00.129798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:00.129798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:00.129798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:00.130711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:00.130711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:00.130711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:00.130711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:00.130711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:26:00.130711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:26:00.130711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:26:00.130711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:26:00.130711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:26:00.130711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:26:00.130711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:26:00.130711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:00.135089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 443/891] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Jul 27 18:25:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:00.136569 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fa3a5-999d-41ee-a217-6f035c10caa4 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:00.230078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:00.255849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fa3a5-999d-41ee-a217-6f035c10caa4 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:00.301062 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907d277-fadf-47f6-ba02-6935240290c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:00.301711 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907d277-fadf-47f6-ba02-6935240290c7 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:00.301998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907d277-fadf-47f6-ba02-6935240290c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:00.302275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907d277-fadf-47f6-ba02-6935240290c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:00.303014 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907d277-fadf-47f6-ba02-6935240290c7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:00.303351 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907d277-fadf-47f6-ba02-6935240290c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:00.304763 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907d277-fadf-47f6-ba02-6935240290c7 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:00.315423 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 449/892] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Jul 27 18:26:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:00.321196 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc5d85-95d4-4876-8795-b9396f7859dc None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:00.387127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:00.434593 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc5d85-95d4-4876-8795-b9396f7859dc None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:00.473146 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28366315-12dc-46bd-b08d-d2962f96fc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:00.474205 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28366315-12dc-46bd-b08d-d2962f96fc73 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:00.474705 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28366315-12dc-46bd-b08d-d2962f96fc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:00.475189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28366315-12dc-46bd-b08d-d2962f96fc73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:00.487504 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28366315-12dc-46bd-b08d-d2962f96fc73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:00.489359 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28366315-12dc-46bd-b08d-d2962f96fc73 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:00.505379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-28366315-12dc-46bd-b08d-d2962f96fc73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:00.505379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:00.505379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:00.505379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:00.505379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:00.505379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:00.505379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:00.505379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:00.505379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:00.505379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:00.505379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:00.505379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:00.505379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:26:00.505379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:26:00.505379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:26:00.506367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:26:00.506367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:00.506367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:00.506367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:00.506367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:00.506367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:00.506367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:00.506367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:00.506367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:00.506367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:00.506367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:00.506367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:00.506367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:00.506367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:00.506367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:00.506367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:00.506367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:00.507320 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:26:00.507320 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:26:00.507320 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:00.507320 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:00.513061 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 444/893] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:00.516122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907d277-fadf-47f6-ba02-6935240290c7 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:00.637669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907d277-fadf-47f6-ba02-6935240290c7 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:00.675554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f1eee-bb5f-4435-961b-5b2caab3e2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:00.676184 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f1eee-bb5f-4435-961b-5b2caab3e2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:00.676468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f1eee-bb5f-4435-961b-5b2caab3e2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:00.676746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f1eee-bb5f-4435-961b-5b2caab3e2a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:00.677543 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f1eee-bb5f-4435-961b-5b2caab3e2a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:00.677853 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f1eee-bb5f-4435-961b-5b2caab3e2a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:00.679235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f1eee-bb5f-4435-961b-5b2caab3e2a8 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:00.687939 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:00.694415 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 450/894] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:00.699976 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28366315-12dc-46bd-b08d-d2962f96fc73 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:00.809441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28366315-12dc-46bd-b08d-d2962f96fc73 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:00.824452 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:00.848333 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52853570-2cb1-40be-bed6-c97c6142b615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:00.848983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52853570-2cb1-40be-bed6-c97c6142b615 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:00.849262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52853570-2cb1-40be-bed6-c97c6142b615 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:00.849535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52853570-2cb1-40be-bed6-c97c6142b615 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:00.858998 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52853570-2cb1-40be-bed6-c97c6142b615 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:00.860497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52853570-2cb1-40be-bed6-c97c6142b615 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:00.872859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-52853570-2cb1-40be-bed6-c97c6142b615 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:26:00.872859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:00.872859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:00.872859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:00.872859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:00.872859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:00.872859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:00.872859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:00.872859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:00.872859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:00.872859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:00.872859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:00.872859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:26:00.872859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:26:00.872859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:26:00.872859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:26:00.875207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:00.875207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:00.875207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:26:00.875207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:26:00.875207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:26:00.875207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:26:00.875207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:00.875207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:00.875207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:00.875207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:00.875207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:00.875207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:00.875207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:00.875207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:00.875207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:00.875207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:00.875207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:00.875207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:00.876289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:00.876289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:00.876289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:26:00.876289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:26:00.876289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:26:00.876289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:26:00.876289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:26:00.876289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:26:00.876289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:26:00.876289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:00.880971 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 445/895] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 18:26:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:00.886961 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f1eee-bb5f-4435-961b-5b2caab3e2a8 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:00.994901 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f1eee-bb5f-4435-961b-5b2caab3e2a8 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:01.035870 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a857f-1424-4519-874b-bbf71bfde16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:01.036500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a857f-1424-4519-874b-bbf71bfde16f None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:01.036781 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a857f-1424-4519-874b-bbf71bfde16f None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:01.037057 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a857f-1424-4519-874b-bbf71bfde16f None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:01.037862 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a857f-1424-4519-874b-bbf71bfde16f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:01.038170 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a857f-1424-4519-874b-bbf71bfde16f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:01.039640 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a857f-1424-4519-874b-bbf71bfde16f None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:01.058545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 451/896] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Jul 27 18:26:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:01.065217 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52853570-2cb1-40be-bed6-c97c6142b615 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:01.176422 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52853570-2cb1-40be-bed6-c97c6142b615 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:01.213621 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabe00a-a14e-4d56-acab-aadbf54f5ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:01.214242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabe00a-a14e-4d56-acab-aadbf54f5ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:01.214521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabe00a-a14e-4d56-acab-aadbf54f5ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:01.214792 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabe00a-a14e-4d56-acab-aadbf54f5ef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:01.257728 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:01.287057 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabe00a-a14e-4d56-acab-aadbf54f5ef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:01.288563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabe00a-a14e-4d56-acab-aadbf54f5ef6 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:01.416192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 446/897] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:26:01 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:26:01.422827 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a857f-1424-4519-874b-bbf71bfde16f None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:01.482958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:01.529449 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a857f-1424-4519-874b-bbf71bfde16f None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:01.568330 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331737b-0e51-4705-83dc-6a2cd036e998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:01.578570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331737b-0e51-4705-83dc-6a2cd036e998 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:01.578865 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331737b-0e51-4705-83dc-6a2cd036e998 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:01.579151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331737b-0e51-4705-83dc-6a2cd036e998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:01.590442 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331737b-0e51-4705-83dc-6a2cd036e998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:01.591932 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331737b-0e51-4705-83dc-6a2cd036e998 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:01.607818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-3331737b-0e51-4705-83dc-6a2cd036e998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:01.607818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:01.607818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:01.607818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:01.607818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:01.607818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:01.607818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:01.607818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:01.607818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:01.607818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:01.607818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:01.607818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:01.607818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:26:01.607818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:26:01.607818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:26:01.609387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:26:01.609387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:01.609387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:01.609387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:01.609387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:01.609387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:01.609387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:01.609387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:01.609387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:01.609387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:01.609387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:01.609387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:01.609387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:01.609387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:01.609387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:01.609387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:01.609387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:01.610699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:26:01.610699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:26:01.610699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:01.610699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:01.610699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 452/898] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:01.616924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabe00a-a14e-4d56-acab-aadbf54f5ef6 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:01.696603 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:01.728512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabe00a-a14e-4d56-acab-aadbf54f5ef6 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:01.768842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336e09e-0309-467c-a1c8-1ab4aff43c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:01.769476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336e09e-0309-467c-a1c8-1ab4aff43c84 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:01.769761 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336e09e-0309-467c-a1c8-1ab4aff43c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:01.770041 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336e09e-0309-467c-a1c8-1ab4aff43c84 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:01.770743 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336e09e-0309-467c-a1c8-1ab4aff43c84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:01.771077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336e09e-0309-467c-a1c8-1ab4aff43c84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:01.772496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336e09e-0309-467c-a1c8-1ab4aff43c84 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:01.772798 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceedee3-c794-4004-b3fb-ad2c807de417 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:01.773244 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceedee3-c794-4004-b3fb-ad2c807de417 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:01.773407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceedee3-c794-4004-b3fb-ad2c807de417 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:01.775775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 453/899] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:01.780700 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add8e41-dd57-4e53-88e8-a886eef45250 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:01.780971 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add8e41-dd57-4e53-88e8-a886eef45250 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:01.781213 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add8e41-dd57-4e53-88e8-a886eef45250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:01.789941 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 447/900] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:01.791289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336e09e-0309-467c-a1c8-1ab4aff43c84 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:01.799863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-0add8e41-dd57-4e53-88e8-a886eef45250 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:01.801059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-0add8e41-dd57-4e53-88e8-a886eef45250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:01.879878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 454/901] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:01.904359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add8e41-dd57-4e53-88e8-a886eef45250 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:01.908381 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336e09e-0309-467c-a1c8-1ab4aff43c84 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:01.940740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:01.945714 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d1e81-fe41-4080-bb28-f71efcde2371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:01.948867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d1e81-fe41-4080-bb28-f71efcde2371 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:01.948867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d1e81-fe41-4080-bb28-f71efcde2371 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:01.948867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d1e81-fe41-4080-bb28-f71efcde2371 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:01.955049 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d1e81-fe41-4080-bb28-f71efcde2371 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:01.956776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d1e81-fe41-4080-bb28-f71efcde2371 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:01.957695 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:01.970291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-663d1e81-fe41-4080-bb28-f71efcde2371 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:26:01.970291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:01.970291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:01.970291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:01.970291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:01.970291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:01.970291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:01.970291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:01.970291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:01.970291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:01.970291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:01.970291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:01.970291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:26:01.970291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:26:01.970291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:26:01.972646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:26:01.972646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:01.972646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:01.972646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:01.972646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:01.972646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:01.972646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:01.972646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:01.972646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:01.972646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:01.972646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:01.972646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:01.972646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:01.972646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:01.972646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:01.972646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:01.972646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:01.973570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:26:01.973570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:26:01.973570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:26:01.973570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:26:01.973570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:26:01.973570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:26:01.973570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:26:01.973570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:01.975000 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 448/902] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:26:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:01.983686 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d1e81-fe41-4080-bb28-f71efcde2371 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:02.026383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add8e41-dd57-4e53-88e8-a886eef45250 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:02.072652 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034471c9-44e9-46fa-9f90-3dfd4e2f50d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:02.073862 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034471c9-44e9-46fa-9f90-3dfd4e2f50d4 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.074320 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034471c9-44e9-46fa-9f90-3dfd4e2f50d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.074775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034471c9-44e9-46fa-9f90-3dfd4e2f50d4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.076685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034471c9-44e9-46fa-9f90-3dfd4e2f50d4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:02.078876 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034471c9-44e9-46fa-9f90-3dfd4e2f50d4 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:02.091060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-034471c9-44e9-46fa-9f90-3dfd4e2f50d4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:26:02.091060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:02.091060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:26:02.091060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:26:02.091060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:26:02.091060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:26:02.091060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:26:02.091060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:02.091060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:26:02.091060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:02.091060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:26:02.091060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:02.091060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:02.091060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:02.091060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:02.091060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:02.091060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:02.092411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:02.092411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:02.092411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:02.092411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:02.092411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:02.092411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:02.092411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:26:02.092411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:26:02.092411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:26:02.092411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:26:02.092411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:02.092411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:02.092411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:02.092411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:02.092411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:02.092411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:02.094017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:02.094017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:02.094017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:02.094017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:02.094017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:02.094017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:02.094017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:02.094017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:02.094017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:02.094017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:02.094017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:26:02.094017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:02.094017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:26:02.094017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:02.097038 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 455/903] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 18:26:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:02.103420 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034471c9-44e9-46fa-9f90-3dfd4e2f50d4 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:02.116356 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d1e81-fe41-4080-bb28-f71efcde2371 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:02.163864 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d336100-b6c7-4f86-9353-2f47c700a7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:02.164600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d336100-b6c7-4f86-9353-2f47c700a7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.164957 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d336100-b6c7-4f86-9353-2f47c700a7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.165304 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d336100-b6c7-4f86-9353-2f47c700a7c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.166126 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d336100-b6c7-4f86-9353-2f47c700a7c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:02.166607 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d336100-b6c7-4f86-9353-2f47c700a7c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:02.168078 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d336100-b6c7-4f86-9353-2f47c700a7c0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:02.185851 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 449/904] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:26:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:02.185851 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b82539-df4e-489a-9158-163c75b333d1 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.185851 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b82539-df4e-489a-9158-163c75b333d1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.185851 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b82539-df4e-489a-9158-163c75b333d1 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.185851 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 450/905] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:02.188269 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b82539-df4e-489a-9158-163c75b333d1 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:02.229213 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034471c9-44e9-46fa-9f90-3dfd4e2f50d4 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:02.230819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:02.246097 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:02.268391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2c79f-7593-40f7-b330-d3c21fad8967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:02.269461 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2c79f-7593-40f7-b330-d3c21fad8967 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.269946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2c79f-7593-40f7-b330-d3c21fad8967 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.270648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2c79f-7593-40f7-b330-d3c21fad8967 None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.271423 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2c79f-7593-40f7-b330-d3c21fad8967 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:02.277101 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2c79f-7593-40f7-b330-d3c21fad8967 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:02.277101 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2c79f-7593-40f7-b330-d3c21fad8967 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:02.279104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 456/906] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 18:26:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:02.280675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12a75e-6235-4351-a184-f08e4b41e18f None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.281154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12a75e-6235-4351-a184-f08e4b41e18f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.281435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12a75e-6235-4351-a184-f08e4b41e18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.299918 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-0d12a75e-6235-4351-a184-f08e4b41e18f None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:02.301100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-0d12a75e-6235-4351-a184-f08e4b41e18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:02.304407 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b82539-df4e-489a-9158-163c75b333d1 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:02.339707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dee60-4376-4118-9f57-8b0d88289a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:02.340325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dee60-4376-4118-9f57-8b0d88289a97 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.340605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dee60-4376-4118-9f57-8b0d88289a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.340879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dee60-4376-4118-9f57-8b0d88289a97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.341669 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680dee60-4376-4118-9f57-8b0d88289a97 None admin] RBAC: Adding query filter params (role.id=a4fdca42d75d42b884608b1880bd969c, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=5b4c4184e87b4dc5a4047310cd0122ba) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:02.341977 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680dee60-4376-4118-9f57-8b0d88289a97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:02.343476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680dee60-4376-4118-9f57-8b0d88289a97 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:02.348890 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 451/907] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:26:02 2022] GET /identity/v3/role_assignments?user.id=5b4c4184e87b4dc5a4047310cd0122ba&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=a4fdca42d75d42b884608b1880bd969c => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:02.349760 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dee60-4376-4118-9f57-8b0d88289a97 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:02.390642 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 457/908] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:02.390642 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026674d9-2de1-4cf4-8613-2a09ddcac529 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.390642 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026674d9-2de1-4cf4-8613-2a09ddcac529 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.390642 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026674d9-2de1-4cf4-8613-2a09ddcac529 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.396424 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 458/909] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:02.397906 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4251a-4752-40ae-ae27-5648da7e3cf5 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.398195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4251a-4752-40ae-ae27-5648da7e3cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.398493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4251a-4752-40ae-ae27-5648da7e3cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.421383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-7ee4251a-4752-40ae-ae27-5648da7e3cf5 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:02.422491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-7ee4251a-4752-40ae-ae27-5648da7e3cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:02.477472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dee60-4376-4118-9f57-8b0d88289a97 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:02.497161 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:02.498675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 459/910] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:02.499776 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4251a-4752-40ae-ae27-5648da7e3cf5 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:02.530600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e87a6-ac8e-4fa9-b6db-e2bad3088768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:02.531815 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e87a6-ac8e-4fa9-b6db-e2bad3088768 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.532020 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e87a6-ac8e-4fa9-b6db-e2bad3088768 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.532359 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e87a6-ac8e-4fa9-b6db-e2bad3088768 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.532984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e87a6-ac8e-4fa9-b6db-e2bad3088768 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:02.533288 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e87a6-ac8e-4fa9-b6db-e2bad3088768 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:02.534807 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e87a6-ac8e-4fa9-b6db-e2bad3088768 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:02.541396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:02.548904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 452/911] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 18:26:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:02.548904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e87a6-ac8e-4fa9-b6db-e2bad3088768 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:02.635892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4251a-4752-40ae-ae27-5648da7e3cf5 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:02.662511 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e87a6-ac8e-4fa9-b6db-e2bad3088768 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:02.676386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d54f8-ab5b-4563-8347-f8a82a7c088a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:02.677282 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d54f8-ab5b-4563-8347-f8a82a7c088a None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.677397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d54f8-ab5b-4563-8347-f8a82a7c088a None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.677645 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d54f8-ab5b-4563-8347-f8a82a7c088a None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.678354 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d54f8-ab5b-4563-8347-f8a82a7c088a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:02.679792 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d54f8-ab5b-4563-8347-f8a82a7c088a None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:02.698452 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804088e9-4a22-4539-9652-db36bd2d0bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:02.700717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804088e9-4a22-4539-9652-db36bd2d0bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.700717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804088e9-4a22-4539-9652-db36bd2d0bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.700717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804088e9-4a22-4539-9652-db36bd2d0bb2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.700717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804088e9-4a22-4539-9652-db36bd2d0bb2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:02.702332 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804088e9-4a22-4539-9652-db36bd2d0bb2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:02.711535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-804088e9-4a22-4539-9652-db36bd2d0bb2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:26:02.711535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:02.711535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:26:02.711535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:26:02.711535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:26:02.711535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:26:02.711535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:26:02.711535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:02.711535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:26:02.711535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:02.711535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:26:02.711535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:02.711535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:02.711535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:02.711535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:02.711535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:02.712515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:02.712515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:02.712515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:02.712515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:02.712515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:02.712515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:02.712515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:02.712515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:26:02.712515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:26:02.712515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:26:02.712515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:26:02.712515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:02.712515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:02.712515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:02.712515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:02.712515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:02.713386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:02.713386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:02.713386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:02.713386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:02.713386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:02.713386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:02.713386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:02.713386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:02.713386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:02.713386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:02.713386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:02.713386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:26:02.713386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:02.713386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:26:02.713386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:02.713386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 453/912] 10.222.0.65 () {56 vars in 1132 bytes} [Wed Jul 27 18:26:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:02.714240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804088e9-4a22-4539-9652-db36bd2d0bb2 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:02.767531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:02.790362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 460/913] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 18:26:02 2022] POST /identity/v3/services => generated 241 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:02.791091 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d54f8-ab5b-4563-8347-f8a82a7c088a None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:02.854446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804088e9-4a22-4539-9652-db36bd2d0bb2 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:02.922845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:02.945058 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04b2fd-9c97-43a6-b839-19cba3a77f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:02.946182 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04b2fd-9c97-43a6-b839-19cba3a77f4b None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.946381 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d54f8-ab5b-4563-8347-f8a82a7c088a None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:02.946828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04b2fd-9c97-43a6-b839-19cba3a77f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.947183 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04b2fd-9c97-43a6-b839-19cba3a77f4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.948027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04b2fd-9c97-43a6-b839-19cba3a77f4b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:02.949774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04b2fd-9c97-43a6-b839-19cba3a77f4b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:02.995037 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399e8aa-b016-4f92-898c-21741e5ee6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:02.995996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399e8aa-b016-4f92-898c-21741e5ee6db None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.996624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399e8aa-b016-4f92-898c-21741e5ee6db None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.997862 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399e8aa-b016-4f92-898c-21741e5ee6db None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.998430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399e8aa-b016-4f92-898c-21741e5ee6db None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:02.999410 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399e8aa-b016-4f92-898c-21741e5ee6db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:03.000793 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399e8aa-b016-4f92-898c-21741e5ee6db None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:03.006310 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 461/914] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 18:26:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:03.012794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399e8aa-b016-4f92-898c-21741e5ee6db None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:03.048515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 454/915] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:26:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:03.162983 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399e8aa-b016-4f92-898c-21741e5ee6db None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:03.221271 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0429d-b82e-488f-ad2e-f75c05e46c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:03.222225 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0429d-b82e-488f-ad2e-f75c05e46c25 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:03.222782 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0429d-b82e-488f-ad2e-f75c05e46c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:03.223206 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0429d-b82e-488f-ad2e-f75c05e46c25 None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:03.224188 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0429d-b82e-488f-ad2e-f75c05e46c25 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:03.224665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0429d-b82e-488f-ad2e-f75c05e46c25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:03.226396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0429d-b82e-488f-ad2e-f75c05e46c25 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:03.232740 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 462/916] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 18:26:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:03.240877 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04b2fd-9c97-43a6-b839-19cba3a77f4b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:03.369512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:03.376906 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04b2fd-9c97-43a6-b839-19cba3a77f4b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:03.423140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75382b1d-a53f-47e4-bdb3-83e89e7abe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:03.423837 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75382b1d-a53f-47e4-bdb3-83e89e7abe96 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:03.424133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75382b1d-a53f-47e4-bdb3-83e89e7abe96 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:03.424409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75382b1d-a53f-47e4-bdb3-83e89e7abe96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:03.425198 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75382b1d-a53f-47e4-bdb3-83e89e7abe96 None admin] RBAC: Adding query filter params (interface=public, service_id=8ed0a6f46f194dcc8d57d20e619acd89, region_id=RegionOne) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:03.425514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75382b1d-a53f-47e4-bdb3-83e89e7abe96 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:03.427622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75382b1d-a53f-47e4-bdb3-83e89e7abe96 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:03.434901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 455/917] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 18:26:03 2022] GET /identity/v3/endpoints?service_id=8ed0a6f46f194dcc8d57d20e619acd89&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:03.441289 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0429d-b82e-488f-ad2e-f75c05e46c25 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:03.457212 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:03.571132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0429d-b82e-488f-ad2e-f75c05e46c25 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:03.616040 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefff7f-56f9-4193-9692-abdec5f28318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:03.616681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefff7f-56f9-4193-9692-abdec5f28318 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:03.617250 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefff7f-56f9-4193-9692-abdec5f28318 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:03.617525 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefff7f-56f9-4193-9692-abdec5f28318 None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:03.618277 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefff7f-56f9-4193-9692-abdec5f28318 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:03.619876 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefff7f-56f9-4193-9692-abdec5f28318 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:03.628865 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 463/918] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 18:26:03 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:04.666418 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b422634-db4f-477a-82ef-74cbbc434db8 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:04.666974 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b422634-db4f-477a-82ef-74cbbc434db8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:04.666974 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b422634-db4f-477a-82ef-74cbbc434db8 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:04.668597 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 456/919] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:04.674467 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eb589-5663-4cb6-8214-8f1753e3ea77 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:04.674902 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eb589-5663-4cb6-8214-8f1753e3ea77 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:04.675080 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eb589-5663-4cb6-8214-8f1753e3ea77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:04.694358 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-bd6eb589-5663-4cb6-8214-8f1753e3ea77 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:04.695592 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-bd6eb589-5663-4cb6-8214-8f1753e3ea77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:04.779395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 464/920] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:04.797515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b422634-db4f-477a-82ef-74cbbc434db8 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:04.914765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b422634-db4f-477a-82ef-74cbbc434db8 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:04.952194 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b6648-7261-4170-8554-94f2718afb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:04.953233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b6648-7261-4170-8554-94f2718afb3c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:04.953725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b6648-7261-4170-8554-94f2718afb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:04.954225 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b6648-7261-4170-8554-94f2718afb3c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:04.965855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b6648-7261-4170-8554-94f2718afb3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:26:04.971496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-fa6b6648-7261-4170-8554-94f2718afb3c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:26:04.971496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:04.971496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:04.971496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:04.971496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:04.971496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:04.971496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:04.971496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:04.971496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:04.971496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:04.971496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:04.971496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:04.971496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:26:04.971496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:26:04.971496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:26:04.971496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:26:04.972460 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:26:04.972460 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:26:04.972460 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:26:04.972460 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:26:04.972460 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:04.972460 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:04.972460 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:04.972460 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:04.972460 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:04.972460 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:04.972460 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:04.972460 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:04.972460 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:04.972460 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:04.972460 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:04.972460 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:04.973340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:04.973340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:04.973340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:04.973340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:04.973340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:26:04.973340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:26:04.973340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:26:04.973340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:26:04.973340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:26:04.973340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:26:04.973340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:26:04.973340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:04.976109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 457/921] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Jul 27 18:26:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:04.984740 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6eb589-5663-4cb6-8214-8f1753e3ea77 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:04.986142 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:05.070416 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15caf637-f580-4a66-9115-6fadbb3cff6c None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:05.070751 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15caf637-f580-4a66-9115-6fadbb3cff6c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:05.071436 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15caf637-f580-4a66-9115-6fadbb3cff6c None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:05.072460 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 458/922] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:26:05.078969 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357caf4-0a84-474c-a070-02267c7df14e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:05.079383 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357caf4-0a84-474c-a070-02267c7df14e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:05.079739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357caf4-0a84-474c-a070-02267c7df14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:05.092854 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6eb589-5663-4cb6-8214-8f1753e3ea77 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:05.103638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0357caf4-0a84-474c-a070-02267c7df14e None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:05.105628 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0357caf4-0a84-474c-a070-02267c7df14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:05.125912 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:05.145036 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6162c57-9f80-4a59-a00a-5ecd03e1c033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:05.146163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6162c57-9f80-4a59-a00a-5ecd03e1c033 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:05.146444 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6162c57-9f80-4a59-a00a-5ecd03e1c033 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:05.146751 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6162c57-9f80-4a59-a00a-5ecd03e1c033 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:05.147850 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6162c57-9f80-4a59-a00a-5ecd03e1c033 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:05.148310 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6162c57-9f80-4a59-a00a-5ecd03e1c033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:05.150414 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6162c57-9f80-4a59-a00a-5ecd03e1c033 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:05.167012 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 465/923] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Jul 27 18:26:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:05.168211 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6162c57-9f80-4a59-a00a-5ecd03e1c033 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:05.203831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 459/924] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:26:05.227735 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357caf4-0a84-474c-a070-02267c7df14e None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:05.252080 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:05.291496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6162c57-9f80-4a59-a00a-5ecd03e1c033 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:05.332240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84e441-fa91-49c8-bca5-d307862bee21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:05.333247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84e441-fa91-49c8-bca5-d307862bee21 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:05.333850 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84e441-fa91-49c8-bca5-d307862bee21 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:05.334431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84e441-fa91-49c8-bca5-d307862bee21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:05.347682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84e441-fa91-49c8-bca5-d307862bee21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:05.349558 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84e441-fa91-49c8-bca5-d307862bee21 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:05.357437 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357caf4-0a84-474c-a070-02267c7df14e None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:05.367407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-0d84e441-fa91-49c8-bca5-d307862bee21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:05.367407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:05.367407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:05.367407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:05.367407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:05.367407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:05.367407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:05.367407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:05.367407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:05.367407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:05.367407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:05.367407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:05.367407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:26:05.367407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:26:05.367407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:26:05.368347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:26:05.368347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:05.368347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:05.368347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:05.368347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:05.368347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:05.368347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:05.368347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:05.368347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:05.368347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:05.368347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:05.368347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:05.368347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:05.368347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:05.368347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:05.368347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:05.368347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:05.369313 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:26:05.369313 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:26:05.369313 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:05.369313 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:05.377140 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 466/925] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:05.378505 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84e441-fa91-49c8-bca5-d307862bee21 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:05.400033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeada42-b894-42f8-8185-a9b189343f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:05.401024 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeada42-b894-42f8-8185-a9b189343f5d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:05.401313 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeada42-b894-42f8-8185-a9b189343f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:05.401585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeada42-b894-42f8-8185-a9b189343f5d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:05.402224 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeada42-b894-42f8-8185-a9b189343f5d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:05.403645 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeada42-b894-42f8-8185-a9b189343f5d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:05.416685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-0aeada42-b894-42f8-8185-a9b189343f5d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:26:05.416685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:05.416685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:26:05.416685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:26:05.416685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:26:05.416685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:26:05.416685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:26:05.416685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:05.416685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:26:05.416685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:05.416685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:26:05.416685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:05.416685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:05.416685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:05.416685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:05.416685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:05.416685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:05.417947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:05.417947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:05.417947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:05.417947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:05.417947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:05.417947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:05.417947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:26:05.417947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:26:05.417947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:26:05.417947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:26:05.417947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:05.417947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:05.417947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:05.417947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:05.417947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:05.417947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:05.418809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:05.418809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:05.418809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:05.418809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:05.418809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:05.418809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:05.418809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:05.418809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:05.418809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:05.418809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:05.418809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:26:05.418809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:05.418809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:26:05.418809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:05.418809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 460/926] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 18:26:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:05.420211 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22840547-ca1d-4de4-a894-4decb2d6da91 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:05.420211 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22840547-ca1d-4de4-a894-4decb2d6da91 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:05.420401 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22840547-ca1d-4de4-a894-4decb2d6da91 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:05.426288 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 461/927] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:05.426288 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22840547-ca1d-4de4-a894-4decb2d6da91 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:05.444416 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:05.500593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84e441-fa91-49c8-bca5-d307862bee21 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:05.519870 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:05.541507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22840547-ca1d-4de4-a894-4decb2d6da91 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:05.543731 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f72d3-4437-4821-b225-f6c3f1d00935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:05.544359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f72d3-4437-4821-b225-f6c3f1d00935 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:05.544641 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f72d3-4437-4821-b225-f6c3f1d00935 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:05.544914 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f72d3-4437-4821-b225-f6c3f1d00935 None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:05.546348 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f72d3-4437-4821-b225-f6c3f1d00935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:05.546739 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f72d3-4437-4821-b225-f6c3f1d00935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:05.548225 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f72d3-4437-4821-b225-f6c3f1d00935 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:05.561131 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 467/928] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:05.562498 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58f412-b29b-4c67-86b7-7b5e5f32cfe5 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:05.563201 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58f412-b29b-4c67-86b7-7b5e5f32cfe5 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:05.563909 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58f412-b29b-4c67-86b7-7b5e5f32cfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:05.583137 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-df58f412-b29b-4c67-86b7-7b5e5f32cfe5 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:05.584398 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-df58f412-b29b-4c67-86b7-7b5e5f32cfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:05.586052 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002b903-d164-4600-b461-f99075e8936a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:05.586679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002b903-d164-4600-b461-f99075e8936a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:05.586955 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002b903-d164-4600-b461-f99075e8936a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:05.587989 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002b903-d164-4600-b461-f99075e8936a None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:05.587989 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002b903-d164-4600-b461-f99075e8936a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:05.588284 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002b903-d164-4600-b461-f99075e8936a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:05.589576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002b903-d164-4600-b461-f99075e8936a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:05.601853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 462/929] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Jul 27 18:26:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:05.601853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002b903-d164-4600-b461-f99075e8936a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:05.667253 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 468/930] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:05.667943 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58f412-b29b-4c67-86b7-7b5e5f32cfe5 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:05.695172 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:05.719429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002b903-d164-4600-b461-f99075e8936a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:05.753834 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775291e5-c6c0-4961-a75b-8c2b182fd937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:05.754479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775291e5-c6c0-4961-a75b-8c2b182fd937 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:05.754760 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775291e5-c6c0-4961-a75b-8c2b182fd937 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:05.755036 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775291e5-c6c0-4961-a75b-8c2b182fd937 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:05.762707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775291e5-c6c0-4961-a75b-8c2b182fd937 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:05.765123 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775291e5-c6c0-4961-a75b-8c2b182fd937 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:05.773658 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58f412-b29b-4c67-86b7-7b5e5f32cfe5 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:05.776292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-775291e5-c6c0-4961-a75b-8c2b182fd937 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:26:05.776292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:05.776292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:05.776292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:05.776292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:05.776292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:05.776292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:05.776292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:05.776292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:05.776292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:05.776292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:05.776292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:05.776292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:26:05.776292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:26:05.776292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:26:05.776292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:26:05.777446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:05.777446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:05.777446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:26:05.777446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:26:05.777446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:26:05.777446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:26:05.777446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:05.777446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:05.777446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:05.777446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:05.777446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:05.777446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:05.777446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:05.777446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:05.777446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:05.777446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:05.777446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:05.777446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:05.778432 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:05.778432 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:05.778432 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:26:05.778432 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:26:05.778432 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:26:05.778432 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:26:05.778432 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:26:05.778432 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:26:05.778432 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:26:05.778432 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:05.778432 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 463/931] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 18:26:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:05.779044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775291e5-c6c0-4961-a75b-8c2b182fd937 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:05.785207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:05.809660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff80cc-1587-450c-921f-e42e31da2ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:05.810334 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff80cc-1587-450c-921f-e42e31da2ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:05.810610 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff80cc-1587-450c-921f-e42e31da2ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:05.810880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff80cc-1587-450c-921f-e42e31da2ce3 None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:05.811631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff80cc-1587-450c-921f-e42e31da2ce3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:05.811928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff80cc-1587-450c-921f-e42e31da2ce3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:05.813326 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff80cc-1587-450c-921f-e42e31da2ce3 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:05.818970 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 469/932] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Jul 27 18:26:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:05.820015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587f16e-e8ee-44ed-9856-76672fe63ea0 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:05.820301 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587f16e-e8ee-44ed-9856-76672fe63ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:05.820573 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587f16e-e8ee-44ed-9856-76672fe63ea0 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:05.821962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 470/933] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:05.826483 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587f16e-e8ee-44ed-9856-76672fe63ea0 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:05.885533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775291e5-c6c0-4961-a75b-8c2b182fd937 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:05.919561 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5466030-5104-4ed5-b0f9-646125c612a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:05.920179 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5466030-5104-4ed5-b0f9-646125c612a0 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:05.921063 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5466030-5104-4ed5-b0f9-646125c612a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:05.921330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5466030-5104-4ed5-b0f9-646125c612a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:05.922032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5466030-5104-4ed5-b0f9-646125c612a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:05.923509 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5466030-5104-4ed5-b0f9-646125c612a0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:05.926098 dv-cinder-799871-43-smb devstack@keystone.service[80428]: WARNING keystone.server.flask.common [None req-f5466030-5104-4ed5-b0f9-646125c612a0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 27 18:26:05.929580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587f16e-e8ee-44ed-9856-76672fe63ea0 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:05.934770 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:05.963694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a47ffc-4dbd-49a3-b553-36456f224894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:05.964302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a47ffc-4dbd-49a3-b553-36456f224894 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:05.964582 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a47ffc-4dbd-49a3-b553-36456f224894 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:05.964853 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a47ffc-4dbd-49a3-b553-36456f224894 None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:05.965637 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a47ffc-4dbd-49a3-b553-36456f224894 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:05.965942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a47ffc-4dbd-49a3-b553-36456f224894 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:05.967413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a47ffc-4dbd-49a3-b553-36456f224894 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:05.981893 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.sql.core [None req-f5466030-5104-4ed5-b0f9-646125c612a0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 18:26:05.981893 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 18:26:05.981893 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [parameters: {'id': '761ea0338b47443f99958f396bf2a2cc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 18:26:05.981893 dv-cinder-799871-43-smb devstack@keystone.service[80428]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80428) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 18:26:05.985200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 471/934] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Jul 27 18:26:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:05.985993 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a47ffc-4dbd-49a3-b553-36456f224894 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:06.001020 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-f5466030-5104-4ed5-b0f9-646125c612a0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 761ea0338b47443f99958f396bf2a2cc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 761ea0338b47443f99958f396bf2a2cc. Jul 27 18:26:06.001020 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:06.001020 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 18:26:06.001020 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 18:26:06.001020 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 18:26:06.001020 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 18:26:06.001020 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 18:26:06.001020 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 18:26:06.001020 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 18:26:06.001020 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application conn.query(q) Jul 27 18:26:06.001020 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 18:26:06.001020 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 18:26:06.001020 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 18:26:06.002136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application result.read() Jul 27 18:26:06.002136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 18:26:06.002136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 18:26:06.002136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 18:26:06.002136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 18:26:06.002136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 18:26:06.002136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 18:26:06.002136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 18:26:06.002136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 18:26:06.002136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 18:26:06.002136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:06.002136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 18:26:06.002136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:06.002136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:06.002136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 18:26:06.002136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 18:26:06.002136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 27 18:26:06.002136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 27 18:26:06.003152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 18:26:06.003152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application next(self.gen) Jul 27 18:26:06.003152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 18:26:06.003152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application yield resource Jul 27 18:26:06.003152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 18:26:06.003152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application next(self.gen) Jul 27 18:26:06.003152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 18:26:06.003152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 18:26:06.003152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 18:26:06.003152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 18:26:06.003152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 18:26:06.003152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise self.value Jul 27 18:26:06.003152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 18:26:06.003152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 18:26:06.003152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 18:26:06.003152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application session.commit() Jul 27 18:26:06.003152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 18:26:06.004167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 18:26:06.004167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 18:26:06.004167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 18:26:06.004167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 18:26:06.004167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self.session.flush() Jul 27 18:26:06.004167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 18:26:06.004167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 18:26:06.004167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 18:26:06.004167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 18:26:06.004167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 18:26:06.004167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application compat.raise_( Jul 27 18:26:06.004167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 18:26:06.004167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception Jul 27 18:26:06.004167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 18:26:06.004167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 18:26:06.004167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 18:26:06.004167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 18:26:06.005105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 18:26:06.005105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 18:26:06.005105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 18:26:06.005105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 18:26:06.005105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 18:26:06.005105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 18:26:06.005105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 18:26:06.005105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 18:26:06.005105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 18:26:06.005105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 18:26:06.005105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 18:26:06.005105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 18:26:06.005105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 18:26:06.005105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 18:26:06.005105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 18:26:06.005905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 18:26:06.005905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 18:26:06.005905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception Jul 27 18:26:06.005905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 18:26:06.005905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 18:26:06.005905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 18:26:06.005905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 18:26:06.005905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 18:26:06.005905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 18:26:06.005905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 18:26:06.005905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application conn.query(q) Jul 27 18:26:06.005905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 18:26:06.005905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 18:26:06.005905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 18:26:06.005905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application result.read() Jul 27 18:26:06.005905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 18:26:06.005905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 18:26:06.006795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 18:26:06.006795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 18:26:06.006795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 18:26:06.006795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 18:26:06.006795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 18:26:06.006795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 18:26:06.006795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 18:26:06.006795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 18:26:06.006795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [parameters: {'id': '761ea0338b47443f99958f396bf2a2cc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 18:26:06.006795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 18:26:06.006795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:06.006795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:26:06.006795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:06.006795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:06.006795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 27 18:26:06.009309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 27 18:26:06.009309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 18:26:06.009309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 18:26:06.009309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 27 18:26:06.009309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:06.009309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:26:06.009309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:06.009309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:06.009309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:06.009309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:06.009309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:06.009309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:06.009309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:06.009309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:06.009309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:06.009309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:06.009309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:06.011361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:06.011361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 27 18:26:06.011361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 27 18:26:06.011361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:06.011361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:06.011361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 27 18:26:06.011361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 27 18:26:06.011361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 761ea0338b47443f99958f396bf2a2cc. Jul 27 18:26:06.011361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:06.011361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 464/935] 10.222.0.65 () {60 vars in 1140 bytes} [Wed Jul 27 18:26:05 2022] POST /identity/v3/projects => generated 262 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:06.011361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41681c0-2bf4-4fd3-8cf1-547bbcd2c9d6 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:06.011361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41681c0-2bf4-4fd3-8cf1-547bbcd2c9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:06.012471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41681c0-2bf4-4fd3-8cf1-547bbcd2c9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:06.019341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:06.024589 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f41681c0-2bf4-4fd3-8cf1-547bbcd2c9d6 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:06.026136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f41681c0-2bf4-4fd3-8cf1-547bbcd2c9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:06.087894 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a47ffc-4dbd-49a3-b553-36456f224894 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:06.095012 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 465/936] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:06.096092 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41681c0-2bf4-4fd3-8cf1-547bbcd2c9d6 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:06.126645 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49062a8a-f395-4a0a-87c8-d5f4f3182747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:06.127289 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49062a8a-f395-4a0a-87c8-d5f4f3182747 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:06.127583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49062a8a-f395-4a0a-87c8-d5f4f3182747 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:06.127859 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49062a8a-f395-4a0a-87c8-d5f4f3182747 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:06.128780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49062a8a-f395-4a0a-87c8-d5f4f3182747 None admin] RBAC: Adding query filter params (interface=public, service_id=e56cb0e8811740b08d7f0ee541bfbb31, region_id=RegionOne) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:06.129091 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49062a8a-f395-4a0a-87c8-d5f4f3182747 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:06.130453 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49062a8a-f395-4a0a-87c8-d5f4f3182747 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:06.135449 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 472/937] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 18:26:05 2022] GET /identity/v3/endpoints?service_id=e56cb0e8811740b08d7f0ee541bfbb31&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:06.136217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49062a8a-f395-4a0a-87c8-d5f4f3182747 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:06.203807 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41681c0-2bf4-4fd3-8cf1-547bbcd2c9d6 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:06.227728 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:06.233704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:06.240011 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8392f5-5986-4d5c-9af6-14d798d36cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:06.244556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49062a8a-f395-4a0a-87c8-d5f4f3182747 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:06.244689 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8392f5-5986-4d5c-9af6-14d798d36cdb None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:06.244689 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8392f5-5986-4d5c-9af6-14d798d36cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:06.244689 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8392f5-5986-4d5c-9af6-14d798d36cdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:06.252188 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8392f5-5986-4d5c-9af6-14d798d36cdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:06.253846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8392f5-5986-4d5c-9af6-14d798d36cdb None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:06.269262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-be8392f5-5986-4d5c-9af6-14d798d36cdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:06.269262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:06.269262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:06.269262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:06.269262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:06.269262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:06.269262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:06.269262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:06.269262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:06.269262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:06.269262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:06.269262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:06.269262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:26:06.269262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:26:06.269262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:26:06.270425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:26:06.270425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:06.270425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:06.270425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:06.270425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:06.270425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:06.270425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:06.270425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:06.270425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:06.270425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:06.270425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:06.270425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:06.270425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:06.270425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:06.270425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:06.270425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:06.270425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:06.271383 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:26:06.271383 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:26:06.271383 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:06.271383 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:06.271383 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 466/938] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:06.271662 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8392f5-5986-4d5c-9af6-14d798d36cdb None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:06.280807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017a14d-84bd-4188-b290-9ed19e440df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:06.281622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017a14d-84bd-4188-b290-9ed19e440df1 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:06.281930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017a14d-84bd-4188-b290-9ed19e440df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:06.282217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017a14d-84bd-4188-b290-9ed19e440df1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:06.289674 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017a14d-84bd-4188-b290-9ed19e440df1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:06.291121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017a14d-84bd-4188-b290-9ed19e440df1 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:06.303032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-4017a14d-84bd-4188-b290-9ed19e440df1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:26:06.303032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:06.303032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:06.303032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:06.303032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:06.303032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:06.303032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:06.303032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:06.303032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:06.303032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:06.303032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:06.303032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:06.303032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:26:06.303032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:26:06.303032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:26:06.304122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:26:06.304122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:06.304122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:06.304122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:06.304122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:06.304122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:06.304122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:06.304122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:06.304122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:06.304122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:06.304122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:06.304122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:06.304122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:06.304122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:06.304122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:06.304122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:06.304122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:06.305272 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:26:06.305272 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:26:06.305272 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:26:06.305272 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:26:06.305272 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:26:06.305272 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:26:06.305272 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:26:06.305272 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:06.305272 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 473/939] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:26:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:06.305272 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017a14d-84bd-4188-b290-9ed19e440df1 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:06.377119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8392f5-5986-4d5c-9af6-14d798d36cdb None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:06.410708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017a14d-84bd-4188-b290-9ed19e440df1 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:06.413564 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84366f-d59c-485c-86ab-2346654c42ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:06.414217 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84366f-d59c-485c-86ab-2346654c42ec None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:06.414504 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84366f-d59c-485c-86ab-2346654c42ec None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:06.414779 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84366f-d59c-485c-86ab-2346654c42ec None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:06.415451 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84366f-d59c-485c-86ab-2346654c42ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:06.416828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84366f-d59c-485c-86ab-2346654c42ec None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:06.426897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-ab84366f-d59c-485c-86ab-2346654c42ec None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:26:06.426897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:06.426897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:26:06.426897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:26:06.426897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:26:06.426897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:26:06.426897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:26:06.426897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:06.426897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:26:06.426897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:06.426897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:26:06.426897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:06.426897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:06.426897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:06.426897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:06.426897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:06.428149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:06.428149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:06.428149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:06.428149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:06.428149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:06.428149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:06.428149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:06.428149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:26:06.428149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:26:06.428149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:26:06.428149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:26:06.428149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:06.428149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:06.428149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:06.428149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:06.428149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:06.429181 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:06.429181 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:06.429181 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:06.429181 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:06.429181 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:06.429181 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:06.429181 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:06.429181 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:06.429181 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:06.429181 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:06.429181 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:06.429181 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:26:06.429181 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:06.429181 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:26:06.429181 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:06.431405 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 467/940] 10.222.0.65 () {56 vars in 1132 bytes} [Wed Jul 27 18:26:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:06.432444 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84366f-d59c-485c-86ab-2346654c42ec None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:06.446649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c689b-863f-460c-8ebf-7e3f01a08102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:06.447312 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c689b-863f-460c-8ebf-7e3f01a08102 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:06.447568 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c689b-863f-460c-8ebf-7e3f01a08102 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:06.447851 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c689b-863f-460c-8ebf-7e3f01a08102 None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:06.448501 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c689b-863f-460c-8ebf-7e3f01a08102 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:06.449883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c689b-863f-460c-8ebf-7e3f01a08102 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:06.456355 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 474/941] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 18:26:06 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:06.457141 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c689b-863f-460c-8ebf-7e3f01a08102 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:06.478204 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:06.493394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:06.548870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84366f-d59c-485c-86ab-2346654c42ec None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:06.587432 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365cd3a-90e4-432f-bdf8-922fa6077f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:06.588065 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365cd3a-90e4-432f-bdf8-922fa6077f38 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:06.588346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365cd3a-90e4-432f-bdf8-922fa6077f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:06.588617 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365cd3a-90e4-432f-bdf8-922fa6077f38 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:06.589355 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365cd3a-90e4-432f-bdf8-922fa6077f38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:06.589657 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365cd3a-90e4-432f-bdf8-922fa6077f38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:06.591052 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365cd3a-90e4-432f-bdf8-922fa6077f38 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:06.597660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c689b-863f-460c-8ebf-7e3f01a08102 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:06.613692 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 468/942] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:06.613692 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365cd3a-90e4-432f-bdf8-922fa6077f38 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:06.638850 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7aaad7-bd81-44f1-ad62-7e0b2278f0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:06.640055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7aaad7-bd81-44f1-ad62-7e0b2278f0cf None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:06.640338 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7aaad7-bd81-44f1-ad62-7e0b2278f0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:06.640616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7aaad7-bd81-44f1-ad62-7e0b2278f0cf None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:06.641358 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7aaad7-bd81-44f1-ad62-7e0b2278f0cf None admin] RBAC: Adding query filter params (name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:06.641642 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7aaad7-bd81-44f1-ad62-7e0b2278f0cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:06.643077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7aaad7-bd81-44f1-ad62-7e0b2278f0cf None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:06.661335 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 475/943] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 18:26:06 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:06.662410 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7aaad7-bd81-44f1-ad62-7e0b2278f0cf None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:06.749608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:06.753495 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365cd3a-90e4-432f-bdf8-922fa6077f38 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:06.759285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:06.784015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7aaad7-bd81-44f1-ad62-7e0b2278f0cf None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:06.797218 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4654255-749b-431d-aa8a-08449596d3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:06.797856 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4654255-749b-431d-aa8a-08449596d3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:06.798199 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4654255-749b-431d-aa8a-08449596d3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:06.798475 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4654255-749b-431d-aa8a-08449596d3f9 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:06.799165 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4654255-749b-431d-aa8a-08449596d3f9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:06.799494 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4654255-749b-431d-aa8a-08449596d3f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:06.800898 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4654255-749b-431d-aa8a-08449596d3f9 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:06.806929 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 469/944] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 18:26:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:06.816408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4654255-749b-431d-aa8a-08449596d3f9 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:06.827882 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb5ffb-6977-48e0-b8c8-7fce60a48c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:06.828942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb5ffb-6977-48e0-b8c8-7fce60a48c1f None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:06.829227 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb5ffb-6977-48e0-b8c8-7fce60a48c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:06.829507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb5ffb-6977-48e0-b8c8-7fce60a48c1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:06.837841 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb5ffb-6977-48e0-b8c8-7fce60a48c1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:06.839496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb5ffb-6977-48e0-b8c8-7fce60a48c1f None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:06.853502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-f0fb5ffb-6977-48e0-b8c8-7fce60a48c1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:26:06.853502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:06.853502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:06.853502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:06.853502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:06.853502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:06.853502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:06.853502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:06.853502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:06.853502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:06.853502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:06.853502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:06.853502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:26:06.853502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:26:06.853502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:26:06.854646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:26:06.854646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:06.854646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:06.854646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:06.854646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:06.854646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:06.854646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:06.854646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:06.854646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:06.854646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:06.854646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:06.854646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:06.854646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:06.854646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:06.854646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:06.854646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:06.854646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:06.855649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:26:06.855649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:26:06.855649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:26:06.855649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:26:06.855649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:26:06.855649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:26:06.855649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:26:06.855649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:06.855649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 476/945] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:26:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:06.863330 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb5ffb-6977-48e0-b8c8-7fce60a48c1f None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:06.944980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4654255-749b-431d-aa8a-08449596d3f9 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:06.984597 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321049f9-914c-46a8-8e1b-29bf7f5c6568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:06.985221 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321049f9-914c-46a8-8e1b-29bf7f5c6568 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:06.985499 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321049f9-914c-46a8-8e1b-29bf7f5c6568 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:06.985768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321049f9-914c-46a8-8e1b-29bf7f5c6568 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:06.986444 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321049f9-914c-46a8-8e1b-29bf7f5c6568 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:06.986867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321049f9-914c-46a8-8e1b-29bf7f5c6568 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:06.988274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321049f9-914c-46a8-8e1b-29bf7f5c6568 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:06.994217 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 470/946] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 18:26:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:07.000513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321049f9-914c-46a8-8e1b-29bf7f5c6568 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:07.003498 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb5ffb-6977-48e0-b8c8-7fce60a48c1f None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:07.032288 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:07.040626 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06183ed-20f8-40f8-88eb-53dd76c6abcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:07.041466 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06183ed-20f8-40f8-88eb-53dd76c6abcb None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:07.041910 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06183ed-20f8-40f8-88eb-53dd76c6abcb None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:07.042340 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06183ed-20f8-40f8-88eb-53dd76c6abcb None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:07.044276 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06183ed-20f8-40f8-88eb-53dd76c6abcb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:07.044276 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06183ed-20f8-40f8-88eb-53dd76c6abcb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:07.045584 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06183ed-20f8-40f8-88eb-53dd76c6abcb None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:07.053778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:07.059946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 477/947] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:26:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:07.066778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06183ed-20f8-40f8-88eb-53dd76c6abcb None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:07.125487 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321049f9-914c-46a8-8e1b-29bf7f5c6568 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:07.176500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08168289-5242-4919-ba04-448081310ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:07.177230 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08168289-5242-4919-ba04-448081310ea1 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:07.177591 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08168289-5242-4919-ba04-448081310ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:07.178480 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08168289-5242-4919-ba04-448081310ea1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:07.179425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08168289-5242-4919-ba04-448081310ea1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:07.181436 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08168289-5242-4919-ba04-448081310ea1 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:07.192855 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06183ed-20f8-40f8-88eb-53dd76c6abcb None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:07.240322 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8b04a-7577-4ea4-96ba-664698d58f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:07.241701 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8b04a-7577-4ea4-96ba-664698d58f47 None admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:07.242134 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8b04a-7577-4ea4-96ba-664698d58f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:07.242420 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8b04a-7577-4ea4-96ba-664698d58f47 None admin] PATH_INFO: `/v3/projects/2880a34079d742c38bfdace2c04564c7/users/5b4c4184e87b4dc5a4047310cd0122ba/roles/a4fdca42d75d42b884608b1880bd969c` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:07.244865 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8b04a-7577-4ea4-96ba-664698d58f47 None admin] RBAC: Authorizing `identity:create_grant(project_id=2880a34079d742c38bfdace2c04564c7, user_id=5b4c4184e87b4dc5a4047310cd0122ba, role_id=a4fdca42d75d42b884608b1880bd969c)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:07.246332 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8b04a-7577-4ea4-96ba-664698d58f47 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:07.275379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 471/948] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:26:06 2022] POST /identity/v3/endpoints => generated 347 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:07.366573 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 478/949] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:26:07 2022] PUT /identity/v3/projects/2880a34079d742c38bfdace2c04564c7/users/5b4c4184e87b4dc5a4047310cd0122ba/roles/a4fdca42d75d42b884608b1880bd969c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:08.557697 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1969e-79ec-4cf9-995a-92636d659812 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:08.558150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1969e-79ec-4cf9-995a-92636d659812 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:08.558257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1969e-79ec-4cf9-995a-92636d659812 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:08.559906 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 472/950] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:08.565774 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d1019-1f8e-44b0-b541-270dbc880574 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:08.566200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d1019-1f8e-44b0-b541-270dbc880574 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:08.566376 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d1019-1f8e-44b0-b541-270dbc880574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:08.586322 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-513d1019-1f8e-44b0-b541-270dbc880574 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:08.587546 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-513d1019-1f8e-44b0-b541-270dbc880574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:08.645965 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:08.666110 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 479/951] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:08.690054 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1969e-79ec-4cf9-995a-92636d659812 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:08.786987 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:08.805882 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1969e-79ec-4cf9-995a-92636d659812 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:08.843043 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0eaf9a-1913-4c8d-a262-5961d5fec4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:08.844074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0eaf9a-1913-4c8d-a262-5961d5fec4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:08.844563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0eaf9a-1913-4c8d-a262-5961d5fec4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:08.845041 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0eaf9a-1913-4c8d-a262-5961d5fec4b3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:08.845904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0eaf9a-1913-4c8d-a262-5961d5fec4b3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:08.847523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0eaf9a-1913-4c8d-a262-5961d5fec4b3 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:08.857044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-1c0eaf9a-1913-4c8d-a262-5961d5fec4b3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:26:08.857044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:08.857044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:26:08.857044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:26:08.857044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:26:08.857044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:26:08.857044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:26:08.857044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:08.857044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:26:08.857044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:08.857044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:26:08.857044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:08.857044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:08.857044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:08.857044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:08.857044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:08.857044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:08.858299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:08.858299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:08.858299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:08.858299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:08.858299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:08.858299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:08.858299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:26:08.858299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:26:08.858299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:26:08.858299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:26:08.858299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:08.858299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:08.858299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:08.858299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:08.858299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:08.858299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:08.859241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:08.859241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:08.859241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:08.859241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:08.859241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:08.859241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:08.859241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:08.859241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:08.859241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:08.859241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:08.859241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:26:08.859241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:08.859241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:26:08.859241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:08.860822 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4966717-816b-4674-8a0a-f8fbab4939e9 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:08.861115 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4966717-816b-4674-8a0a-f8fbab4939e9 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:08.861392 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4966717-816b-4674-8a0a-f8fbab4939e9 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:08.862881 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 473/953] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 18:26:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:08.867310 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 480/953] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:08.871686 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4966717-816b-4674-8a0a-f8fbab4939e9 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:08.872212 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4f356-0124-42b5-9598-47e21d345e16 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:08.872497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4f356-0124-42b5-9598-47e21d345e16 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:08.873038 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4f356-0124-42b5-9598-47e21d345e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:08.894502 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-9ba4f356-0124-42b5-9598-47e21d345e16 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:08.896071 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9ba4f356-0124-42b5-9598-47e21d345e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:08.975445 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 474/954] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:08.993756 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4f356-0124-42b5-9598-47e21d345e16 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:09.006026 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4966717-816b-4674-8a0a-f8fbab4939e9 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:09.054647 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace0f0c-0a69-4653-b907-642f4c179ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:09.055296 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace0f0c-0a69-4653-b907-642f4c179ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:09.055596 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace0f0c-0a69-4653-b907-642f4c179ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:09.056059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace0f0c-0a69-4653-b907-642f4c179ec8 None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:09.056988 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace0f0c-0a69-4653-b907-642f4c179ec8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:09.057299 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace0f0c-0a69-4653-b907-642f4c179ec8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:09.058702 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace0f0c-0a69-4653-b907-642f4c179ec8 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:09.066909 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 481/955] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Jul 27 18:26:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:09.073043 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace0f0c-0a69-4653-b907-642f4c179ec8 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:09.095519 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:09.119839 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4f356-0124-42b5-9598-47e21d345e16 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:09.126941 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:09.159135 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea802b3-1bfc-483b-90bb-22dc163fb886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:09.160201 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea802b3-1bfc-483b-90bb-22dc163fb886 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:09.160705 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea802b3-1bfc-483b-90bb-22dc163fb886 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:09.161178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea802b3-1bfc-483b-90bb-22dc163fb886 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:09.162088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea802b3-1bfc-483b-90bb-22dc163fb886 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:09.163800 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea802b3-1bfc-483b-90bb-22dc163fb886 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:09.183632 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace0f0c-0a69-4653-b907-642f4c179ec8 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:09.219449 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7abad-8ace-414f-9f16-4aea753f3246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:09.220077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7abad-8ace-414f-9f16-4aea753f3246 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:09.220361 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7abad-8ace-414f-9f16-4aea753f3246 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:09.220636 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7abad-8ace-414f-9f16-4aea753f3246 None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:09.221327 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7abad-8ace-414f-9f16-4aea753f3246 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:09.221632 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7abad-8ace-414f-9f16-4aea753f3246 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:09.223010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7abad-8ace-414f-9f16-4aea753f3246 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:09.223133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.sql.core [None req-bea802b3-1bfc-483b-90bb-22dc163fb886 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 18:26:09.223133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 18:26:09.223133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [parameters: {'user_id': '7c8d2152213f4555b4981737b8713f30', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 18:26:09.223133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80428) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 18:26:09.231576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-bea802b3-1bfc-483b-90bb-22dc163fb886 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 18:26:09.231576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:09.231576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 18:26:09.231576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 18:26:09.231576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 18:26:09.231576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 18:26:09.231576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 18:26:09.231576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 18:26:09.231576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 18:26:09.231576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application conn.query(q) Jul 27 18:26:09.231576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 18:26:09.231576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 18:26:09.231576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 18:26:09.231576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application result.read() Jul 27 18:26:09.231576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 18:26:09.232587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 18:26:09.232587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 18:26:09.232587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 18:26:09.232587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 18:26:09.232587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 18:26:09.232587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 18:26:09.232587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 18:26:09.232587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 18:26:09.232587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:09.232587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 18:26:09.232587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:09.232587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:09.232587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 18:26:09.232587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 18:26:09.232587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 27 18:26:09.232587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 27 18:26:09.232587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 18:26:09.232587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application next(self.gen) Jul 27 18:26:09.233983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 18:26:09.233983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application yield resource Jul 27 18:26:09.233983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 18:26:09.233983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application next(self.gen) Jul 27 18:26:09.233983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 18:26:09.233983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 18:26:09.233983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 18:26:09.233983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 18:26:09.233983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 18:26:09.233983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise self.value Jul 27 18:26:09.233983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 18:26:09.233983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 18:26:09.233983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 18:26:09.233983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application session.commit() Jul 27 18:26:09.233983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 18:26:09.233983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 18:26:09.233983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 18:26:09.234919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 18:26:09.234919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 18:26:09.234919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self.session.flush() Jul 27 18:26:09.234919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 18:26:09.234919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 18:26:09.234919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 18:26:09.234919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 18:26:09.234919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 18:26:09.234919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application compat.raise_( Jul 27 18:26:09.234919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 18:26:09.234919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception Jul 27 18:26:09.234919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 18:26:09.234919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 18:26:09.234919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 18:26:09.234919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 18:26:09.234919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 18:26:09.234919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 18:26:09.236507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 18:26:09.236507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 18:26:09.236507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 27 18:26:09.236507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 27 18:26:09.236507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 18:26:09.236507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 18:26:09.236507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 18:26:09.236507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 18:26:09.236507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 18:26:09.236507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 18:26:09.236507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 18:26:09.236507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 18:26:09.236507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 18:26:09.236507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 18:26:09.236507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 18:26:09.236507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception Jul 27 18:26:09.237385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 18:26:09.237385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 18:26:09.237385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 18:26:09.237385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 18:26:09.237385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 18:26:09.237385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 18:26:09.237385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 18:26:09.237385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application conn.query(q) Jul 27 18:26:09.237385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 18:26:09.237385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 18:26:09.237385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 18:26:09.237385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application result.read() Jul 27 18:26:09.237385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 18:26:09.237385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 18:26:09.237385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 18:26:09.237385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 18:26:09.240587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 18:26:09.240587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 18:26:09.240587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 18:26:09.240587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 18:26:09.240587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 18:26:09.240587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 18:26:09.240587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [parameters: {'user_id': '7c8d2152213f4555b4981737b8713f30', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 18:26:09.240587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 18:26:09.240587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:09.240587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:26:09.240587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:09.240587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:09.240587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:09.240587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:09.240587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:09.242506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:09.242506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:09.242506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:09.242506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:09.242506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:09.242506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:09.242506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:09.242506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 27 18:26:09.242506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 27 18:26:09.242506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:09.242506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:09.242506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:26:09.242506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:26:09.242506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:26:09.242506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:26:09.242506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 27 18:26:09.242506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 27 18:26:09.245321 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 27 18:26:09.245321 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 27 18:26:09.245321 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 18:26:09.245321 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 18:26:09.245321 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 18:26:09.245321 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:09.246611 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 482/956] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Jul 27 18:26:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:09.246611 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7abad-8ace-414f-9f16-4aea753f3246 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:09.265054 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 475/957] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Jul 27 18:26:08 2022] POST /identity/v3/users => generated 160 bytes in 257 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:09.269389 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea802b3-1bfc-483b-90bb-22dc163fb886 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:09.351408 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7abad-8ace-414f-9f16-4aea753f3246 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:09.376377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:09.383625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea802b3-1bfc-483b-90bb-22dc163fb886 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:09.390018 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f6e27-3cc8-4404-a072-5c1595ed6fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:09.390653 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f6e27-3cc8-4404-a072-5c1595ed6fdd None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:09.390940 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f6e27-3cc8-4404-a072-5c1595ed6fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:09.391215 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f6e27-3cc8-4404-a072-5c1595ed6fdd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:09.392008 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f6e27-3cc8-4404-a072-5c1595ed6fdd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:09.393592 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f6e27-3cc8-4404-a072-5c1595ed6fdd None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:09.422570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883ad0d-c110-407c-bbfa-c6214cae197c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:09.423236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883ad0d-c110-407c-bbfa-c6214cae197c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:09.429105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883ad0d-c110-407c-bbfa-c6214cae197c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:09.429105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883ad0d-c110-407c-bbfa-c6214cae197c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:09.432149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883ad0d-c110-407c-bbfa-c6214cae197c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:09.433807 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883ad0d-c110-407c-bbfa-c6214cae197c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:09.436687 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:09.446349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-9883ad0d-c110-407c-bbfa-c6214cae197c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:26:09.446349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:09.446349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:09.446349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:09.446349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:09.446349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:09.446349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:09.446349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:09.446349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:09.446349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:09.446349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:09.446349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:09.446349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:26:09.446349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:26:09.446349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:26:09.446349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:26:09.447516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:09.447516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:09.447516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:26:09.447516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:26:09.447516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:26:09.447516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:26:09.447516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:09.447516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:09.447516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:09.447516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:09.447516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:09.447516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:09.447516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:09.447516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:09.447516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:09.447516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:09.447516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:09.447516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:09.448717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:09.448717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:09.448717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:26:09.448717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:26:09.448717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:26:09.448717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:26:09.448717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:26:09.448717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:26:09.448717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:26:09.448717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:09.448717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 476/958] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:26:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:09.449570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74850e0a-d80e-403c-a108-5f3d93dde94f None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:09.449570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74850e0a-d80e-403c-a108-5f3d93dde94f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:09.449816 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74850e0a-d80e-403c-a108-5f3d93dde94f None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:09.454411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 477/959] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:09.455099 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74850e0a-d80e-403c-a108-5f3d93dde94f None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:09.516331 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 483/960] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:26:09 2022] POST /identity/v3/endpoints => generated 349 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:09.516331 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f8bad-71f0-4df2-9c00-16953c892480 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:09.516331 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f8bad-71f0-4df2-9c00-16953c892480 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:09.516331 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f8bad-71f0-4df2-9c00-16953c892480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:09.531671 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-722f8bad-71f0-4df2-9c00-16953c892480 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:09.533061 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-722f8bad-71f0-4df2-9c00-16953c892480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:09.588243 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74850e0a-d80e-403c-a108-5f3d93dde94f None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:09.616597 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 484/961] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:09.628865 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca5034-2faf-46ec-9ba1-f6d7307ea932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:09.629557 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca5034-2faf-46ec-9ba1-f6d7307ea932 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:09.629888 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca5034-2faf-46ec-9ba1-f6d7307ea932 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:09.630043 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70990762-4ec1-4b87-b941-84263bf373ec None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:09.630189 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70990762-4ec1-4b87-b941-84263bf373ec None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:09.630700 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70990762-4ec1-4b87-b941-84263bf373ec None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:09.630869 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca5034-2faf-46ec-9ba1-f6d7307ea932 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:09.639410 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca5034-2faf-46ec-9ba1-f6d7307ea932 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:09.639410 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca5034-2faf-46ec-9ba1-f6d7307ea932 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:09.639410 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca5034-2faf-46ec-9ba1-f6d7307ea932 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:09.639720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 485/962] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:09 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:09.644465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4b90f-bcff-4759-bc06-67b40efe6071 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:09.644853 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4b90f-bcff-4759-bc06-67b40efe6071 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:09.645277 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4b90f-bcff-4759-bc06-67b40efe6071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:09.665806 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-aee4b90f-bcff-4759-bc06-67b40efe6071 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:09.667046 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-aee4b90f-bcff-4759-bc06-67b40efe6071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:09.683126 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 478/963] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 18:26:09 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:09.684301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca5034-2faf-46ec-9ba1-f6d7307ea932 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:09.763455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 486/964] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:26:09.767072 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:09.783769 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4b90f-bcff-4759-bc06-67b40efe6071 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:09.816732 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:09.820440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca5034-2faf-46ec-9ba1-f6d7307ea932 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:09.859188 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1f1f5-49dd-44af-b436-f575e1c5f724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:09.859979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1f1f5-49dd-44af-b436-f575e1c5f724 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:09.860267 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1f1f5-49dd-44af-b436-f575e1c5f724 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:09.860545 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1f1f5-49dd-44af-b436-f575e1c5f724 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:09.861187 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1f1f5-49dd-44af-b436-f575e1c5f724 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:09.862582 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1f1f5-49dd-44af-b436-f575e1c5f724 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:09.872949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-31e1f1f5-49dd-44af-b436-f575e1c5f724 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:26:09.872949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:09.872949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:26:09.872949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:26:09.872949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:26:09.872949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:26:09.872949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:26:09.872949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:09.872949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:26:09.872949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:09.872949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:26:09.872949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:09.872949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:09.872949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:09.872949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:09.872949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:09.872949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:09.874639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:09.874639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:09.874639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:09.874639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:09.874639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:09.874639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:09.874639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:26:09.874639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:26:09.874639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:26:09.874639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:26:09.874639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:09.874639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:09.874639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:09.874639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:09.874639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:09.874639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:09.875995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:09.875995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:09.875995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:09.875995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:09.875995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:09.875995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:09.875995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:09.875995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:09.875995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:09.875995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:09.875995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:26:09.875995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:09.875995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:26:09.875995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:09.875995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 479/965] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:26:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:09.881691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1f1f5-49dd-44af-b436-f575e1c5f724 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:09.919018 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4b90f-bcff-4759-bc06-67b40efe6071 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:09.965450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e701913-81e6-4740-abce-12a0ff5701c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:09.966455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e701913-81e6-4740-abce-12a0ff5701c9 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:09.966996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e701913-81e6-4740-abce-12a0ff5701c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:09.968283 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e701913-81e6-4740-abce-12a0ff5701c9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:09.982672 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e701913-81e6-4740-abce-12a0ff5701c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:26:09.988025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-5e701913-81e6-4740-abce-12a0ff5701c9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:26:09.988025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:09.988025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:09.988025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:09.988025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:09.988025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:09.988025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:09.988025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:09.988025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:09.988025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:09.988025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:09.988025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:09.988025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:26:09.988025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:26:09.988025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:26:09.988025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:26:09.989157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:26:09.989157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:26:09.989157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:26:09.989157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:26:09.989157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:09.989157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:09.989157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:09.989157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:09.989157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:09.989157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:09.989157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:09.989157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:09.989157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:09.989157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:09.989157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:09.989157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:09.990200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:09.990200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:09.990200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:09.990200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:09.990200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:26:09.990200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:26:09.990200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:26:09.990200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:26:09.990200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:26:09.990200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:26:09.990200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:26:09.990200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:09.995489 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 487/966] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Jul 27 18:26:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:09.999611 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e701913-81e6-4740-abce-12a0ff5701c9 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:10.036932 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1f1f5-49dd-44af-b436-f575e1c5f724 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:10.058594 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:10.081145 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda91035-82c8-4fa8-ab6a-fde9d5da9831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:10.081775 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda91035-82c8-4fa8-ab6a-fde9d5da9831 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:10.082060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda91035-82c8-4fa8-ab6a-fde9d5da9831 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:10.082338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda91035-82c8-4fa8-ab6a-fde9d5da9831 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:10.083024 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda91035-82c8-4fa8-ab6a-fde9d5da9831 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:10.083399 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda91035-82c8-4fa8-ab6a-fde9d5da9831 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:10.084904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda91035-82c8-4fa8-ab6a-fde9d5da9831 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:10.090104 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 480/967] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 18:26:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:10.097460 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda91035-82c8-4fa8-ab6a-fde9d5da9831 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:10.100510 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:10.113246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e701913-81e6-4740-abce-12a0ff5701c9 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:10.154076 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06661c1-7184-4d9a-a845-5bfb117c1091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:10.154910 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06661c1-7184-4d9a-a845-5bfb117c1091 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:10.155194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06661c1-7184-4d9a-a845-5bfb117c1091 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:10.155496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06661c1-7184-4d9a-a845-5bfb117c1091 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:10.156336 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06661c1-7184-4d9a-a845-5bfb117c1091 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:10.156642 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06661c1-7184-4d9a-a845-5bfb117c1091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:10.158255 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06661c1-7184-4d9a-a845-5bfb117c1091 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:10.167060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 488/968] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Jul 27 18:26:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:10.173506 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06661c1-7184-4d9a-a845-5bfb117c1091 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:10.208857 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda91035-82c8-4fa8-ab6a-fde9d5da9831 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:10.250659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892485d-ab17-4a0a-a4c2-df9f27ed0d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:10.251701 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892485d-ab17-4a0a-a4c2-df9f27ed0d95 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:10.252194 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892485d-ab17-4a0a-a4c2-df9f27ed0d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:10.252691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892485d-ab17-4a0a-a4c2-df9f27ed0d95 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:10.253582 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892485d-ab17-4a0a-a4c2-df9f27ed0d95 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:10.254110 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892485d-ab17-4a0a-a4c2-df9f27ed0d95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:10.256170 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892485d-ab17-4a0a-a4c2-df9f27ed0d95 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:10.275307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 481/969] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 18:26:10 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:10.288643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06661c1-7184-4d9a-a845-5bfb117c1091 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:10.330649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2452e-9a3c-4235-9c2e-430082cc3f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:10.331334 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2452e-9a3c-4235-9c2e-430082cc3f4f None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:10.331624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2452e-9a3c-4235-9c2e-430082cc3f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:10.331898 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2452e-9a3c-4235-9c2e-430082cc3f4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:10.344881 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2452e-9a3c-4235-9c2e-430082cc3f4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:10.346389 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2452e-9a3c-4235-9c2e-430082cc3f4f None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:10.363985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-f3e2452e-9a3c-4235-9c2e-430082cc3f4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:10.363985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:10.363985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:10.363985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:10.363985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:10.363985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:10.363985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:10.363985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:10.363985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:10.363985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:10.363985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:10.363985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:10.363985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:26:10.363985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:26:10.363985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:26:10.365085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:26:10.365085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:10.365085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:10.365085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:10.365085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:10.365085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:10.365085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:10.365085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:10.365085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:10.365085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:10.365085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:10.365085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:10.365085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:10.365085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:10.365085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:10.365085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:10.365085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:10.366019 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:26:10.366019 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:26:10.366019 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:10.366019 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:10.367433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 489/970] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:10.371228 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892485d-ab17-4a0a-a4c2-df9f27ed0d95 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:10.430037 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:10.490378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892485d-ab17-4a0a-a4c2-df9f27ed0d95 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:10.526605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd7e37-7168-43de-b63f-6d9ace42dd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:10.527415 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd7e37-7168-43de-b63f-6d9ace42dd5b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:10.527834 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd7e37-7168-43de-b63f-6d9ace42dd5b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:10.528186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd7e37-7168-43de-b63f-6d9ace42dd5b None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:10.529052 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd7e37-7168-43de-b63f-6d9ace42dd5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:10.530013 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd7e37-7168-43de-b63f-6d9ace42dd5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:10.531577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd7e37-7168-43de-b63f-6d9ace42dd5b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:10.545071 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 482/971] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:10.551779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2452e-9a3c-4235-9c2e-430082cc3f4f None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:10.554783 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:10.662520 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2452e-9a3c-4235-9c2e-430082cc3f4f None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:10.698280 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc12285-e949-4dae-ae87-8258727b9381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:10.699203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc12285-e949-4dae-ae87-8258727b9381 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:10.699693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc12285-e949-4dae-ae87-8258727b9381 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:10.699969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc12285-e949-4dae-ae87-8258727b9381 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:10.708126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc12285-e949-4dae-ae87-8258727b9381 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:10.709584 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc12285-e949-4dae-ae87-8258727b9381 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:10.721957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-1fc12285-e949-4dae-ae87-8258727b9381 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:26:10.721957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:10.721957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:10.721957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:10.721957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:10.721957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:10.721957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:10.721957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:10.721957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:10.721957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:10.721957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:10.721957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:10.721957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:26:10.721957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:26:10.721957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:26:10.721957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:26:10.722986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:10.722986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:10.722986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:26:10.722986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:26:10.722986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:26:10.722986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:26:10.722986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:10.722986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:10.722986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:10.722986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:10.722986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:10.722986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:10.722986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:10.722986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:10.722986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:10.722986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:10.722986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:10.722986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:10.728807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:10.728807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:10.728807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:26:10.728807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:26:10.728807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:26:10.728807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:26:10.728807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:26:10.728807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:26:10.728807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:26:10.728807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:10.728807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 490/972] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 18:26:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:10.730992 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd7e37-7168-43de-b63f-6d9ace42dd5b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:10.843116 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd7e37-7168-43de-b63f-6d9ace42dd5b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:10.851074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:10.880531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd3a0d-0102-435f-becc-b3cc8986d255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:10.881161 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd3a0d-0102-435f-becc-b3cc8986d255 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:10.881442 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd3a0d-0102-435f-becc-b3cc8986d255 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:10.881716 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd3a0d-0102-435f-becc-b3cc8986d255 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:10.882516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd3a0d-0102-435f-becc-b3cc8986d255 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:10.882826 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd3a0d-0102-435f-becc-b3cc8986d255 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:10.884305 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd3a0d-0102-435f-becc-b3cc8986d255 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:10.903735 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 483/973] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Jul 27 18:26:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:10.909811 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc12285-e949-4dae-ae87-8258727b9381 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:10.980655 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:11.021123 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc12285-e949-4dae-ae87-8258727b9381 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:11.057610 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb6cca-a274-4ef6-a97f-09e380e0cb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:11.058242 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb6cca-a274-4ef6-a97f-09e380e0cb9a None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:11.058527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb6cca-a274-4ef6-a97f-09e380e0cb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:11.058804 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb6cca-a274-4ef6-a97f-09e380e0cb9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:11.128554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb6cca-a274-4ef6-a97f-09e380e0cb9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:11.131810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb6cca-a274-4ef6-a97f-09e380e0cb9a None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:11.197010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:11.242464 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 491/974] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:26:10 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:26:11.243664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd3a0d-0102-435f-becc-b3cc8986d255 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:11.348336 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd3a0d-0102-435f-becc-b3cc8986d255 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:11.388530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b62a47-0ef5-4c39-937e-d5e1b61ece24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:11.389907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b62a47-0ef5-4c39-937e-d5e1b61ece24 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:11.390188 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b62a47-0ef5-4c39-937e-d5e1b61ece24 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:11.390471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b62a47-0ef5-4c39-937e-d5e1b61ece24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:11.401584 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b62a47-0ef5-4c39-937e-d5e1b61ece24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:11.403106 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b62a47-0ef5-4c39-937e-d5e1b61ece24 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:11.430298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-10b62a47-0ef5-4c39-937e-d5e1b61ece24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:11.430298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:11.430298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:11.430298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:11.430298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:11.430298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:11.430298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:11.430298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:11.430298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:11.430298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:11.430298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:11.430298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:11.430298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:26:11.430298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:26:11.430298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:26:11.435409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:26:11.435409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:11.435409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:11.435409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:11.435409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:11.435409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:11.435409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:11.435409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:11.435409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:11.435409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:11.435409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:11.435409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:11.435409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:11.435409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:11.435409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:11.435409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:11.435409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:11.436917 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:26:11.436917 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:26:11.436917 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:11.436917 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:11.436917 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 484/975] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:11.440343 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb6cca-a274-4ef6-a97f-09e380e0cb9a None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:11.550167 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb6cca-a274-4ef6-a97f-09e380e0cb9a None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:11.586547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ff0ee-2680-414e-a4d9-48311e37f2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:11.587238 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ff0ee-2680-414e-a4d9-48311e37f2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:11.587568 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ff0ee-2680-414e-a4d9-48311e37f2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:11.587844 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ff0ee-2680-414e-a4d9-48311e37f2a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:11.588535 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ff0ee-2680-414e-a4d9-48311e37f2a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:11.588950 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ff0ee-2680-414e-a4d9-48311e37f2a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:11.590218 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ff0ee-2680-414e-a4d9-48311e37f2a6 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:11.606775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 492/976] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:11.608650 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b62a47-0ef5-4c39-937e-d5e1b61ece24 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:11.628763 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:11.708757 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b234104-1d46-492a-a25a-2caab21726cb None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:11.709292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b234104-1d46-492a-a25a-2caab21726cb None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:11.709292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b234104-1d46-492a-a25a-2caab21726cb None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:11.712390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 493/977] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:11.717519 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9c2c7-1f7b-4768-9a48-8e9f940ea47e None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:11.717812 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9c2c7-1f7b-4768-9a48-8e9f940ea47e None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:11.718095 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9c2c7-1f7b-4768-9a48-8e9f940ea47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:11.719942 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b62a47-0ef5-4c39-937e-d5e1b61ece24 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:11.736607 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-01b9c2c7-1f7b-4768-9a48-8e9f940ea47e None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:11.737813 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-01b9c2c7-1f7b-4768-9a48-8e9f940ea47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:11.756558 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00552f-ca92-424a-bea2-1d1fa32c4f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:11.757207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00552f-ca92-424a-bea2-1d1fa32c4f71 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:11.757669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:11.757783 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00552f-ca92-424a-bea2-1d1fa32c4f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:11.757961 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00552f-ca92-424a-bea2-1d1fa32c4f71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:11.765242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00552f-ca92-424a-bea2-1d1fa32c4f71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:11.766691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00552f-ca92-424a-bea2-1d1fa32c4f71 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:11.778328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-9e00552f-ca92-424a-bea2-1d1fa32c4f71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:26:11.778328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:11.778328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:11.778328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:11.778328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:11.778328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:11.778328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:11.778328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:11.778328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:11.778328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:11.778328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:11.778328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:11.778328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:26:11.778328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:26:11.778328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:26:11.779250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:26:11.779250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:11.779250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:11.779250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:11.779250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:11.779250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:11.779250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:11.779250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:11.779250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:11.779250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:11.779250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:11.779250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:11.779250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:11.779250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:11.779250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:11.779250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:11.779250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:11.781186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:26:11.781186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:26:11.781186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:26:11.781186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:26:11.781186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:26:11.781186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:26:11.781186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:26:11.781186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:11.781186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 485/978] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:26:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:11.785386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00552f-ca92-424a-bea2-1d1fa32c4f71 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:11.814298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 494/979] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:26:11.837616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9c2c7-1f7b-4768-9a48-8e9f940ea47e None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:11.870357 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:11.898954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00552f-ca92-424a-bea2-1d1fa32c4f71 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:11.937760 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e345f81-14fb-4617-a2b1-ac13f9067759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:11.938395 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e345f81-14fb-4617-a2b1-ac13f9067759 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:11.938667 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e345f81-14fb-4617-a2b1-ac13f9067759 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:11.938938 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e345f81-14fb-4617-a2b1-ac13f9067759 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:11.939719 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e345f81-14fb-4617-a2b1-ac13f9067759 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:11.940023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e345f81-14fb-4617-a2b1-ac13f9067759 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:11.941444 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e345f81-14fb-4617-a2b1-ac13f9067759 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:11.948414 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9c2c7-1f7b-4768-9a48-8e9f940ea47e None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:11.955906 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 486/980] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:26:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:11.962391 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e345f81-14fb-4617-a2b1-ac13f9067759 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:11.988423 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f794a-1f35-4872-a97a-0e742fa4449d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:11.989172 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f794a-1f35-4872-a97a-0e742fa4449d None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:11.989450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f794a-1f35-4872-a97a-0e742fa4449d None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:11.989726 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f794a-1f35-4872-a97a-0e742fa4449d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:11.990353 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f794a-1f35-4872-a97a-0e742fa4449d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:11.991768 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f794a-1f35-4872-a97a-0e742fa4449d None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:12.002126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-232f794a-1f35-4872-a97a-0e742fa4449d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:26:12.002126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:12.002126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:26:12.002126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:26:12.002126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:26:12.002126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:26:12.002126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:26:12.002126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:12.002126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:26:12.002126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:12.002126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:26:12.002126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:12.002126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:12.002126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:12.002126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:12.002126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:12.002126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:12.003178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:12.003178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:12.003178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:12.003178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:12.003178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:12.003178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:12.003178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:26:12.003178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:26:12.003178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:26:12.003178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:26:12.003178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:12.003178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:12.003178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:12.003178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:12.003178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:12.003178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:12.004094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:12.004094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:12.004094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:12.004094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:12.004094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:12.004094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:12.004094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:12.004094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:12.004094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:12.004094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:12.004094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:26:12.004094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:12.004094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:26:12.004094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:12.008395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 495/981] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 18:26:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:12.009115 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f794a-1f35-4872-a97a-0e742fa4449d None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:12.030630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:12.082859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e345f81-14fb-4617-a2b1-ac13f9067759 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:12.114808 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f794a-1f35-4872-a97a-0e742fa4449d None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:12.123894 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb23d83-f9c2-4f56-b749-333fa07ab9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:12.124536 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb23d83-f9c2-4f56-b749-333fa07ab9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:12.124857 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb23d83-f9c2-4f56-b749-333fa07ab9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:12.125068 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb23d83-f9c2-4f56-b749-333fa07ab9d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:12.125861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb23d83-f9c2-4f56-b749-333fa07ab9d5 None admin] RBAC: Adding query filter params (role.id=a4fdca42d75d42b884608b1880bd969c, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=5b4c4184e87b4dc5a4047310cd0122ba) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:12.126165 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb23d83-f9c2-4f56-b749-333fa07ab9d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:12.127641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb23d83-f9c2-4f56-b749-333fa07ab9d5 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:12.131196 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:12.143292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 487/982] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:26:11 2022] GET /identity/v3/role_assignments?user.id=5b4c4184e87b4dc5a4047310cd0122ba&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=a4fdca42d75d42b884608b1880bd969c => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:12.165750 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094118e-18c9-4525-bc84-af76586b3aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:12.166507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094118e-18c9-4525-bc84-af76586b3aaa None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:12.166867 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094118e-18c9-4525-bc84-af76586b3aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:12.167218 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094118e-18c9-4525-bc84-af76586b3aaa None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:12.168053 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094118e-18c9-4525-bc84-af76586b3aaa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:12.168445 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094118e-18c9-4525-bc84-af76586b3aaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:12.170028 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094118e-18c9-4525-bc84-af76586b3aaa None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:12.176653 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 496/983] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Jul 27 18:26:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:12.182323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb23d83-f9c2-4f56-b749-333fa07ab9d5 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:12.299763 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb23d83-f9c2-4f56-b749-333fa07ab9d5 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:12.336665 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d86aa1-21a2-4c1a-a5af-add1efa20f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:12.337211 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d86aa1-21a2-4c1a-a5af-add1efa20f56 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:12.337491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d86aa1-21a2-4c1a-a5af-add1efa20f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:12.337768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d86aa1-21a2-4c1a-a5af-add1efa20f56 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:12.338447 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d86aa1-21a2-4c1a-a5af-add1efa20f56 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:12.338745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d86aa1-21a2-4c1a-a5af-add1efa20f56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:12.340172 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d86aa1-21a2-4c1a-a5af-add1efa20f56 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:12.341177 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807d9b8-6ed1-48fa-9e2a-eb236adf614b None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:12.341478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807d9b8-6ed1-48fa-9e2a-eb236adf614b None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:12.341760 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807d9b8-6ed1-48fa-9e2a-eb236adf614b None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:12.344092 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 497/984] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:12.347852 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 488/985] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Jul 27 18:26:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:12.349282 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7490e8-ae90-4113-a856-c268e93cd180 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:12.349558 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7490e8-ae90-4113-a856-c268e93cd180 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:12.349831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7490e8-ae90-4113-a856-c268e93cd180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:12.352342 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d86aa1-21a2-4c1a-a5af-add1efa20f56 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:12.369605 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-5b7490e8-ae90-4113-a856-c268e93cd180 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:12.370912 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5b7490e8-ae90-4113-a856-c268e93cd180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:12.426007 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:12.441204 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 498/986] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:12.464171 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7490e8-ae90-4113-a856-c268e93cd180 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:12.470094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d86aa1-21a2-4c1a-a5af-add1efa20f56 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:12.476087 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:12.515500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f8a3c-470b-4df5-aeed-83d4b994aac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:12.516737 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f8a3c-470b-4df5-aeed-83d4b994aac4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:12.517203 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f8a3c-470b-4df5-aeed-83d4b994aac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:12.517720 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f8a3c-470b-4df5-aeed-83d4b994aac4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:12.519108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f8a3c-470b-4df5-aeed-83d4b994aac4 None admin] RBAC: Adding query filter params (interface=admin, service_id=e56cb0e8811740b08d7f0ee541bfbb31, region_id=RegionOne) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:12.519665 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f8a3c-470b-4df5-aeed-83d4b994aac4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:12.521957 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f8a3c-470b-4df5-aeed-83d4b994aac4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:12.535349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 489/987] 10.222.0.65 () {56 vars in 1249 bytes} [Wed Jul 27 18:26:12 2022] GET /identity/v3/endpoints?service_id=e56cb0e8811740b08d7f0ee541bfbb31&interface=admin®ion_id=RegionOne => generated 193 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:12.537685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f8a3c-470b-4df5-aeed-83d4b994aac4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:12.586650 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7490e8-ae90-4113-a856-c268e93cd180 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:12.624308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7320c62-b86a-47dd-b884-d5a10756671c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:12.624848 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7320c62-b86a-47dd-b884-d5a10756671c None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:12.625179 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7320c62-b86a-47dd-b884-d5a10756671c None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:12.625463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7320c62-b86a-47dd-b884-d5a10756671c None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:12.626160 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7320c62-b86a-47dd-b884-d5a10756671c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:12.627564 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7320c62-b86a-47dd-b884-d5a10756671c None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:12.653327 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f8a3c-470b-4df5-aeed-83d4b994aac4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:12.680461 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:12.688245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783e1a8-be26-45bc-bc80-4386a61ff85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:12.688956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783e1a8-be26-45bc-bc80-4386a61ff85a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:12.689229 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783e1a8-be26-45bc-bc80-4386a61ff85a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:12.689509 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783e1a8-be26-45bc-bc80-4386a61ff85a None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:12.690166 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783e1a8-be26-45bc-bc80-4386a61ff85a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:12.691569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783e1a8-be26-45bc-bc80-4386a61ff85a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:12.697528 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 490/988] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 18:26:12 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:12.749216 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 499/989] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 18:26:12 2022] POST /identity/v3/services => generated 242 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:14.201914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e2ec4-d05c-4282-99f4-943a86f0a8e4 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:14.202779 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e2ec4-d05c-4282-99f4-943a86f0a8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:14.202779 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e2ec4-d05c-4282-99f4-943a86f0a8e4 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:14.203895 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 491/990] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:14.208925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a93a36-38c5-445b-b28d-71e406b54016 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:14.209400 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a93a36-38c5-445b-b28d-71e406b54016 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:14.209486 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a93a36-38c5-445b-b28d-71e406b54016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:14.227368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-e0a93a36-38c5-445b-b28d-71e406b54016 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:14.228553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e0a93a36-38c5-445b-b28d-71e406b54016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:14.291848 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:14.303307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 500/991] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:14.325905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e2ec4-d05c-4282-99f4-943a86f0a8e4 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:14.433482 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e2ec4-d05c-4282-99f4-943a86f0a8e4 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:14.468699 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673f58f-bdd6-4e61-853f-8c10ec5c8999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:14.469265 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673f58f-bdd6-4e61-853f-8c10ec5c8999 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:14.469548 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673f58f-bdd6-4e61-853f-8c10ec5c8999 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:14.469821 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673f58f-bdd6-4e61-853f-8c10ec5c8999 None admin] PATH_INFO: `/v3/services/image` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:14.470448 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673f58f-bdd6-4e61-853f-8c10ec5c8999 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:14.471868 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673f58f-bdd6-4e61-853f-8c10ec5c8999 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:14.480949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-4673f58f-bdd6-4e61-853f-8c10ec5c8999 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:26:14.480949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:14.480949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:26:14.480949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:26:14.480949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:26:14.480949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:26:14.480949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:26:14.480949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:14.480949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:26:14.480949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:14.480949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:26:14.480949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:14.480949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:14.480949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:14.480949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:14.480949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:14.480949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:14.481963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:14.481963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:14.481963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:14.481963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:14.481963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:14.481963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:14.481963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:26:14.481963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:26:14.481963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:26:14.481963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:26:14.481963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:14.481963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:14.481963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:14.481963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:14.481963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:14.481963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:14.483954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:14.483954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:14.483954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:14.483954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:14.483954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:14.483954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:14.483954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:14.483954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:14.483954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:14.483954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:14.483954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:26:14.483954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:14.483954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:26:14.483954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:14.483954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 492/992] 10.222.0.65 () {56 vars in 1105 bytes} [Wed Jul 27 18:26:14 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:14.488683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a93a36-38c5-445b-b28d-71e406b54016 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:14.599558 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a93a36-38c5-445b-b28d-71e406b54016 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:14.635583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a1f19-cdc9-4782-aacb-59e43853691e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:14.636212 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a1f19-cdc9-4782-aacb-59e43853691e None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:14.636493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a1f19-cdc9-4782-aacb-59e43853691e None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:14.636767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a1f19-cdc9-4782-aacb-59e43853691e None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:14.637454 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a1f19-cdc9-4782-aacb-59e43853691e None admin] RBAC: Adding query filter params (name=image) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:14.637756 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a1f19-cdc9-4782-aacb-59e43853691e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:14.639736 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a1f19-cdc9-4782-aacb-59e43853691e None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:14.651326 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 501/993] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:14.653687 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673f58f-bdd6-4e61-853f-8c10ec5c8999 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:14.720512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:14.766676 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673f58f-bdd6-4e61-853f-8c10ec5c8999 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:14.785782 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77898833-922a-4087-bec5-7e3985318454 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:14.786114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77898833-922a-4087-bec5-7e3985318454 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:14.786342 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77898833-922a-4087-bec5-7e3985318454 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:14.787887 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 502/994] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:14.792922 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a8321-7724-4cf1-afb9-724058f724b2 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:14.793243 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a8321-7724-4cf1-afb9-724058f724b2 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:14.793499 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a8321-7724-4cf1-afb9-724058f724b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:14.805086 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64147ca-7d99-4074-bac4-37c159a8d201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:14.805711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64147ca-7d99-4074-bac4-37c159a8d201 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:14.805993 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64147ca-7d99-4074-bac4-37c159a8d201 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:14.806270 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64147ca-7d99-4074-bac4-37c159a8d201 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:14.807451 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64147ca-7d99-4074-bac4-37c159a8d201 None admin] RBAC: Adding query filter params (type=image) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:14.807739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64147ca-7d99-4074-bac4-37c159a8d201 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:14.809414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64147ca-7d99-4074-bac4-37c159a8d201 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:14.812021 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-909a8321-7724-4cf1-afb9-724058f724b2 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:14.813224 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-909a8321-7724-4cf1-afb9-724058f724b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:14.814636 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 493/995] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:14 2022] GET /identity/v3/services?type=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:14.825056 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e53d2b-cf5a-47d1-84ab-7e87e00134b1 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:14.825412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e53d2b-cf5a-47d1-84ab-7e87e00134b1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:14.825612 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e53d2b-cf5a-47d1-84ab-7e87e00134b1 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:14.827902 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 494/996] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:26:14.833436 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f5472-a0fa-4d6d-a66d-4067db7553e3 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:14.833725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f5472-a0fa-4d6d-a66d-4067db7553e3 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:14.834007 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f5472-a0fa-4d6d-a66d-4067db7553e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:14.854632 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-eb6f5472-a0fa-4d6d-a66d-4067db7553e3 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:14.856271 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-eb6f5472-a0fa-4d6d-a66d-4067db7553e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:14.883105 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:14.896389 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 503/997] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:26:14.919506 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a8321-7724-4cf1-afb9-724058f724b2 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:14.946849 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 495/998] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:26:14.970284 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f5472-a0fa-4d6d-a66d-4067db7553e3 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:15.026787 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:15.039877 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a8321-7724-4cf1-afb9-724058f724b2 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:15.078821 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4f852-a058-4194-8b5b-87c363d41f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:15.079520 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4f852-a058-4194-8b5b-87c363d41f08 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:15.079804 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4f852-a058-4194-8b5b-87c363d41f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:15.079907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f5472-a0fa-4d6d-a66d-4067db7553e3 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:15.080078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4f852-a058-4194-8b5b-87c363d41f08 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:15.080714 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4f852-a058-4194-8b5b-87c363d41f08 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:15.082093 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4f852-a058-4194-8b5b-87c363d41f08 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:15.091550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-86e4f852-a058-4194-8b5b-87c363d41f08 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:26:15.091550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:15.091550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:26:15.091550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:26:15.091550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:26:15.091550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:26:15.091550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:26:15.091550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:15.091550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:26:15.091550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:15.091550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:26:15.091550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:15.091550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:15.091550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:15.091550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:15.091550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:15.091550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:15.093593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:15.093593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:15.093593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:15.093593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:15.093593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:15.093593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:15.093593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:26:15.093593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:26:15.093593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:26:15.093593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:26:15.093593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:15.093593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:15.093593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:15.093593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:15.093593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:15.093593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:15.094627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:15.094627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:15.094627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:15.094627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:15.094627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:15.094627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:15.094627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:15.094627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:15.094627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:15.094627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:15.094627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:26:15.094627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:15.094627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:26:15.094627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:15.094627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 504/999] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 18:26:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:15.099709 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4f852-a058-4194-8b5b-87c363d41f08 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:15.121823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bec64-cc5a-4733-b897-1ae268f737b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:15.122782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bec64-cc5a-4733-b897-1ae268f737b7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:15.123744 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bec64-cc5a-4733-b897-1ae268f737b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:15.124198 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bec64-cc5a-4733-b897-1ae268f737b7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:15.124842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bec64-cc5a-4733-b897-1ae268f737b7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:15.126237 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bec64-cc5a-4733-b897-1ae268f737b7 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:15.135740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-375bec64-cc5a-4733-b897-1ae268f737b7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:26:15.135740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:15.135740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:26:15.135740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:26:15.135740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:26:15.135740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:26:15.135740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:26:15.135740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:15.135740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:26:15.135740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:15.135740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:26:15.135740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:15.135740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:15.135740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:15.135740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:15.135740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:15.135740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:15.136794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:15.136794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:15.136794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:15.136794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:15.136794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:15.136794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:15.136794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:26:15.136794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:26:15.136794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:26:15.136794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:26:15.136794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:15.136794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:15.136794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:15.136794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:15.136794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:15.136794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:15.137738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:15.137738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:15.137738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:15.137738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:15.137738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:15.137738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:15.137738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:15.137738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:15.137738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:15.137738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:15.137738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:26:15.137738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:15.137738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:26:15.137738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:15.137738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 496/1000] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:26:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:15.143484 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bec64-cc5a-4733-b897-1ae268f737b7 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:15.168837 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:15.221240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4f852-a058-4194-8b5b-87c363d41f08 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:15.253798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bec64-cc5a-4733-b897-1ae268f737b7 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:15.259659 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b030ef-2cd9-45bc-bb40-b5dab5279c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:15.260292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b030ef-2cd9-45bc-bb40-b5dab5279c73 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:15.260577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b030ef-2cd9-45bc-bb40-b5dab5279c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:15.260856 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b030ef-2cd9-45bc-bb40-b5dab5279c73 None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:15.261984 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b030ef-2cd9-45bc-bb40-b5dab5279c73 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:15.262299 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b030ef-2cd9-45bc-bb40-b5dab5279c73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:15.264105 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b030ef-2cd9-45bc-bb40-b5dab5279c73 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:15.268119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:15.270755 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 505/1001] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Jul 27 18:26:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:15.276263 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b030ef-2cd9-45bc-bb40-b5dab5279c73 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:15.297493 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74a92d-6a8f-4797-8005-fb6e9c5b66d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:15.298079 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74a92d-6a8f-4797-8005-fb6e9c5b66d0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:15.298348 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74a92d-6a8f-4797-8005-fb6e9c5b66d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:15.298620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74a92d-6a8f-4797-8005-fb6e9c5b66d0 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:15.299411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74a92d-6a8f-4797-8005-fb6e9c5b66d0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:15.299642 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74a92d-6a8f-4797-8005-fb6e9c5b66d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:15.301013 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74a92d-6a8f-4797-8005-fb6e9c5b66d0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:15.311296 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 497/1002] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 18:26:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:15.313408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74a92d-6a8f-4797-8005-fb6e9c5b66d0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:15.390186 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b030ef-2cd9-45bc-bb40-b5dab5279c73 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:15.409228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:15.426817 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cdd9a-ea74-4fbb-9cc9-253583fe6204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:15.427481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cdd9a-ea74-4fbb-9cc9-253583fe6204 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:15.427767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cdd9a-ea74-4fbb-9cc9-253583fe6204 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:15.428044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cdd9a-ea74-4fbb-9cc9-253583fe6204 None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:15.429460 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850cdd9a-ea74-4fbb-9cc9-253583fe6204 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:15.429460 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850cdd9a-ea74-4fbb-9cc9-253583fe6204 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:15.430399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850cdd9a-ea74-4fbb-9cc9-253583fe6204 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:15.433279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74a92d-6a8f-4797-8005-fb6e9c5b66d0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:15.440418 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 506/1003] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Jul 27 18:26:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:15.441779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cdd9a-ea74-4fbb-9cc9-253583fe6204 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:15.481769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3e2ec-2d67-4e81-998f-932dbd7128e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:15.482455 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3e2ec-2d67-4e81-998f-932dbd7128e6 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:15.482739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3e2ec-2d67-4e81-998f-932dbd7128e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:15.483012 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3e2ec-2d67-4e81-998f-932dbd7128e6 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:15.483724 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3e2ec-2d67-4e81-998f-932dbd7128e6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:15.484033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3e2ec-2d67-4e81-998f-932dbd7128e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:15.485408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3e2ec-2d67-4e81-998f-932dbd7128e6 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:15.495646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 498/1004] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 18:26:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:15.496733 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3e2ec-2d67-4e81-998f-932dbd7128e6 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:15.551942 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:15.556820 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cdd9a-ea74-4fbb-9cc9-253583fe6204 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:15.596650 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027447f-4a1c-4549-bdc4-7d81265119e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:15.597283 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027447f-4a1c-4549-bdc4-7d81265119e1 None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:15.597566 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027447f-4a1c-4549-bdc4-7d81265119e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:15.597864 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027447f-4a1c-4549-bdc4-7d81265119e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:15.598558 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027447f-4a1c-4549-bdc4-7d81265119e1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:15.599964 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027447f-4a1c-4549-bdc4-7d81265119e1 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:15.618461 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3e2ec-2d67-4e81-998f-932dbd7128e6 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:15.653264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbd695-de6c-4226-aeb4-4c7ef3c8c80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:15.653890 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbd695-de6c-4226-aeb4-4c7ef3c8c80f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:15.654381 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbd695-de6c-4226-aeb4-4c7ef3c8c80f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:15.654671 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbd695-de6c-4226-aeb4-4c7ef3c8c80f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:15.655466 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbd695-de6c-4226-aeb4-4c7ef3c8c80f None admin] RBAC: Adding query filter params (interface=public, service_id=c880b51db3184832b3e9d59ea9585e36, region_id=RegionOne) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:15.655777 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbd695-de6c-4226-aeb4-4c7ef3c8c80f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:15.657147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbd695-de6c-4226-aeb4-4c7ef3c8c80f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:15.662423 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 499/1005] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 18:26:15 2022] GET /identity/v3/endpoints?service_id=c880b51db3184832b3e9d59ea9585e36&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:15.668093 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbd695-de6c-4226-aeb4-4c7ef3c8c80f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:15.706792 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 507/1006] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:26:15 2022] POST /identity/v3/endpoints => generated 325 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:26:15.834674 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbd695-de6c-4226-aeb4-4c7ef3c8c80f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:15.844104 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:15.881087 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a4ee1-43ae-41c9-b1c1-666b2bba407a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:15.881730 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a4ee1-43ae-41c9-b1c1-666b2bba407a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:15.882283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a4ee1-43ae-41c9-b1c1-666b2bba407a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:15.882857 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a4ee1-43ae-41c9-b1c1-666b2bba407a None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:15.883835 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a4ee1-43ae-41c9-b1c1-666b2bba407a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:15.885235 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a4ee1-43ae-41c9-b1c1-666b2bba407a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:15.891972 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 500/1007] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 18:26:15 2022] GET /identity/v3/services => generated 1727 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:26:16.880728 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bc0c5-f5b1-4cc1-963e-bbdd44ca5acc None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:16.881254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bc0c5-f5b1-4cc1-963e-bbdd44ca5acc None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:16.881254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bc0c5-f5b1-4cc1-963e-bbdd44ca5acc None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:16.882622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 508/1008] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:16.887905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8e1de-c6e2-4b80-b42d-7c05541004bb None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:16.888351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8e1de-c6e2-4b80-b42d-7c05541004bb None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:16.888449 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8e1de-c6e2-4b80-b42d-7c05541004bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:16.907857 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-e5d8e1de-c6e2-4b80-b42d-7c05541004bb None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:16.909044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e5d8e1de-c6e2-4b80-b42d-7c05541004bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:16.978109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 501/1009] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:16 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:17.000776 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bc0c5-f5b1-4cc1-963e-bbdd44ca5acc None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:17.067012 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:17.127958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bc0c5-f5b1-4cc1-963e-bbdd44ca5acc None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:17.163868 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414986f9-6e67-4598-861b-cac7c0e3f7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:17.164412 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414986f9-6e67-4598-861b-cac7c0e3f7be None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:17.164698 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414986f9-6e67-4598-861b-cac7c0e3f7be None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:17.164979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414986f9-6e67-4598-861b-cac7c0e3f7be None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:17.165684 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414986f9-6e67-4598-861b-cac7c0e3f7be None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:17.167062 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414986f9-6e67-4598-861b-cac7c0e3f7be None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:17.257278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 509/1010] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 18:26:16 2022] POST /identity/v3/services => generated 242 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:17.774192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab1f0f-5d09-4d47-ac41-16a9ae49fac8 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:17.774482 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab1f0f-5d09-4d47-ac41-16a9ae49fac8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:17.774932 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab1f0f-5d09-4d47-ac41-16a9ae49fac8 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:17.776487 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 502/1011] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:17.781748 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b5538-76b6-4953-8e29-a625944504ac None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:17.782038 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b5538-76b6-4953-8e29-a625944504ac None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:17.782341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b5538-76b6-4953-8e29-a625944504ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:17.800942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-e33b5538-76b6-4953-8e29-a625944504ac None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:17.802192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e33b5538-76b6-4953-8e29-a625944504ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:17.882773 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 510/1012] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:17 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:17.905832 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab1f0f-5d09-4d47-ac41-16a9ae49fac8 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:17.984131 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b15c5-9e62-4b26-8635-9f84270cae1f None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:17.984411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b15c5-9e62-4b26-8635-9f84270cae1f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:17.984849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b15c5-9e62-4b26-8635-9f84270cae1f None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:17.986360 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 511/1013] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:26:17.991953 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27912e-0bd4-47b4-b6ce-6494c7ae94f2 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:17.992244 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27912e-0bd4-47b4-b6ce-6494c7ae94f2 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:17.992529 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27912e-0bd4-47b4-b6ce-6494c7ae94f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:18.010944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:18.012602 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-6d27912e-0bd4-47b4-b6ce-6494c7ae94f2 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:18.014431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-6d27912e-0bd4-47b4-b6ce-6494c7ae94f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:18.018627 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab1f0f-5d09-4d47-ac41-16a9ae49fac8 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:18.040613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:18.055504 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a895956-9062-49bf-bfcc-46ccc3db9398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:18.056073 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a895956-9062-49bf-bfcc-46ccc3db9398 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:18.056353 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a895956-9062-49bf-bfcc-46ccc3db9398 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:18.056629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a895956-9062-49bf-bfcc-46ccc3db9398 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:18.057799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a895956-9062-49bf-bfcc-46ccc3db9398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:18.059247 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a895956-9062-49bf-bfcc-46ccc3db9398 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:18.063303 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 503/1014] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:18.067705 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a895956-9062-49bf-bfcc-46ccc3db9398 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:18.090267 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 512/1015] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:17 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:26:18.112676 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27912e-0bd4-47b4-b6ce-6494c7ae94f2 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:18.179411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a895956-9062-49bf-bfcc-46ccc3db9398 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:18.216250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8f5bf-cc11-420b-a3d5-da5faacdb896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:18.216893 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8f5bf-cc11-420b-a3d5-da5faacdb896 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:18.217174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8f5bf-cc11-420b-a3d5-da5faacdb896 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:18.217443 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8f5bf-cc11-420b-a3d5-da5faacdb896 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:18.218119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8f5bf-cc11-420b-a3d5-da5faacdb896 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:18.219583 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8f5bf-cc11-420b-a3d5-da5faacdb896 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:18.221394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27912e-0bd4-47b4-b6ce-6494c7ae94f2 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:18.257402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066fae7-cdf3-4cdc-94c1-131b8d4f3f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:18.258047 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066fae7-cdf3-4cdc-94c1-131b8d4f3f55 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:18.258335 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066fae7-cdf3-4cdc-94c1-131b8d4f3f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:18.258616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066fae7-cdf3-4cdc-94c1-131b8d4f3f55 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:18.259254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066fae7-cdf3-4cdc-94c1-131b8d4f3f55 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:18.260665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066fae7-cdf3-4cdc-94c1-131b8d4f3f55 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:18.270066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-4066fae7-cdf3-4cdc-94c1-131b8d4f3f55 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:26:18.270066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:18.270066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:26:18.270066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:26:18.270066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:26:18.270066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:26:18.270066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:26:18.270066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:18.270066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:26:18.270066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:18.270066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:26:18.270066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:18.270066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:18.270066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:18.270066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:18.270066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:18.270066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:18.271446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:18.271446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:18.271446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:18.271446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:18.271446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:18.271446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:18.271446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:26:18.271446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:26:18.271446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:26:18.271446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:26:18.271446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:18.271446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:18.271446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:18.271446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:18.271446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:18.271446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:18.275364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:18.275364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:18.275364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:18.275364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:18.275364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:18.275364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:18.275364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:18.275364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:18.275364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:18.275364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:18.275364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:26:18.275364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:18.275364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:26:18.275364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:18.275364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 513/1016] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:26:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:18.277160 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066fae7-cdf3-4cdc-94c1-131b8d4f3f55 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:18.302852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:18.305246 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 504/1017] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 18:26:18 2022] POST /identity/v3/projects => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:26:18.411646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066fae7-cdf3-4cdc-94c1-131b8d4f3f55 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:18.463431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a885c5-355f-4c72-8ad1-6563425b270e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:18.464337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a885c5-355f-4c72-8ad1-6563425b270e None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:18.464787 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a885c5-355f-4c72-8ad1-6563425b270e None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:18.465217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a885c5-355f-4c72-8ad1-6563425b270e None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:18.466113 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a885c5-355f-4c72-8ad1-6563425b270e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:18.466414 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a885c5-355f-4c72-8ad1-6563425b270e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:18.468309 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a885c5-355f-4c72-8ad1-6563425b270e None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:18.476776 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 514/1018] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 18:26:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:18.483146 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8f5bf-cc11-420b-a3d5-da5faacdb896 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:18.504570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:18.591022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8f5bf-cc11-420b-a3d5-da5faacdb896 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:18.627529 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfcd8e-e2f7-4f4b-9e45-8530a08cdf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:18.628152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfcd8e-e2f7-4f4b-9e45-8530a08cdf87 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:18.628473 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfcd8e-e2f7-4f4b-9e45-8530a08cdf87 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:18.628708 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfcd8e-e2f7-4f4b-9e45-8530a08cdf87 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:18.629400 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfcd8e-e2f7-4f4b-9e45-8530a08cdf87 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:18.629707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfcd8e-e2f7-4f4b-9e45-8530a08cdf87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:18.631081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfcd8e-e2f7-4f4b-9e45-8530a08cdf87 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:18.641147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 505/1019] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 18:26:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:18.642385 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a885c5-355f-4c72-8ad1-6563425b270e None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:18.734292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:18.755898 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a885c5-355f-4c72-8ad1-6563425b270e None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:18.798799 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e630e98-34e7-496a-8e35-f73960043b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:18.799838 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e630e98-34e7-496a-8e35-f73960043b89 None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:18.800307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e630e98-34e7-496a-8e35-f73960043b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:18.800793 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e630e98-34e7-496a-8e35-f73960043b89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:18.801853 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e630e98-34e7-496a-8e35-f73960043b89 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:18.803450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e630e98-34e7-496a-8e35-f73960043b89 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:18.901779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 515/1020] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:26:18 2022] POST /identity/v3/endpoints => generated 334 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:26:19.355989 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f05c7-58d5-4b86-9d61-52b99692d8ac None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:19.356565 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f05c7-58d5-4b86-9d61-52b99692d8ac None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:19.356565 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f05c7-58d5-4b86-9d61-52b99692d8ac None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:19.358270 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 506/1021] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:26:19.363818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cadefe-d884-44dc-a664-6e170b71d7cc None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:19.364185 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cadefe-d884-44dc-a664-6e170b71d7cc None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:19.364561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cadefe-d884-44dc-a664-6e170b71d7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:19.389344 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-77cadefe-d884-44dc-a664-6e170b71d7cc None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:19.390750 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-77cadefe-d884-44dc-a664-6e170b71d7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:19.472671 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 516/1022] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:19.496064 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f05c7-58d5-4b86-9d61-52b99692d8ac None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:19.585921 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:19.606451 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f05c7-58d5-4b86-9d61-52b99692d8ac None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:19.643840 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a3a35-1149-4bdd-a8c0-e6011667f1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:19.645241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a3a35-1149-4bdd-a8c0-e6011667f1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:19.645241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a3a35-1149-4bdd-a8c0-e6011667f1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:19.645241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a3a35-1149-4bdd-a8c0-e6011667f1f1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:19.645670 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a3a35-1149-4bdd-a8c0-e6011667f1f1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:19.647034 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a3a35-1149-4bdd-a8c0-e6011667f1f1 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:19.656954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-8a3a3a35-1149-4bdd-a8c0-e6011667f1f1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:26:19.656954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:19.656954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:26:19.656954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:26:19.656954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:26:19.656954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:26:19.656954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:26:19.656954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:19.656954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:26:19.656954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:19.656954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:26:19.656954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:19.656954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:19.656954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:19.656954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:19.656954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:19.656954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:19.658014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:19.658014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:19.658014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:19.658014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:19.658014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:19.658014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:19.658014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:26:19.658014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:26:19.658014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:26:19.658014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:26:19.658014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:19.658014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:19.658014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:19.658014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:19.658014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:19.658014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:19.659514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:19.659514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:19.659514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:19.659514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:19.659514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:19.659514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:19.659514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:19.659514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:19.659514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:19.659514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:19.659514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:26:19.659514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:19.659514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:26:19.659514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:19.659514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 507/1023] 10.222.0.65 () {56 vars in 1105 bytes} [Wed Jul 27 18:26:19 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:19.664063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cadefe-d884-44dc-a664-6e170b71d7cc None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:19.731819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:19.768104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cadefe-d884-44dc-a664-6e170b71d7cc None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:19.805403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef02e0e-9127-460e-b599-ef6f99ce4aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:19.806032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef02e0e-9127-460e-b599-ef6f99ce4aab None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:19.806318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef02e0e-9127-460e-b599-ef6f99ce4aab None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:19.806599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef02e0e-9127-460e-b599-ef6f99ce4aab None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:19.807310 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef02e0e-9127-460e-b599-ef6f99ce4aab None admin] RBAC: Adding query filter params (name=image) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:19.807626 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef02e0e-9127-460e-b599-ef6f99ce4aab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:19.809020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef02e0e-9127-460e-b599-ef6f99ce4aab None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:19.819319 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 517/1024] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:19.820879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a3a35-1149-4bdd-a8c0-e6011667f1f1 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:19.938388 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a3a35-1149-4bdd-a8c0-e6011667f1f1 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:19.973238 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bef69e-d058-4267-a0ce-02d6ca1ac250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:19.973867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bef69e-d058-4267-a0ce-02d6ca1ac250 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:19.974148 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bef69e-d058-4267-a0ce-02d6ca1ac250 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:19.974423 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bef69e-d058-4267-a0ce-02d6ca1ac250 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:19.975139 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bef69e-d058-4267-a0ce-02d6ca1ac250 None admin] RBAC: Adding query filter params (type=image) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:19.975472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bef69e-d058-4267-a0ce-02d6ca1ac250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:19.976855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bef69e-d058-4267-a0ce-02d6ca1ac250 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:19.987610 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 508/1025] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:19.989047 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef02e0e-9127-460e-b599-ef6f99ce4aab None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:20.098990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef02e0e-9127-460e-b599-ef6f99ce4aab None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:20.133119 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:20.139303 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff381a03-c3f0-4d44-86f0-20cd62d4e3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:20.139955 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff381a03-c3f0-4d44-86f0-20cd62d4e3ae None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:20.142699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff381a03-c3f0-4d44-86f0-20cd62d4e3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:20.142699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff381a03-c3f0-4d44-86f0-20cd62d4e3ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:20.142699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff381a03-c3f0-4d44-86f0-20cd62d4e3ae None admin] RBAC: Adding query filter params (interface=public, service_id=9b46215002de4bab9d084c1222254083, region_id=RegionOne) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:20.142699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff381a03-c3f0-4d44-86f0-20cd62d4e3ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:20.143004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff381a03-c3f0-4d44-86f0-20cd62d4e3ae None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:20.152692 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 518/1026] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 18:26:19 2022] GET /identity/v3/endpoints?service_id=9b46215002de4bab9d084c1222254083&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:20.155322 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bef69e-d058-4267-a0ce-02d6ca1ac250 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:20.168188 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:20.276192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bef69e-d058-4267-a0ce-02d6ca1ac250 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:20.316590 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e98077-2830-49fc-8952-08a4d09246ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:20.317218 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e98077-2830-49fc-8952-08a4d09246ce None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:20.317504 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e98077-2830-49fc-8952-08a4d09246ce None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:20.317777 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e98077-2830-49fc-8952-08a4d09246ce None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:20.318433 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e98077-2830-49fc-8952-08a4d09246ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:20.319911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e98077-2830-49fc-8952-08a4d09246ce None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:20.335306 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 509/1027] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 18:26:20 2022] GET /identity/v3/services => generated 1957 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:20.441808 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0538e0-2aa6-4def-b2d0-cd4dc465cc43 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:20.442091 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0538e0-2aa6-4def-b2d0-cd4dc465cc43 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:20.442375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0538e0-2aa6-4def-b2d0-cd4dc465cc43 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:20.444011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 519/1028] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:20.449645 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c31269-1265-4ab7-8c73-3cfd7e6c9c33 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:20.450198 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c31269-1265-4ab7-8c73-3cfd7e6c9c33 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:20.450198 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c31269-1265-4ab7-8c73-3cfd7e6c9c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:20.473373 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-d1c31269-1265-4ab7-8c73-3cfd7e6c9c33 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:20.474611 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d1c31269-1265-4ab7-8c73-3cfd7e6c9c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:20.562248 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 510/1029] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:26:20.586513 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0538e0-2aa6-4def-b2d0-cd4dc465cc43 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:20.696367 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0538e0-2aa6-4def-b2d0-cd4dc465cc43 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:20.732650 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491003d4-071f-4a6b-9c94-778e48c1a4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:20.733300 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491003d4-071f-4a6b-9c94-778e48c1a4db None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:20.733583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491003d4-071f-4a6b-9c94-778e48c1a4db None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:20.733856 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491003d4-071f-4a6b-9c94-778e48c1a4db None admin] PATH_INFO: `/v3/domains/default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:20.735102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491003d4-071f-4a6b-9c94-778e48c1a4db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:20.736566 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491003d4-071f-4a6b-9c94-778e48c1a4db None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:20.742955 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 520/1030] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:20.744513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c31269-1265-4ab7-8c73-3cfd7e6c9c33 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:20.746772 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:20.860909 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c31269-1265-4ab7-8c73-3cfd7e6c9c33 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:20.898122 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d416df-2afc-4253-b772-2d4b78f47058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:20.898748 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d416df-2afc-4253-b772-2d4b78f47058 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:20.899032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d416df-2afc-4253-b772-2d4b78f47058 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:20.899337 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d416df-2afc-4253-b772-2d4b78f47058 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:20.900047 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d416df-2afc-4253-b772-2d4b78f47058 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:20.901489 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d416df-2afc-4253-b772-2d4b78f47058 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:21.022320 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 511/1031] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 18:26:20 2022] POST /identity/v3/users => generated 285 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:21.068440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f74bc-4837-49ae-ab0e-b1a457c7f6d7 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:21.068970 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f74bc-4837-49ae-ab0e-b1a457c7f6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:21.068970 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f74bc-4837-49ae-ab0e-b1a457c7f6d7 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:21.070641 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 521/1032] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:21.076852 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bae4f2-6bae-44f1-bf63-6bdebd5acba3 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:21.077275 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bae4f2-6bae-44f1-bf63-6bdebd5acba3 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:21.077417 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bae4f2-6bae-44f1-bf63-6bdebd5acba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:21.097434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-e2bae4f2-6bae-44f1-bf63-6bdebd5acba3 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:21.098679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e2bae4f2-6bae-44f1-bf63-6bdebd5acba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:21.170917 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:21.186755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 512/1033] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:21.210327 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f74bc-4837-49ae-ab0e-b1a457c7f6d7 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:21.278608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:21.322230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f74bc-4837-49ae-ab0e-b1a457c7f6d7 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:21.360330 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cad9d2-4cae-4dfb-a1cf-140145dc5f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:21.360989 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cad9d2-4cae-4dfb-a1cf-140145dc5f3e None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:21.361272 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cad9d2-4cae-4dfb-a1cf-140145dc5f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:21.361549 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cad9d2-4cae-4dfb-a1cf-140145dc5f3e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:21.373184 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cad9d2-4cae-4dfb-a1cf-140145dc5f3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:26:21.378703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-33cad9d2-4cae-4dfb-a1cf-140145dc5f3e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:26:21.378703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:21.378703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:21.378703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:21.378703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:21.378703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:21.378703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:21.378703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:21.378703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:21.378703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:21.378703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:21.378703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:21.378703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:26:21.378703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:26:21.378703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:26:21.378703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:26:21.379675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:26:21.379675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:26:21.379675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:26:21.379675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:26:21.379675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:21.379675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:21.379675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:21.379675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:21.379675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:21.379675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:21.379675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:21.379675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:21.379675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:21.379675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:21.379675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:21.379675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:21.380560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:21.380560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:21.380560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:21.380560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:21.380560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:26:21.380560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:26:21.380560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:26:21.380560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:26:21.380560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:26:21.380560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:26:21.380560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:26:21.380560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:21.380560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 522/1034] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Jul 27 18:26:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:21.387824 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bae4f2-6bae-44f1-bf63-6bdebd5acba3 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:21.504014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bae4f2-6bae-44f1-bf63-6bdebd5acba3 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:21.543332 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0f7c5-1f57-493c-a240-63de0fbb3b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:21.543973 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0f7c5-1f57-493c-a240-63de0fbb3b6e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:21.544255 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0f7c5-1f57-493c-a240-63de0fbb3b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:21.544530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0f7c5-1f57-493c-a240-63de0fbb3b6e None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:21.545858 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0f7c5-1f57-493c-a240-63de0fbb3b6e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:21.549445 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0f7c5-1f57-493c-a240-63de0fbb3b6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:21.549445 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0f7c5-1f57-493c-a240-63de0fbb3b6e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:21.557408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 513/1035] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Jul 27 18:26:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:21.562917 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cad9d2-4cae-4dfb-a1cf-140145dc5f3e None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:21.672669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cad9d2-4cae-4dfb-a1cf-140145dc5f3e None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:21.698158 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:21.709439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072f950-3eae-457d-8985-e9c4303af0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:21.710085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072f950-3eae-457d-8985-e9c4303af0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:21.710373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072f950-3eae-457d-8985-e9c4303af0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:21.710654 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072f950-3eae-457d-8985-e9c4303af0b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:21.721367 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072f950-3eae-457d-8985-e9c4303af0b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:21.722828 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072f950-3eae-457d-8985-e9c4303af0b2 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:21.737452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-6072f950-3eae-457d-8985-e9c4303af0b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:21.737452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:21.737452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:21.737452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:21.737452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:21.737452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:21.737452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:21.737452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:21.737452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:21.737452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:21.737452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:21.737452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:21.737452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:26:21.737452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:26:21.737452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:26:21.738430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:26:21.738430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:21.738430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:21.738430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:21.738430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:21.738430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:21.738430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:21.738430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:21.738430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:21.738430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:21.738430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:21.738430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:21.738430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:21.738430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:21.738430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:21.738430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:21.738430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:21.739395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:26:21.739395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:26:21.739395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:21.739395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:21.739395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 523/1036] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:21.745531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0f7c5-1f57-493c-a240-63de0fbb3b6e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:21.804252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:21.860415 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0f7c5-1f57-493c-a240-63de0fbb3b6e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:21.896664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc9de5-4ebe-4608-a0b2-2aef742eb08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:21.897300 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc9de5-4ebe-4608-a0b2-2aef742eb08c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:21.897585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc9de5-4ebe-4608-a0b2-2aef742eb08c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:21.897862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc9de5-4ebe-4608-a0b2-2aef742eb08c None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:21.898568 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc9de5-4ebe-4608-a0b2-2aef742eb08c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:21.898875 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc9de5-4ebe-4608-a0b2-2aef742eb08c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:21.900300 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc9de5-4ebe-4608-a0b2-2aef742eb08c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:21.918096 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 514/1037] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:21.919773 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072f950-3eae-457d-8985-e9c4303af0b2 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:22.025542 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072f950-3eae-457d-8985-e9c4303af0b2 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:22.060206 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6ccf7-8edf-4c59-9403-4bf142caebc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:22.061300 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6ccf7-8edf-4c59-9403-4bf142caebc8 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:22.061582 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6ccf7-8edf-4c59-9403-4bf142caebc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:22.061854 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6ccf7-8edf-4c59-9403-4bf142caebc8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:22.070129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6ccf7-8edf-4c59-9403-4bf142caebc8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:22.071628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6ccf7-8edf-4c59-9403-4bf142caebc8 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:22.084182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-d2b6ccf7-8edf-4c59-9403-4bf142caebc8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:26:22.084182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:22.084182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:22.084182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:22.084182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:22.084182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:22.084182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:22.084182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:22.084182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:22.084182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:22.084182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:22.084182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:22.084182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:26:22.084182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:26:22.084182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:26:22.084182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:26:22.085265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:22.085265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:22.085265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:26:22.085265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:26:22.085265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:26:22.085265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:26:22.085265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:22.085265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:22.085265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:22.085265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:22.085265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:22.085265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:22.085265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:22.085265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:22.085265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:22.085265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:22.085265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:22.085265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:22.090918 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:22.090918 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:22.090918 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:26:22.090918 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:26:22.090918 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:26:22.090918 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:26:22.090918 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:26:22.090918 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:26:22.090918 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:26:22.090918 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:22.090918 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 524/1038] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 18:26:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:22.093377 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc9de5-4ebe-4608-a0b2-2aef742eb08c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:22.207317 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc9de5-4ebe-4608-a0b2-2aef742eb08c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:22.219314 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:22.242900 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2d711-1a09-4a5a-8448-7f1dfe701418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:22.243580 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2d711-1a09-4a5a-8448-7f1dfe701418 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:22.243868 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2d711-1a09-4a5a-8448-7f1dfe701418 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:22.244146 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2d711-1a09-4a5a-8448-7f1dfe701418 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:22.244976 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2d711-1a09-4a5a-8448-7f1dfe701418 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:22.245292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2d711-1a09-4a5a-8448-7f1dfe701418 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:22.246799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2d711-1a09-4a5a-8448-7f1dfe701418 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:22.273028 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 515/1039] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 18:26:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:22.274538 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6ccf7-8edf-4c59-9403-4bf142caebc8 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:22.314674 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:22.384478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6ccf7-8edf-4c59-9403-4bf142caebc8 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:22.398084 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487f4c0-22b2-4e85-9a96-cb5cd75943c3 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:22.398373 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487f4c0-22b2-4e85-9a96-cb5cd75943c3 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:22.398650 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487f4c0-22b2-4e85-9a96-cb5cd75943c3 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:22.400048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 516/1040] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:26:22.406396 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18ce25-14d5-4ec8-9bb8-195dd805670d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:22.406849 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18ce25-14d5-4ec8-9bb8-195dd805670d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:22.407121 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18ce25-14d5-4ec8-9bb8-195dd805670d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:22.425600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-6e18ce25-14d5-4ec8-9bb8-195dd805670d None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:22.427055 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6e18ce25-14d5-4ec8-9bb8-195dd805670d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:22.428983 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0420a8a-ce06-4e3d-afc1-ac864b71c398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:22.429603 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0420a8a-ce06-4e3d-afc1-ac864b71c398 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:22.429886 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0420a8a-ce06-4e3d-afc1-ac864b71c398 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:22.430162 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0420a8a-ce06-4e3d-afc1-ac864b71c398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:22.506574 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 517/1041] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:26:22.509264 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0420a8a-ce06-4e3d-afc1-ac864b71c398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:22.510745 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0420a8a-ce06-4e3d-afc1-ac864b71c398 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:22.526131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18ce25-14d5-4ec8-9bb8-195dd805670d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:22.555368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:22.630362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 525/1042] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:26:22 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:26:22.631796 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:22.636055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0420a8a-ce06-4e3d-afc1-ac864b71c398 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:22.639096 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18ce25-14d5-4ec8-9bb8-195dd805670d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:22.677049 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101e882-d25c-4c89-9df4-1a756fe7a83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:22.677878 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101e882-d25c-4c89-9df4-1a756fe7a83c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:22.678277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101e882-d25c-4c89-9df4-1a756fe7a83c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:22.678651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101e882-d25c-4c89-9df4-1a756fe7a83c None admin] PATH_INFO: `/v3/services/image` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:22.679459 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101e882-d25c-4c89-9df4-1a756fe7a83c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:22.686092 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101e882-d25c-4c89-9df4-1a756fe7a83c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:22.693530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-2101e882-d25c-4c89-9df4-1a756fe7a83c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:26:22.693530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:22.693530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:26:22.693530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:26:22.693530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:26:22.693530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:26:22.693530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:26:22.693530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:22.693530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:26:22.693530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:22.693530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:26:22.693530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:22.693530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:22.693530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:22.693530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:22.693530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:22.693530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:22.694732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:22.694732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:22.694732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:22.694732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:22.694732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:22.694732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:22.694732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:26:22.694732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:26:22.694732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:26:22.694732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:26:22.694732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:22.694732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:22.694732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:22.694732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:22.694732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:22.694732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:22.695643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:22.695643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:22.695643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:22.695643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:22.695643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:22.695643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:22.695643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:22.695643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:22.695643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:22.695643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:22.695643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:26:22.695643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:26:22.695643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:26:22.695643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:22.695643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 518/1043] 10.222.0.65 () {56 vars in 1105 bytes} [Wed Jul 27 18:26:22 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:22.701817 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101e882-d25c-4c89-9df4-1a756fe7a83c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:22.755055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0420a8a-ce06-4e3d-afc1-ac864b71c398 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:22.795682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca47de-19d0-41f1-a69a-8f52b0a76a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:22.796448 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca47de-19d0-41f1-a69a-8f52b0a76a4b None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:22.796735 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca47de-19d0-41f1-a69a-8f52b0a76a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:22.797044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca47de-19d0-41f1-a69a-8f52b0a76a4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:22.800354 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:22.809796 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca47de-19d0-41f1-a69a-8f52b0a76a4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:22.816231 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca47de-19d0-41f1-a69a-8f52b0a76a4b None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:22.828496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-26ca47de-19d0-41f1-a69a-8f52b0a76a4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:22.828496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:22.828496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:22.828496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:22.828496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:22.828496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:22.828496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:22.828496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:22.828496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:22.828496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:22.828496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:22.828496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:22.828496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:26:22.828496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:26:22.828496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:26:22.829482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:26:22.829482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:22.829482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:22.829482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:22.829482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:22.829482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:22.829482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:22.829482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:22.829482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:22.829482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:22.829482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:22.829482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:22.829482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:22.829482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:22.829482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:22.829482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:22.829482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:22.835427 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:26:22.835427 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:26:22.835427 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:22.835427 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:22.835662 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101e882-d25c-4c89-9df4-1a756fe7a83c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:22.835741 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 526/1044] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:22.835741 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca47de-19d0-41f1-a69a-8f52b0a76a4b None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:22.874395 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e7566-9b75-47d3-a1bf-2720e056d4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:22.875025 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e7566-9b75-47d3-a1bf-2720e056d4ee None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:22.875338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e7566-9b75-47d3-a1bf-2720e056d4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:22.875619 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e7566-9b75-47d3-a1bf-2720e056d4ee None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:22.876311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e7566-9b75-47d3-a1bf-2720e056d4ee None admin] RBAC: Adding query filter params (name=image) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:22.876622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e7566-9b75-47d3-a1bf-2720e056d4ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:22.878015 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e7566-9b75-47d3-a1bf-2720e056d4ee None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:22.883741 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 519/1045] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:22.890693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e7566-9b75-47d3-a1bf-2720e056d4ee None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:22.925560 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:22.957801 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca47de-19d0-41f1-a69a-8f52b0a76a4b None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:22.995177 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42989f-b514-4026-8168-6dece4d3e0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:22.995851 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42989f-b514-4026-8168-6dece4d3e0ff None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:22.996136 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42989f-b514-4026-8168-6dece4d3e0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:22.996414 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42989f-b514-4026-8168-6dece4d3e0ff None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:22.997118 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42989f-b514-4026-8168-6dece4d3e0ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:22.997716 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42989f-b514-4026-8168-6dece4d3e0ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:22.999712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42989f-b514-4026-8168-6dece4d3e0ff None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:23.007925 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e7566-9b75-47d3-a1bf-2720e056d4ee None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:23.013713 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 527/1046] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:23.019189 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42989f-b514-4026-8168-6dece4d3e0ff None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:23.044349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfaf78c-5cb7-4d13-a880-e74d22ab34ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:23.045767 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaf78c-5cb7-4d13-a880-e74d22ab34ce None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:23.046232 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaf78c-5cb7-4d13-a880-e74d22ab34ce None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:23.046658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaf78c-5cb7-4d13-a880-e74d22ab34ce None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:23.047588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfaf78c-5cb7-4d13-a880-e74d22ab34ce None admin] RBAC: Adding query filter params (type=image) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:23.047902 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfaf78c-5cb7-4d13-a880-e74d22ab34ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:23.049707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfaf78c-5cb7-4d13-a880-e74d22ab34ce None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:23.059537 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 520/1047] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:23.061640 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfaf78c-5cb7-4d13-a880-e74d22ab34ce None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:23.079314 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:23.143046 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42989f-b514-4026-8168-6dece4d3e0ff None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:23.169105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:23.178944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfaf78c-5cb7-4d13-a880-e74d22ab34ce None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:23.183377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40fbb7-2bc0-4cc3-9ff8-2cbe4a842ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:23.184036 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40fbb7-2bc0-4cc3-9ff8-2cbe4a842ddd None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:23.184321 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40fbb7-2bc0-4cc3-9ff8-2cbe4a842ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:23.184602 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40fbb7-2bc0-4cc3-9ff8-2cbe4a842ddd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:23.191984 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40fbb7-2bc0-4cc3-9ff8-2cbe4a842ddd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:23.205197 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40fbb7-2bc0-4cc3-9ff8-2cbe4a842ddd None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:23.205480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-6f40fbb7-2bc0-4cc3-9ff8-2cbe4a842ddd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:26:23.205480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:23.205480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:23.205480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:23.205480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:23.205480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:23.205480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:23.205480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:23.205480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:23.205480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:23.205480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:23.205480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:23.205480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:26:23.205480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:26:23.205480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:26:23.206439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:26:23.206439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:23.206439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:23.206439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:23.206439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:23.206439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:23.206439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:23.206439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:23.206439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:23.206439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:23.206439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:23.206439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:23.206439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:23.206439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:23.206439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:23.206439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:23.206439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:23.207623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:26:23.207623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:26:23.207623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:26:23.207623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:26:23.207623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:26:23.207623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:26:23.207623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:26:23.207623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:23.207623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 528/1048] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:26:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:23.208430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668ff90-3994-400e-aaf5-a01d08cc86e9 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:23.208430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668ff90-3994-400e-aaf5-a01d08cc86e9 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:23.208800 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668ff90-3994-400e-aaf5-a01d08cc86e9 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:23.210818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 529/1049] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:23.212581 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668ff90-3994-400e-aaf5-a01d08cc86e9 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:23.219067 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758cc509-89f2-4dcb-bb4b-2854c6c09cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:23.219778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cc509-89f2-4dcb-bb4b-2854c6c09cb2 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:23.220058 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cc509-89f2-4dcb-bb4b-2854c6c09cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:23.220353 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cc509-89f2-4dcb-bb4b-2854c6c09cb2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:23.221094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758cc509-89f2-4dcb-bb4b-2854c6c09cb2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:23.222463 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758cc509-89f2-4dcb-bb4b-2854c6c09cb2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:23.322585 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668ff90-3994-400e-aaf5-a01d08cc86e9 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:23.325967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 521/1050] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:26:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:23.327852 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4233bf-a843-4844-ac60-bad5b57b4199 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:23.328152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4233bf-a843-4844-ac60-bad5b57b4199 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:23.328422 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4233bf-a843-4844-ac60-bad5b57b4199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:23.335290 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:23.349845 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-4a4233bf-a843-4844-ac60-bad5b57b4199 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:23.352199 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4a4233bf-a843-4844-ac60-bad5b57b4199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:23.376670 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66525a-40cc-4f19-b01a-7cbb9b4a7f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:23.378085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66525a-40cc-4f19-b01a-7cbb9b4a7f3b None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:23.378383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66525a-40cc-4f19-b01a-7cbb9b4a7f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:23.378774 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66525a-40cc-4f19-b01a-7cbb9b4a7f3b None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:23.379497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66525a-40cc-4f19-b01a-7cbb9b4a7f3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:23.379945 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66525a-40cc-4f19-b01a-7cbb9b4a7f3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:23.381426 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66525a-40cc-4f19-b01a-7cbb9b4a7f3b None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:23.396369 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 530/1051] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:26:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:23.407354 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66525a-40cc-4f19-b01a-7cbb9b4a7f3b None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:23.465594 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 522/1052] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:23.492284 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4233bf-a843-4844-ac60-bad5b57b4199 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:23.544163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66525a-40cc-4f19-b01a-7cbb9b4a7f3b None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:23.582230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339719ad-946e-47cb-bf1c-d8e8edb6538a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:23.582862 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339719ad-946e-47cb-bf1c-d8e8edb6538a None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:23.583148 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339719ad-946e-47cb-bf1c-d8e8edb6538a None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:23.583462 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339719ad-946e-47cb-bf1c-d8e8edb6538a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:23.584270 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339719ad-946e-47cb-bf1c-d8e8edb6538a None admin] RBAC: Adding query filter params (role.id=a4fdca42d75d42b884608b1880bd969c, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=be769d4dd016466f9174e7d5e47a2a0d) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:23.584585 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339719ad-946e-47cb-bf1c-d8e8edb6538a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:23.586101 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339719ad-946e-47cb-bf1c-d8e8edb6538a None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:23.589964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:23.595123 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 531/1053] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:26:23 2022] GET /identity/v3/role_assignments?user.id=be769d4dd016466f9174e7d5e47a2a0d&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=a4fdca42d75d42b884608b1880bd969c => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:23.623294 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4233bf-a843-4844-ac60-bad5b57b4199 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:23.665340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadb8c6-d47c-43db-9dfd-b483dceac7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:23.665924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadb8c6-d47c-43db-9dfd-b483dceac7df None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:23.666212 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadb8c6-d47c-43db-9dfd-b483dceac7df None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:23.666490 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadb8c6-d47c-43db-9dfd-b483dceac7df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:23.679427 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abadb8c6-d47c-43db-9dfd-b483dceac7df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:26:23.684598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-abadb8c6-d47c-43db-9dfd-b483dceac7df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:26:23.684598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:23.684598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:23.684598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:23.684598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:23.684598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:23.684598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:23.684598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:23.684598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:23.684598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:23.684598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:23.684598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:23.684598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:26:23.684598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:26:23.684598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:26:23.684598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:26:23.685769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:26:23.685769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:26:23.685769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:26:23.685769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:26:23.685769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:23.685769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:23.685769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:23.685769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:23.685769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:23.685769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:23.685769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:23.685769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:23.685769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:23.685769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:23.685769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:23.685769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:23.691956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:23.691956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:23.691956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:23.691956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:23.691956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:26:23.691956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:26:23.691956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:26:23.691956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:26:23.691956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:26:23.691956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:26:23.691956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:26:23.691956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:23.691956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 523/1054] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:26:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:23.694332 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339719ad-946e-47cb-bf1c-d8e8edb6538a None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:23.729840 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:23.829318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339719ad-946e-47cb-bf1c-d8e8edb6538a None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:23.868624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c26de2-78d5-455b-92e3-3530c7792c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:23.869247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c26de2-78d5-455b-92e3-3530c7792c6c None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:23.869526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c26de2-78d5-455b-92e3-3530c7792c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:23.869796 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c26de2-78d5-455b-92e3-3530c7792c6c None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:23.870513 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c26de2-78d5-455b-92e3-3530c7792c6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:23.870816 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c26de2-78d5-455b-92e3-3530c7792c6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:23.872200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c26de2-78d5-455b-92e3-3530c7792c6c None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:23.886064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 532/1055] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:26:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:23.887922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadb8c6-d47c-43db-9dfd-b483dceac7df None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:24.004286 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadb8c6-d47c-43db-9dfd-b483dceac7df None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:24.041966 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db29ea0-3614-4d2f-9572-cd9092940125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:24.042625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db29ea0-3614-4d2f-9572-cd9092940125 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:24.042905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db29ea0-3614-4d2f-9572-cd9092940125 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:24.043289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db29ea0-3614-4d2f-9572-cd9092940125 None admin] PATH_INFO: `/v3/users/95fcc1cfe432415296a52df204e87d18` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:24.046636 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:24.059701 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db29ea0-3614-4d2f-9572-cd9092940125 None admin] RBAC: Authorizing `identity:get_user(user_id=95fcc1cfe432415296a52df204e87d18)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:24.061988 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db29ea0-3614-4d2f-9572-cd9092940125 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:24.063933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 524/1056] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:26:23 2022] GET /identity/v3/users/95fcc1cfe432415296a52df204e87d18 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:24.070504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c26de2-78d5-455b-92e3-3530c7792c6c None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:24.166060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:24.176855 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c26de2-78d5-455b-92e3-3530c7792c6c None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:24.212612 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4f4d8-cb05-46a3-b4ac-8f16b3891221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:24.213237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4f4d8-cb05-46a3-b4ac-8f16b3891221 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:24.213526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4f4d8-cb05-46a3-b4ac-8f16b3891221 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:24.213802 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4f4d8-cb05-46a3-b4ac-8f16b3891221 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:24.283956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4f4d8-cb05-46a3-b4ac-8f16b3891221 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:24.285348 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4f4d8-cb05-46a3-b4ac-8f16b3891221 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:24.377694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:24.388661 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 533/1057] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:26:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 18:26:24.394902 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db29ea0-3614-4d2f-9572-cd9092940125 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:24.501075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db29ea0-3614-4d2f-9572-cd9092940125 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:24.545316 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03434a-2095-4a98-8f87-122a6cf2675e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:24.545898 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03434a-2095-4a98-8f87-122a6cf2675e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:24.546182 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03434a-2095-4a98-8f87-122a6cf2675e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:24.547370 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03434a-2095-4a98-8f87-122a6cf2675e None admin] PATH_INFO: `/v3/projects/24c42c1b704a471a9b6b21cd9509ee9a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:24.548019 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03434a-2095-4a98-8f87-122a6cf2675e None admin] RBAC: Authorizing `identity:get_project(project_id=24c42c1b704a471a9b6b21cd9509ee9a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:24.549809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03434a-2095-4a98-8f87-122a6cf2675e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:24.551531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 525/1058] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:26:24 2022] GET /identity/v3/projects/24c42c1b704a471a9b6b21cd9509ee9a => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:24.557409 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4f4d8-cb05-46a3-b4ac-8f16b3891221 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:24.709500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4f4d8-cb05-46a3-b4ac-8f16b3891221 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:24.745923 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef2b94-b961-470a-bb40-d54ae55c523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:24.746544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef2b94-b961-470a-bb40-d54ae55c523a None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:24.746825 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef2b94-b961-470a-bb40-d54ae55c523a None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:24.747101 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef2b94-b961-470a-bb40-d54ae55c523a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:24.748771 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef2b94-b961-470a-bb40-d54ae55c523a None admin] RBAC: Adding query filter params (role.id=4ae8d11d74f14bcc80117d897ba2f5b6, scope.project.id=24c42c1b704a471a9b6b21cd9509ee9a, user.id=95fcc1cfe432415296a52df204e87d18) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:24.749083 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef2b94-b961-470a-bb40-d54ae55c523a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:24.750547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef2b94-b961-470a-bb40-d54ae55c523a None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:24.756620 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 534/1059] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:26:24 2022] GET /identity/v3/role_assignments?user.id=95fcc1cfe432415296a52df204e87d18&scope.project.id=24c42c1b704a471a9b6b21cd9509ee9a&role.id=4ae8d11d74f14bcc80117d897ba2f5b6 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:25.454839 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87de3d-7632-4957-ad71-e9b294c79bad None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:25.455397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87de3d-7632-4957-ad71-e9b294c79bad None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:25.455478 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87de3d-7632-4957-ad71-e9b294c79bad None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:25.456955 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 526/1060] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:25.462478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaee3c-5a49-4827-a287-30ec7966516e None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:25.463092 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaee3c-5a49-4827-a287-30ec7966516e None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:25.463092 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaee3c-5a49-4827-a287-30ec7966516e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:25.483210 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-abcaee3c-5a49-4827-a287-30ec7966516e None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:25.484450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-abcaee3c-5a49-4827-a287-30ec7966516e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:25.542479 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:25.561936 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 535/1061] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:25.583666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87de3d-7632-4957-ad71-e9b294c79bad None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:25.636416 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d54d7b-bda4-45ee-a229-6a12b26d0d0a None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:25.637206 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d54d7b-bda4-45ee-a229-6a12b26d0d0a None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:25.637676 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d54d7b-bda4-45ee-a229-6a12b26d0d0a None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:25.640224 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 536/1062] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:25.645129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedebaea-af12-404c-9e6e-564c1759571e None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:25.646005 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedebaea-af12-404c-9e6e-564c1759571e None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:25.646771 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedebaea-af12-404c-9e6e-564c1759571e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:25.650984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:25.671062 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-cedebaea-af12-404c-9e6e-564c1759571e None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:25.672308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-cedebaea-af12-404c-9e6e-564c1759571e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:25.693657 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87de3d-7632-4957-ad71-e9b294c79bad None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:25.739234 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27689665-da94-48c6-aceb-279b44d2fbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:25.739820 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27689665-da94-48c6-aceb-279b44d2fbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:25.740116 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27689665-da94-48c6-aceb-279b44d2fbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:25.740372 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27689665-da94-48c6-aceb-279b44d2fbe2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:25.747532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 537/1063] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:25.767447 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedebaea-af12-404c-9e6e-564c1759571e None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:25.814409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27689665-da94-48c6-aceb-279b44d2fbe2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:25.815918 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27689665-da94-48c6-aceb-279b44d2fbe2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:25.885203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedebaea-af12-404c-9e6e-564c1759571e None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:25.893977 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:25.900062 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:25.921263 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed55335-8849-4518-b43b-2d067c78b834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:25.921944 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed55335-8849-4518-b43b-2d067c78b834 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:25.922228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed55335-8849-4518-b43b-2d067c78b834 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:25.922502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed55335-8849-4518-b43b-2d067c78b834 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:25.933473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed55335-8849-4518-b43b-2d067c78b834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:26:25.938224 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 527/1064] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:26:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:26:25.938551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-2ed55335-8849-4518-b43b-2d067c78b834 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:26:25.938551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:25.938551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:25.938551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:25.938551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:25.938551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:25.938551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:25.938551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:25.938551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:25.938551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:25.938551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:25.938551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:25.938551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:26:25.938551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:26:25.938551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:26:25.938551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:26:25.947990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:26:25.947990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:26:25.947990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:26:25.947990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:26:25.947990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:25.947990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:25.947990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:25.947990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:25.947990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:25.947990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:25.947990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:25.947990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:25.947990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:25.947990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:25.947990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:25.947990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:25.948880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:25.948880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:25.948880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:25.948880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:25.948880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:26:25.948880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:26:25.948880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:26:25.948880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:26:25.948880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:26:25.948880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:26:25.948880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:26:25.948880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:25.948880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 538/1065] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Jul 27 18:26:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:25.949612 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27689665-da94-48c6-aceb-279b44d2fbe2 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:25.949688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed55335-8849-4518-b43b-2d067c78b834 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:26.054802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27689665-da94-48c6-aceb-279b44d2fbe2 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:26.055757 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed55335-8849-4518-b43b-2d067c78b834 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:26.091187 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eedb91-50e6-4ab2-8dd9-e8514a7aba53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:26.091512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a97fe-0129-4164-a265-bf905551d6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:26.092441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eedb91-50e6-4ab2-8dd9-e8514a7aba53 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:26.092620 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a97fe-0129-4164-a265-bf905551d6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:26.092812 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eedb91-50e6-4ab2-8dd9-e8514a7aba53 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:26.092936 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a97fe-0129-4164-a265-bf905551d6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:26.093091 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eedb91-50e6-4ab2-8dd9-e8514a7aba53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:26.093215 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a97fe-0129-4164-a265-bf905551d6c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:26.093878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a97fe-0129-4164-a265-bf905551d6c2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:26.094187 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a97fe-0129-4164-a265-bf905551d6c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:26.095604 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a97fe-0129-4164-a265-bf905551d6c2 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:26.104151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 539/1066] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Jul 27 18:26:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:26.104316 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eedb91-50e6-4ab2-8dd9-e8514a7aba53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:26.105512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eedb91-50e6-4ab2-8dd9-e8514a7aba53 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:26.110109 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a97fe-0129-4164-a265-bf905551d6c2 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:26.124149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-28eedb91-50e6-4ab2-8dd9-e8514a7aba53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:26.124149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:26.124149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:26.124149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:26.124149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:26.124149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:26.124149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:26.124149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:26.124149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:26.124149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:26.124149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:26.124149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:26.124149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:26:26.124149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:26:26.124149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:26:26.125384 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:26:26.125384 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:26.125384 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:26.125384 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:26.125384 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:26.125384 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:26.125384 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:26.125384 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:26.125384 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:26.125384 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:26.125384 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:26.125384 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:26.125384 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:26.125384 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:26.125384 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:26.125384 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:26.125384 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:26.126528 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:26:26.126528 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:26:26.126528 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:26.126528 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:26.132137 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 528/1067] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:26.132873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eedb91-50e6-4ab2-8dd9-e8514a7aba53 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:26.149812 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:26.156377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:26.221133 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a97fe-0129-4164-a265-bf905551d6c2 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:26.241401 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eedb91-50e6-4ab2-8dd9-e8514a7aba53 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:26.258776 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cf44e-63a7-44e1-898b-850e446f3969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:26.259453 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cf44e-63a7-44e1-898b-850e446f3969 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:26.259760 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cf44e-63a7-44e1-898b-850e446f3969 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:26.260017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cf44e-63a7-44e1-898b-850e446f3969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:26.270408 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0cf44e-63a7-44e1-898b-850e446f3969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:26.271911 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0cf44e-63a7-44e1-898b-850e446f3969 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:26.280266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ed5d6-f47a-4578-91de-1aaf5202d68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:26.281253 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ed5d6-f47a-4578-91de-1aaf5202d68d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:26.281535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ed5d6-f47a-4578-91de-1aaf5202d68d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:26.281814 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ed5d6-f47a-4578-91de-1aaf5202d68d None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:26.282520 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ed5d6-f47a-4578-91de-1aaf5202d68d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:26.282825 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ed5d6-f47a-4578-91de-1aaf5202d68d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:26.284226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ed5d6-f47a-4578-91de-1aaf5202d68d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:26.287606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-fd0cf44e-63a7-44e1-898b-850e446f3969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:26.287606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:26.287606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:26.287606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:26.287606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:26.287606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:26.287606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:26.287606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:26.287606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:26.287606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:26.287606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:26.287606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:26.287606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:26:26.287606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:26:26.287606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:26:26.288491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:26:26.288491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:26.288491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:26.288491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:26.288491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:26.288491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:26.288491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:26.288491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:26.288491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:26.288491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:26.288491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:26.288491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:26.288491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:26.288491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:26.288491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:26.288491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:26.288491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:26.289413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:26:26.289413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:26:26.289413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:26.289413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:26.289413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 540/1068] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:26.294445 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cf44e-63a7-44e1-898b-850e446f3969 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:26.307725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 529/1069] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:26.403516 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:26.418752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cf44e-63a7-44e1-898b-850e446f3969 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:26.457012 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1af44d-0637-48bc-90b8-385fc8b16cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:26.457648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1af44d-0637-48bc-90b8-385fc8b16cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:26.457939 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1af44d-0637-48bc-90b8-385fc8b16cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:26.458207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1af44d-0637-48bc-90b8-385fc8b16cd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:26.458915 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1af44d-0637-48bc-90b8-385fc8b16cd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:26.459226 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1af44d-0637-48bc-90b8-385fc8b16cd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:26.460714 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1af44d-0637-48bc-90b8-385fc8b16cd6 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:26.474166 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 541/1070] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:26.480136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ed5d6-f47a-4578-91de-1aaf5202d68d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:26.574631 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:26.600718 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ed5d6-f47a-4578-91de-1aaf5202d68d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:26.637792 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5a760-ff63-46ed-9ed0-b99ce0af260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:26.639006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5a760-ff63-46ed-9ed0-b99ce0af260b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:26.639309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5a760-ff63-46ed-9ed0-b99ce0af260b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:26.639594 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5a760-ff63-46ed-9ed0-b99ce0af260b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:26.646827 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5a760-ff63-46ed-9ed0-b99ce0af260b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:26.648298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5a760-ff63-46ed-9ed0-b99ce0af260b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:26.660985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-e3d5a760-ff63-46ed-9ed0-b99ce0af260b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:26:26.660985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:26.660985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:26.660985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:26.660985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:26.660985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:26.660985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:26.660985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:26.660985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:26.660985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:26.660985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:26.660985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:26.660985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:26:26.660985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:26:26.660985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:26:26.660985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:26:26.662128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:26.662128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:26.662128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:26:26.662128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:26:26.662128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:26:26.662128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:26:26.662128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:26.662128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:26.662128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:26.662128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:26.662128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:26.662128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:26.662128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:26.662128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:26.662128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:26.662128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:26.662128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:26.662128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:26.663094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:26.663094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:26.663094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:26:26.663094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:26:26.663094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:26:26.663094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:26:26.663094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:26:26.663094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:26:26.663094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:26:26.663094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:26.663094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 530/1071] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 18:26:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:26.668001 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1af44d-0637-48bc-90b8-385fc8b16cd6 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:26.773344 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2e731-54df-428e-a3e2-9d41ddc34ef8 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:26.773628 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2e731-54df-428e-a3e2-9d41ddc34ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:26.773902 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2e731-54df-428e-a3e2-9d41ddc34ef8 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:26.775433 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 531/1072] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:26:26.781026 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ac015-56b0-44b6-adc6-7439862c72d0 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:26.781307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ac015-56b0-44b6-adc6-7439862c72d0 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:26.781583 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ac015-56b0-44b6-adc6-7439862c72d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:26.799397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-500ac015-56b0-44b6-adc6-7439862c72d0 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:26.800591 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-500ac015-56b0-44b6-adc6-7439862c72d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:26.810461 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1af44d-0637-48bc-90b8-385fc8b16cd6 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:26.851957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19366730-c2f7-46b1-913c-6f7542c4d05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:26.852493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19366730-c2f7-46b1-913c-6f7542c4d05e None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:26.852775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19366730-c2f7-46b1-913c-6f7542c4d05e None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:26.853051 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19366730-c2f7-46b1-913c-6f7542c4d05e None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:26.853855 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19366730-c2f7-46b1-913c-6f7542c4d05e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:26.854279 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19366730-c2f7-46b1-913c-6f7542c4d05e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:26.855638 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19366730-c2f7-46b1-913c-6f7542c4d05e None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:26.874076 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 542/1073] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 18:26:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:26.874771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 532/1074] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:26:26.879682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19366730-c2f7-46b1-913c-6f7542c4d05e None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:26.889052 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:26.897814 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ac015-56b0-44b6-adc6-7439862c72d0 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:26.962005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:26.987355 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19366730-c2f7-46b1-913c-6f7542c4d05e None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:27.001427 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ac015-56b0-44b6-adc6-7439862c72d0 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:27.022063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c6eba-70d2-486d-b923-46d2a5a9da4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:27.022709 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c6eba-70d2-486d-b923-46d2a5a9da4d None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:27.022992 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c6eba-70d2-486d-b923-46d2a5a9da4d None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:27.023288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c6eba-70d2-486d-b923-46d2a5a9da4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:27.034050 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c6eba-70d2-486d-b923-46d2a5a9da4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:27.035610 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c6eba-70d2-486d-b923-46d2a5a9da4d None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:27.036736 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adc7e7-3d96-4857-a60b-2682fc2d5099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:27.037381 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adc7e7-3d96-4857-a60b-2682fc2d5099 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:27.037663 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adc7e7-3d96-4857-a60b-2682fc2d5099 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:27.037940 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adc7e7-3d96-4857-a60b-2682fc2d5099 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:27.048353 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adc7e7-3d96-4857-a60b-2682fc2d5099 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:26:27.049758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-6c5c6eba-70d2-486d-b923-46d2a5a9da4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:27.049758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:27.049758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:27.049758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:27.049758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:27.049758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:27.049758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:27.049758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:27.049758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:27.049758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:27.049758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:27.049758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:27.049758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:26:27.049758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:26:27.049758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:26:27.050788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:26:27.050788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:27.050788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:27.050788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:27.050788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:27.050788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:27.050788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:27.050788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:27.050788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:27.050788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:27.050788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:27.050788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:27.050788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:27.050788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:27.050788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:27.050788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:27.050788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:27.051898 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:26:27.051898 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:26:27.051898 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:27.051898 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:27.051898 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 543/1075] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:27.053508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-b1adc7e7-3d96-4857-a60b-2682fc2d5099 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:26:27.053508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:27.053508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:27.053508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:27.053508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:27.053508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:27.053508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:27.053508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:27.053508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:27.053508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:27.053508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:27.053508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:27.053508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:26:27.053508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:26:27.053508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:26:27.053508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:26:27.054585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:26:27.054585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:26:27.054585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:26:27.054585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:26:27.054585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:27.054585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:27.054585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:27.054585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:27.054585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:27.054585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:27.054585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:27.054585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:27.054585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:27.054585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:27.054585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:27.054585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:27.055841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:27.055841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:27.055841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:27.055841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:27.055841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:26:27.055841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:26:27.055841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:26:27.055841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:26:27.055841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:26:27.055841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:26:27.055841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:26:27.055841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:27.055841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 533/1076] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:26:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:27.056543 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c6eba-70d2-486d-b923-46d2a5a9da4d None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:27.061825 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adc7e7-3d96-4857-a60b-2682fc2d5099 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:27.118140 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:27.162795 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c6eba-70d2-486d-b923-46d2a5a9da4d None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:27.165301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adc7e7-3d96-4857-a60b-2682fc2d5099 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:27.191332 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:27.199569 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4ea90-c0f8-4ab5-95ef-535774477d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:27.200202 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4ea90-c0f8-4ab5-95ef-535774477d5f None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:27.200490 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4ea90-c0f8-4ab5-95ef-535774477d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:27.203665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4ea90-c0f8-4ab5-95ef-535774477d5f None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:27.203665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4ea90-c0f8-4ab5-95ef-535774477d5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:27.203665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4ea90-c0f8-4ab5-95ef-535774477d5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:27.203926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049cc7a-b0c1-4e5d-9c07-f6ba5b3f6f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:27.203926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049cc7a-b0c1-4e5d-9c07-f6ba5b3f6f70 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:27.203926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049cc7a-b0c1-4e5d-9c07-f6ba5b3f6f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:27.203926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049cc7a-b0c1-4e5d-9c07-f6ba5b3f6f70 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:27.204388 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4ea90-c0f8-4ab5-95ef-535774477d5f None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:27.204479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049cc7a-b0c1-4e5d-9c07-f6ba5b3f6f70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:27.204479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049cc7a-b0c1-4e5d-9c07-f6ba5b3f6f70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:27.205488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049cc7a-b0c1-4e5d-9c07-f6ba5b3f6f70 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:27.213744 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 534/1077] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:26:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:27.215778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 544/1078] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:27.220481 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049cc7a-b0c1-4e5d-9c07-f6ba5b3f6f70 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:27.221479 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4ea90-c0f8-4ab5-95ef-535774477d5f None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:27.323711 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4ea90-c0f8-4ab5-95ef-535774477d5f None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:27.327759 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049cc7a-b0c1-4e5d-9c07-f6ba5b3f6f70 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:27.343744 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:27.361921 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22da48-ce99-44e8-9d18-5ed4eb6fe2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:27.362581 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22da48-ce99-44e8-9d18-5ed4eb6fe2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:27.363861 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22da48-ce99-44e8-9d18-5ed4eb6fe2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:27.363861 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22da48-ce99-44e8-9d18-5ed4eb6fe2a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:27.364448 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39de292-15fb-4186-b2d5-d1762ccf70de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:27.365095 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39de292-15fb-4186-b2d5-d1762ccf70de None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:27.365373 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39de292-15fb-4186-b2d5-d1762ccf70de None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:27.365641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39de292-15fb-4186-b2d5-d1762ccf70de None admin] PATH_INFO: `/v3/users/95fcc1cfe432415296a52df204e87d18` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:27.366836 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39de292-15fb-4186-b2d5-d1762ccf70de None admin] RBAC: Authorizing `identity:get_user(user_id=95fcc1cfe432415296a52df204e87d18)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:27.368416 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39de292-15fb-4186-b2d5-d1762ccf70de None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:27.370052 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 535/1079] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:26:27 2022] GET /identity/v3/users/95fcc1cfe432415296a52df204e87d18 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:27.371919 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22da48-ce99-44e8-9d18-5ed4eb6fe2a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:27.374416 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22da48-ce99-44e8-9d18-5ed4eb6fe2a5 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:27.376783 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39de292-15fb-4186-b2d5-d1762ccf70de None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:27.387399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-ea22da48-ce99-44e8-9d18-5ed4eb6fe2a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:26:27.387399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:27.387399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:27.387399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:27.387399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:27.387399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:27.387399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:27.387399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:27.387399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:27.387399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:27.387399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:27.387399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:27.387399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:26:27.387399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:26:27.387399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:26:27.389011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:26:27.389011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:27.389011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:27.389011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:27.389011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:27.389011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:27.389011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:27.389011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:27.389011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:27.389011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:27.389011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:27.389011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:27.389011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:27.389011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:27.389011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:27.389011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:27.389011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:27.390029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:26:27.390029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:26:27.390029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:26:27.390029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:26:27.390029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:26:27.390029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:26:27.390029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:26:27.390029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:27.390029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 545/1080] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:26:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:27.395199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22da48-ce99-44e8-9d18-5ed4eb6fe2a5 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:27.441311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:27.491405 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39de292-15fb-4186-b2d5-d1762ccf70de None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:27.513730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22da48-ce99-44e8-9d18-5ed4eb6fe2a5 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:27.528488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e452cd9-734a-4da3-acde-447d847467cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:27.529202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e452cd9-734a-4da3-acde-447d847467cd None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:27.529599 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e452cd9-734a-4da3-acde-447d847467cd None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:27.529946 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e452cd9-734a-4da3-acde-447d847467cd None admin] PATH_INFO: `/v3/projects/24c42c1b704a471a9b6b21cd9509ee9a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:27.531054 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e452cd9-734a-4da3-acde-447d847467cd None admin] RBAC: Authorizing `identity:get_project(project_id=24c42c1b704a471a9b6b21cd9509ee9a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:27.532542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e452cd9-734a-4da3-acde-447d847467cd None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:27.534249 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 536/1081] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:26:27 2022] GET /identity/v3/projects/24c42c1b704a471a9b6b21cd9509ee9a => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:27.540374 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e452cd9-734a-4da3-acde-447d847467cd None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:27.551244 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458edda-88ec-4e4c-a662-78282c89a38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:27.551967 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458edda-88ec-4e4c-a662-78282c89a38b None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:27.552255 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458edda-88ec-4e4c-a662-78282c89a38b None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:27.552533 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458edda-88ec-4e4c-a662-78282c89a38b None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:27.553475 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458edda-88ec-4e4c-a662-78282c89a38b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:27.553597 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458edda-88ec-4e4c-a662-78282c89a38b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:27.555078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458edda-88ec-4e4c-a662-78282c89a38b None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:27.568654 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 546/1082] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:26:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:27.574570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458edda-88ec-4e4c-a662-78282c89a38b None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:27.615811 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:27.648947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e452cd9-734a-4da3-acde-447d847467cd None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:27.673164 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:27.680633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458edda-88ec-4e4c-a662-78282c89a38b None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:27.685961 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96945bf-43c8-4566-9756-0b550a786ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:27.686642 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96945bf-43c8-4566-9756-0b550a786ce9 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:27.686972 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96945bf-43c8-4566-9756-0b550a786ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:27.687360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96945bf-43c8-4566-9756-0b550a786ce9 None admin] PATH_INFO: `/v3/projects/24c42c1b704a471a9b6b21cd9509ee9a/users/95fcc1cfe432415296a52df204e87d18/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:27.689282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96945bf-43c8-4566-9756-0b550a786ce9 None admin] RBAC: Authorizing `identity:create_grant(project_id=24c42c1b704a471a9b6b21cd9509ee9a, user_id=95fcc1cfe432415296a52df204e87d18, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:27.690736 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96945bf-43c8-4566-9756-0b550a786ce9 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:27.716649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2d8a9-8ea6-4430-a8d6-f70ae6013561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:27.717395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2d8a9-8ea6-4430-a8d6-f70ae6013561 None admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:27.717673 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2d8a9-8ea6-4430-a8d6-f70ae6013561 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:27.717944 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2d8a9-8ea6-4430-a8d6-f70ae6013561 None admin] PATH_INFO: `/v3/projects/2880a34079d742c38bfdace2c04564c7/users/be769d4dd016466f9174e7d5e47a2a0d/roles/a4fdca42d75d42b884608b1880bd969c` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:27.720149 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2d8a9-8ea6-4430-a8d6-f70ae6013561 None admin] RBAC: Authorizing `identity:create_grant(project_id=2880a34079d742c38bfdace2c04564c7, user_id=be769d4dd016466f9174e7d5e47a2a0d, role_id=a4fdca42d75d42b884608b1880bd969c)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:27.721577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2d8a9-8ea6-4430-a8d6-f70ae6013561 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:27.908843 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 537/1083] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:26:27 2022] PUT /identity/v3/projects/24c42c1b704a471a9b6b21cd9509ee9a/users/95fcc1cfe432415296a52df204e87d18/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:26:27.936814 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 547/1084] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:26:27 2022] PUT /identity/v3/projects/2880a34079d742c38bfdace2c04564c7/users/be769d4dd016466f9174e7d5e47a2a0d/roles/a4fdca42d75d42b884608b1880bd969c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:26:29.914416 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4deab40-6c8c-4655-bcc9-b6951fb571fe None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:29.914998 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4deab40-6c8c-4655-bcc9-b6951fb571fe None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:29.914998 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4deab40-6c8c-4655-bcc9-b6951fb571fe None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:29.916388 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 538/1085] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:29.922276 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffeb31-2e7d-4158-825a-fc082cc746b8 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:29.922753 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffeb31-2e7d-4158-825a-fc082cc746b8 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:29.922854 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffeb31-2e7d-4158-825a-fc082cc746b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:29.941304 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc0cf3-45ca-49fb-af08-fd0fa199cc72 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:29.941591 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc0cf3-45ca-49fb-af08-fd0fa199cc72 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:29.941870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc0cf3-45ca-49fb-af08-fd0fa199cc72 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:29.942004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-60ffeb31-2e7d-4158-825a-fc082cc746b8 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:29.943467 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-60ffeb31-2e7d-4158-825a-fc082cc746b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:29.943604 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 539/1086] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:26:29.948042 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982f5fd-2697-4d5c-96a9-3c9b1f9aac4d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:29.948328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982f5fd-2697-4d5c-96a9-3c9b1f9aac4d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:29.948604 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982f5fd-2697-4d5c-96a9-3c9b1f9aac4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:29.966206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-3982f5fd-2697-4d5c-96a9-3c9b1f9aac4d None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:29.967437 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-3982f5fd-2697-4d5c-96a9-3c9b1f9aac4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:30.011876 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 548/1087] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:30.035292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffeb31-2e7d-4158-825a-fc082cc746b8 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:30.036547 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 540/1088] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:26:30.061887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982f5fd-2697-4d5c-96a9-3c9b1f9aac4d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:30.062959 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:30.139972 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffeb31-2e7d-4158-825a-fc082cc746b8 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:30.163228 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982f5fd-2697-4d5c-96a9-3c9b1f9aac4d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:30.176456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022800f5-1f05-4b1b-973e-0fca68c69438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:30.177001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:30.177132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022800f5-1f05-4b1b-973e-0fca68c69438 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:30.177348 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022800f5-1f05-4b1b-973e-0fca68c69438 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:30.177627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022800f5-1f05-4b1b-973e-0fca68c69438 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:30.188708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022800f5-1f05-4b1b-973e-0fca68c69438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:26:30.193614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-022800f5-1f05-4b1b-973e-0fca68c69438 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:26:30.193614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:30.193614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:30.193614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:30.193614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:30.193614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:30.193614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:30.193614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:30.193614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:30.193614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:30.193614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:30.193614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:30.193614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:26:30.193614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:26:30.193614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:26:30.193614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:26:30.195059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:26:30.195059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:26:30.195059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:26:30.195059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:26:30.195059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:30.195059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:30.195059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:30.195059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:30.195059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:30.195059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:30.195059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:30.195059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:30.195059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:30.195059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:30.195059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:30.195059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:30.196161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:30.196161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:30.196161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:30.196161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:30.196161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:26:30.196161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:26:30.196161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:26:30.196161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:26:30.196161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:26:30.196161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:26:30.196161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:26:30.196161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:30.196161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 549/1089] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:26:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:30.198544 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111b85d-f866-43f5-b74d-e11bacd58bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:30.199185 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111b85d-f866-43f5-b74d-e11bacd58bab None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:30.199501 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111b85d-f866-43f5-b74d-e11bacd58bab None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:30.199777 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111b85d-f866-43f5-b74d-e11bacd58bab None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:30.201016 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022800f5-1f05-4b1b-973e-0fca68c69438 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:30.210375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111b85d-f866-43f5-b74d-e11bacd58bab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:26:30.215299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-9111b85d-f866-43f5-b74d-e11bacd58bab None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:26:30.215299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:30.215299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:30.215299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:30.215299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:30.215299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:30.215299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:30.215299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:30.215299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:30.215299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:30.215299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:30.215299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:30.215299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:26:30.215299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:26:30.215299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:26:30.215299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:26:30.216277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:26:30.216277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:26:30.216277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:26:30.216277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:26:30.216277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:30.216277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:30.216277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:30.216277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:30.216277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:30.216277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:30.216277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:30.216277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:30.216277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:30.216277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:30.216277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:30.216277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:30.217911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:30.217911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:30.217911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:30.217911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:30.217911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:26:30.217911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:26:30.217911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:26:30.217911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:26:30.217911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:26:30.217911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:26:30.217911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:26:30.217911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:30.217911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 541/1090] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Jul 27 18:26:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:30.223179 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111b85d-f866-43f5-b74d-e11bacd58bab None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:30.297008 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:30.309014 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022800f5-1f05-4b1b-973e-0fca68c69438 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:30.340499 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111b85d-f866-43f5-b74d-e11bacd58bab None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:30.347054 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3601a0a-76d9-4701-ae2a-8d820bf750b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:30.347711 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3601a0a-76d9-4701-ae2a-8d820bf750b0 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:30.347989 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3601a0a-76d9-4701-ae2a-8d820bf750b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:30.348264 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3601a0a-76d9-4701-ae2a-8d820bf750b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:30.348999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3601a0a-76d9-4701-ae2a-8d820bf750b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:30.349295 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3601a0a-76d9-4701-ae2a-8d820bf750b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:30.350679 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3601a0a-76d9-4701-ae2a-8d820bf750b0 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:30.360474 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 550/1091] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:26:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:30.366452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3601a0a-76d9-4701-ae2a-8d820bf750b0 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:30.381663 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f03f3a-5f2f-4c9f-82dd-f973bd353e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:30.382428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f03f3a-5f2f-4c9f-82dd-f973bd353e68 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:30.382870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f03f3a-5f2f-4c9f-82dd-f973bd353e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:30.383283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f03f3a-5f2f-4c9f-82dd-f973bd353e68 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:30.384156 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f03f3a-5f2f-4c9f-82dd-f973bd353e68 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:30.384556 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f03f3a-5f2f-4c9f-82dd-f973bd353e68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:30.386676 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f03f3a-5f2f-4c9f-82dd-f973bd353e68 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:30.398609 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 542/1092] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Jul 27 18:26:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:30.406557 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f03f3a-5f2f-4c9f-82dd-f973bd353e68 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:30.445085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:30.474867 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3601a0a-76d9-4701-ae2a-8d820bf750b0 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:30.512048 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8b656-5064-48d2-8806-dab0bdda78ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:30.512693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8b656-5064-48d2-8806-dab0bdda78ac None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:30.512976 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8b656-5064-48d2-8806-dab0bdda78ac None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:30.513287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8b656-5064-48d2-8806-dab0bdda78ac None admin] PATH_INFO: `/v3/users/95fcc1cfe432415296a52df204e87d18` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:30.513431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f03f3a-5f2f-4c9f-82dd-f973bd353e68 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:30.514592 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8b656-5064-48d2-8806-dab0bdda78ac None admin] RBAC: Authorizing `identity:get_user(user_id=95fcc1cfe432415296a52df204e87d18)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:30.516092 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8b656-5064-48d2-8806-dab0bdda78ac None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:30.517727 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 551/1093] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:26:30 2022] GET /identity/v3/users/95fcc1cfe432415296a52df204e87d18 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:30.523453 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8b656-5064-48d2-8806-dab0bdda78ac None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:30.546697 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:30.552573 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34be917-22dc-424e-a884-deac95cd3289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:30.553229 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34be917-22dc-424e-a884-deac95cd3289 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:30.553507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34be917-22dc-424e-a884-deac95cd3289 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:30.553784 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34be917-22dc-424e-a884-deac95cd3289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:30.565727 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34be917-22dc-424e-a884-deac95cd3289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:30.567187 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34be917-22dc-424e-a884-deac95cd3289 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:30.581907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-c34be917-22dc-424e-a884-deac95cd3289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:30.581907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:30.581907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:30.581907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:30.581907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:30.581907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:30.581907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:30.581907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:30.581907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:30.581907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:30.581907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:30.581907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:30.581907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:26:30.581907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:26:30.581907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:26:30.583027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:26:30.583027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:30.583027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:30.583027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:30.583027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:30.583027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:30.583027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:30.583027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:30.583027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:30.583027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:30.583027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:30.583027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:30.583027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:30.583027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:30.583027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:30.583027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:30.583027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:30.584106 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:26:30.584106 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:26:30.584106 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:30.584106 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:30.584106 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 543/1094] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:30.588765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34be917-22dc-424e-a884-deac95cd3289 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:30.634457 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8b656-5064-48d2-8806-dab0bdda78ac None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:30.672111 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9609d-89c3-4dc0-abe9-f86fa408fae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:30.672748 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9609d-89c3-4dc0-abe9-f86fa408fae8 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:30.673032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9609d-89c3-4dc0-abe9-f86fa408fae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:30.673307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9609d-89c3-4dc0-abe9-f86fa408fae8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:30.680719 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:30.696008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34be917-22dc-424e-a884-deac95cd3289 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:30.730568 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c4d1b-c52f-4fac-8e4e-1c18a6223967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:30.734194 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c4d1b-c52f-4fac-8e4e-1c18a6223967 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:30.734194 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c4d1b-c52f-4fac-8e4e-1c18a6223967 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:30.734194 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c4d1b-c52f-4fac-8e4e-1c18a6223967 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:30.734194 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c4d1b-c52f-4fac-8e4e-1c18a6223967 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:30.734194 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c4d1b-c52f-4fac-8e4e-1c18a6223967 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:30.734194 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c4d1b-c52f-4fac-8e4e-1c18a6223967 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:30.742822 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9609d-89c3-4dc0-abe9-f86fa408fae8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:30.744427 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9609d-89c3-4dc0-abe9-f86fa408fae8 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:30.751646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 544/1095] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:30.752670 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c4d1b-c52f-4fac-8e4e-1c18a6223967 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:30.764469 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:30.848908 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 552/1096] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:26:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 18:26:30.853355 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c4d1b-c52f-4fac-8e4e-1c18a6223967 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:30.854843 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9609d-89c3-4dc0-abe9-f86fa408fae8 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:30.890506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffaa1a4-d821-4182-bd3a-af83614c3336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:30.891159 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffaa1a4-d821-4182-bd3a-af83614c3336 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:30.891475 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffaa1a4-d821-4182-bd3a-af83614c3336 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:30.891749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffaa1a4-d821-4182-bd3a-af83614c3336 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:30.899341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffaa1a4-d821-4182-bd3a-af83614c3336 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:30.900808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffaa1a4-d821-4182-bd3a-af83614c3336 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:30.913010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-2ffaa1a4-d821-4182-bd3a-af83614c3336 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:26:30.913010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:30.913010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:30.913010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:30.913010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:30.913010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:30.913010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:30.913010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:30.913010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:30.913010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:30.913010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:30.913010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:30.913010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:26:30.913010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:26:30.913010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:26:30.913010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:26:30.914060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:30.914060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:30.914060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:26:30.914060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:26:30.914060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:26:30.914060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:26:30.914060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:30.914060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:30.914060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:30.914060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:30.914060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:30.914060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:30.914060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:30.914060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:30.914060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:30.914060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:30.914060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:30.914060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:30.915564 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:30.915564 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:30.915564 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:26:30.915564 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:26:30.915564 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:26:30.915564 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:26:30.915564 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:26:30.915564 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:26:30.915564 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:26:30.915564 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:30.915564 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 545/1097] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 18:26:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:30.920303 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffaa1a4-d821-4182-bd3a-af83614c3336 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:30.929283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:30.961103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9609d-89c3-4dc0-abe9-f86fa408fae8 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:30.979781 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:30.999963 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f05622-cb4e-4570-8389-ed2d23c97c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:31.000790 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05622-cb4e-4570-8389-ed2d23c97c93 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:31.001082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05622-cb4e-4570-8389-ed2d23c97c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:31.001349 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05622-cb4e-4570-8389-ed2d23c97c93 None admin] PATH_INFO: `/v3/projects/24c42c1b704a471a9b6b21cd9509ee9a` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:31.002536 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f05622-cb4e-4570-8389-ed2d23c97c93 None admin] RBAC: Authorizing `identity:get_project(project_id=24c42c1b704a471a9b6b21cd9509ee9a)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:31.004097 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f05622-cb4e-4570-8389-ed2d23c97c93 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:31.005914 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 553/1098] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:26:30 2022] GET /identity/v3/projects/24c42c1b704a471a9b6b21cd9509ee9a => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:31.012073 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f05622-cb4e-4570-8389-ed2d23c97c93 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:31.027547 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffaa1a4-d821-4182-bd3a-af83614c3336 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:31.062045 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd02ba-9c32-4888-947e-36313dfba585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:31.062667 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd02ba-9c32-4888-947e-36313dfba585 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:31.062962 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd02ba-9c32-4888-947e-36313dfba585 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:31.063218 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd02ba-9c32-4888-947e-36313dfba585 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:31.064040 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd02ba-9c32-4888-947e-36313dfba585 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:31.064343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd02ba-9c32-4888-947e-36313dfba585 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:31.065771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd02ba-9c32-4888-947e-36313dfba585 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:31.086776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 546/1099] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 18:26:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:31.093440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd02ba-9c32-4888-947e-36313dfba585 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:31.121655 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f05622-cb4e-4570-8389-ed2d23c97c93 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:31.157644 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030fc59-40e9-4d1c-aedd-2a273bf3ccd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:31.158270 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030fc59-40e9-4d1c-aedd-2a273bf3ccd8 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:31.158405 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:31.158531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030fc59-40e9-4d1c-aedd-2a273bf3ccd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:31.158805 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030fc59-40e9-4d1c-aedd-2a273bf3ccd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:31.159628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030fc59-40e9-4d1c-aedd-2a273bf3ccd8 None admin] RBAC: Adding query filter params (role.id=4ae8d11d74f14bcc80117d897ba2f5b6, scope.project.id=24c42c1b704a471a9b6b21cd9509ee9a, user.id=95fcc1cfe432415296a52df204e87d18) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:31.159935 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030fc59-40e9-4d1c-aedd-2a273bf3ccd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:31.161368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030fc59-40e9-4d1c-aedd-2a273bf3ccd8 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:31.167210 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 554/1100] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:26:31 2022] GET /identity/v3/role_assignments?user.id=95fcc1cfe432415296a52df204e87d18&scope.project.id=24c42c1b704a471a9b6b21cd9509ee9a&role.id=4ae8d11d74f14bcc80117d897ba2f5b6 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:31.199755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd02ba-9c32-4888-947e-36313dfba585 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:31.240615 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07112695-2b62-4a72-838f-f34a8fd1b3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:31.241150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07112695-2b62-4a72-838f-f34a8fd1b3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:31.241434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07112695-2b62-4a72-838f-f34a8fd1b3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:31.241711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07112695-2b62-4a72-838f-f34a8fd1b3a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:31.316166 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07112695-2b62-4a72-838f-f34a8fd1b3a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:31.317630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07112695-2b62-4a72-838f-f34a8fd1b3a5 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:31.379679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:31.418886 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 547/1101] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:26:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:26:31.425400 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030fc59-40e9-4d1c-aedd-2a273bf3ccd8 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:31.476246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:31.527786 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030fc59-40e9-4d1c-aedd-2a273bf3ccd8 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:31.568437 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acd817-9902-44f8-9d82-bbb77655f267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:31.569252 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acd817-9902-44f8-9d82-bbb77655f267 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:31.569379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acd817-9902-44f8-9d82-bbb77655f267 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:31.569628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acd817-9902-44f8-9d82-bbb77655f267 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:31.581030 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acd817-9902-44f8-9d82-bbb77655f267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:31.582318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acd817-9902-44f8-9d82-bbb77655f267 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:31.596406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-95acd817-9902-44f8-9d82-bbb77655f267 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:31.596406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:31.596406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:31.596406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:31.596406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:31.596406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:31.596406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:31.596406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:31.596406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:31.596406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:31.596406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:31.596406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:31.596406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:26:31.596406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:26:31.596406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:26:31.597521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:26:31.597521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:31.597521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:31.597521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:31.597521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:31.597521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:31.597521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:31.597521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:31.597521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:31.597521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:31.597521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:31.597521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:31.597521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:31.597521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:31.597521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:31.597521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:31.597521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:31.598543 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:26:31.598543 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:26:31.598543 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:26:31.598543 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:31.598543 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 555/1102] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:26:31.603316 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07112695-2b62-4a72-838f-f34a8fd1b3a5 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:31.706685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07112695-2b62-4a72-838f-f34a8fd1b3a5 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:31.740507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df92486-fe9f-4655-bc52-0b91c85dda3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:31.741122 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df92486-fe9f-4655-bc52-0b91c85dda3b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:31.741403 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df92486-fe9f-4655-bc52-0b91c85dda3b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:31.741676 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df92486-fe9f-4655-bc52-0b91c85dda3b None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:31.742363 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df92486-fe9f-4655-bc52-0b91c85dda3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:31.742666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df92486-fe9f-4655-bc52-0b91c85dda3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:31.744319 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df92486-fe9f-4655-bc52-0b91c85dda3b None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:31.756405 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 548/1103] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:31.762059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acd817-9902-44f8-9d82-bbb77655f267 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:31.863902 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acd817-9902-44f8-9d82-bbb77655f267 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:31.865376 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:31.903154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814fca1-305b-4f44-9461-fa2555a66282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:31.903857 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814fca1-305b-4f44-9461-fa2555a66282 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:31.907074 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814fca1-305b-4f44-9461-fa2555a66282 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:31.907074 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814fca1-305b-4f44-9461-fa2555a66282 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:31.926095 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814fca1-305b-4f44-9461-fa2555a66282 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:31.927615 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814fca1-305b-4f44-9461-fa2555a66282 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:31.939580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-1814fca1-305b-4f44-9461-fa2555a66282 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:26:31.939580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:31.939580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:31.939580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:31.939580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:31.939580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:31.939580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:31.939580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:31.939580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:31.939580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:31.939580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:31.939580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:31.939580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:26:31.939580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:26:31.939580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:26:31.940720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:26:31.940720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:31.940720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:31.940720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:31.940720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:31.940720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:31.940720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:31.940720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:31.940720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:31.940720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:31.940720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:31.940720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:31.940720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:31.940720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:31.940720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:31.940720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:31.940720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:31.941624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:26:31.941624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:26:31.941624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:26:31.941624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:26:31.941624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:26:31.941624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:26:31.941624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:26:31.941624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:31.941624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 556/1104] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:26:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:31.946695 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df92486-fe9f-4655-bc52-0b91c85dda3b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:31.973464 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:32.047466 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df92486-fe9f-4655-bc52-0b91c85dda3b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:32.080547 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc2591-094b-4da3-a971-9f156a49b953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:32.081167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc2591-094b-4da3-a971-9f156a49b953 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:32.081446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc2591-094b-4da3-a971-9f156a49b953 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:32.081722 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc2591-094b-4da3-a971-9f156a49b953 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:32.082476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc2591-094b-4da3-a971-9f156a49b953 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:32.082788 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc2591-094b-4da3-a971-9f156a49b953 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:32.084258 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc2591-094b-4da3-a971-9f156a49b953 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:32.097590 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 549/1105] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:26:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:32.103560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814fca1-305b-4f44-9461-fa2555a66282 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:32.202962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814fca1-305b-4f44-9461-fa2555a66282 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:32.236872 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553ac68-ef31-4bda-8bf1-4e063c860afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:32.237494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553ac68-ef31-4bda-8bf1-4e063c860afa None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:32.237782 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553ac68-ef31-4bda-8bf1-4e063c860afa None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:32.238061 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553ac68-ef31-4bda-8bf1-4e063c860afa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:32.238856 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553ac68-ef31-4bda-8bf1-4e063c860afa None admin] RBAC: Adding query filter params (role.id=a4fdca42d75d42b884608b1880bd969c, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=be769d4dd016466f9174e7d5e47a2a0d) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:32.239172 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553ac68-ef31-4bda-8bf1-4e063c860afa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:32.240645 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553ac68-ef31-4bda-8bf1-4e063c860afa None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:32.246886 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 557/1106] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:26:32 2022] GET /identity/v3/role_assignments?user.id=be769d4dd016466f9174e7d5e47a2a0d&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=a4fdca42d75d42b884608b1880bd969c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:33.254841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ec860-3dc2-4401-ba41-d9164d91da0e None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:33.255433 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ec860-3dc2-4401-ba41-d9164d91da0e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:33.255433 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ec860-3dc2-4401-ba41-d9164d91da0e None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:33.256805 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 550/1107] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:33.261833 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677027d-7e87-4811-bb9f-7c37e537ab31 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:33.262246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677027d-7e87-4811-bb9f-7c37e537ab31 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:33.262392 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677027d-7e87-4811-bb9f-7c37e537ab31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:33.281079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-1677027d-7e87-4811-bb9f-7c37e537ab31 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:33.282295 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-1677027d-7e87-4811-bb9f-7c37e537ab31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:33.303205 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:33.350367 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 558/1108] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:33.375520 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ec860-3dc2-4401-ba41-d9164d91da0e None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:33.462780 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:33.480218 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ec860-3dc2-4401-ba41-d9164d91da0e None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:33.514930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7424a-bfe1-440b-a422-11310163884d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:33.515512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7424a-bfe1-440b-a422-11310163884d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:33.515792 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7424a-bfe1-440b-a422-11310163884d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:33.516062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7424a-bfe1-440b-a422-11310163884d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:33.517192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7424a-bfe1-440b-a422-11310163884d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:33.518629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7424a-bfe1-440b-a422-11310163884d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:33.520285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 551/1109] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:33.526150 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677027d-7e87-4811-bb9f-7c37e537ab31 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:33.631182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677027d-7e87-4811-bb9f-7c37e537ab31 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:33.665424 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86997d08-0952-4b25-a984-2c444f50d317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:33.666043 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86997d08-0952-4b25-a984-2c444f50d317 None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:33.666328 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86997d08-0952-4b25-a984-2c444f50d317 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:33.666607 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86997d08-0952-4b25-a984-2c444f50d317 None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:33.667308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86997d08-0952-4b25-a984-2c444f50d317 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:33.668754 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86997d08-0952-4b25-a984-2c444f50d317 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:33.775720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 559/1110] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 18:26:33 2022] POST /identity/v3/users => generated 286 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:35.854081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e60b8-5631-48d2-9fc2-0ece2f99cf79 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:35.854873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e60b8-5631-48d2-9fc2-0ece2f99cf79 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:35.854873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e60b8-5631-48d2-9fc2-0ece2f99cf79 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:35.856453 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 552/1111] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:35.862792 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bb1ef-4330-49f8-a4b6-92d832f449da None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:35.863209 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bb1ef-4330-49f8-a4b6-92d832f449da None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:35.863383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bb1ef-4330-49f8-a4b6-92d832f449da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:35.882193 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-db6bb1ef-4330-49f8-a4b6-92d832f449da None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:35.883431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-db6bb1ef-4330-49f8-a4b6-92d832f449da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:35.890795 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:35.950590 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 560/1112] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:35.974764 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e60b8-5631-48d2-9fc2-0ece2f99cf79 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:36.075055 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e60b8-5631-48d2-9fc2-0ece2f99cf79 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:36.108631 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c75bc-df68-44c7-bdb3-76aa6e5a226f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:36.109193 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c75bc-df68-44c7-bdb3-76aa6e5a226f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:36.109473 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c75bc-df68-44c7-bdb3-76aa6e5a226f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:36.109748 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c75bc-df68-44c7-bdb3-76aa6e5a226f None admin] PATH_INFO: `/v3/roles/dd7069600e364802831ce7c375e57fcd` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:36.111200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c75bc-df68-44c7-bdb3-76aa6e5a226f None admin] RBAC: Authorizing `identity:get_role(role_id=dd7069600e364802831ce7c375e57fcd)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:36.112605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c75bc-df68-44c7-bdb3-76aa6e5a226f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:36.113956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 553/1113] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:26:35 2022] GET /identity/v3/roles/dd7069600e364802831ce7c375e57fcd => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:36.119908 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bb1ef-4330-49f8-a4b6-92d832f449da None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:36.217139 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bb1ef-4330-49f8-a4b6-92d832f449da None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:36.250352 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93acef8-4771-457f-929d-af2757d03e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:36.250999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93acef8-4771-457f-929d-af2757d03e71 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:36.251309 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93acef8-4771-457f-929d-af2757d03e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:36.251593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93acef8-4771-457f-929d-af2757d03e71 None admin] PATH_INFO: `/v3/users/f68f3289754040068897e35ddb914b73` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:36.262417 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:36.265273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93acef8-4771-457f-929d-af2757d03e71 None admin] RBAC: Authorizing `identity:get_user(user_id=f68f3289754040068897e35ddb914b73)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:36.266737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93acef8-4771-457f-929d-af2757d03e71 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:36.268417 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 561/1114] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:26:36 2022] GET /identity/v3/users/f68f3289754040068897e35ddb914b73 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:36.274428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c75bc-df68-44c7-bdb3-76aa6e5a226f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:36.297844 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:36.375893 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c75bc-df68-44c7-bdb3-76aa6e5a226f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:36.410203 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34f773-752d-4a72-acd6-4eecf8aead58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:36.410829 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34f773-752d-4a72-acd6-4eecf8aead58 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:36.411110 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34f773-752d-4a72-acd6-4eecf8aead58 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:36.411420 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34f773-752d-4a72-acd6-4eecf8aead58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:36.479916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34f773-752d-4a72-acd6-4eecf8aead58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:36.481381 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34f773-752d-4a72-acd6-4eecf8aead58 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:36.506058 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:36.586174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 554/1115] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:26:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:26:36.592367 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93acef8-4771-457f-929d-af2757d03e71 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:36.690549 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93acef8-4771-457f-929d-af2757d03e71 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:36.724492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17ae57-79a3-49fb-801d-dd175f572600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:36.725131 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17ae57-79a3-49fb-801d-dd175f572600 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:36.725416 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17ae57-79a3-49fb-801d-dd175f572600 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:36.725694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17ae57-79a3-49fb-801d-dd175f572600 None admin] PATH_INFO: `/v3/projects/24c42c1b704a471a9b6b21cd9509ee9a` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:36.726859 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17ae57-79a3-49fb-801d-dd175f572600 None admin] RBAC: Authorizing `identity:get_project(project_id=24c42c1b704a471a9b6b21cd9509ee9a)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:36.728337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17ae57-79a3-49fb-801d-dd175f572600 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:36.729995 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 562/1116] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:26:36 2022] GET /identity/v3/projects/24c42c1b704a471a9b6b21cd9509ee9a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:36.740371 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34f773-752d-4a72-acd6-4eecf8aead58 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:36.848110 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34f773-752d-4a72-acd6-4eecf8aead58 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:36.868145 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:36.881641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e1500-55d5-42c9-a28d-f04704db928d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:36.882251 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e1500-55d5-42c9-a28d-f04704db928d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:36.882527 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e1500-55d5-42c9-a28d-f04704db928d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:36.882797 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e1500-55d5-42c9-a28d-f04704db928d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:36.883649 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e1500-55d5-42c9-a28d-f04704db928d None admin] RBAC: Adding query filter params (role.id=dd7069600e364802831ce7c375e57fcd, scope.project.id=24c42c1b704a471a9b6b21cd9509ee9a, user.id=f68f3289754040068897e35ddb914b73) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:36.883956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e1500-55d5-42c9-a28d-f04704db928d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:36.885373 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e1500-55d5-42c9-a28d-f04704db928d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:36.890663 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 555/1117] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:26:36 2022] GET /identity/v3/role_assignments?user.id=f68f3289754040068897e35ddb914b73&scope.project.id=24c42c1b704a471a9b6b21cd9509ee9a&role.id=dd7069600e364802831ce7c375e57fcd => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:38.879918 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd3ecc-8893-4eb7-947f-1ab9ca3251af None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:38.880444 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd3ecc-8893-4eb7-947f-1ab9ca3251af None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:38.880444 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd3ecc-8893-4eb7-947f-1ab9ca3251af None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:38.881746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 563/1118] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:38.886923 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fc83c-6431-4386-b299-6ee86ae841c1 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:38.887334 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fc83c-6431-4386-b299-6ee86ae841c1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:38.887497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fc83c-6431-4386-b299-6ee86ae841c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:38.906220 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0c8fc83c-6431-4386-b299-6ee86ae841c1 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:38.907430 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0c8fc83c-6431-4386-b299-6ee86ae841c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:38.973428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 556/1119] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:38.995866 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd3ecc-8893-4eb7-947f-1ab9ca3251af None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:39.063831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:39.097904 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd3ecc-8893-4eb7-947f-1ab9ca3251af None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:39.131715 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebacba7-0b4a-4ac7-b583-2ee2e3af51bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:39.132355 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebacba7-0b4a-4ac7-b583-2ee2e3af51bc None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:39.132640 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebacba7-0b4a-4ac7-b583-2ee2e3af51bc None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:39.132922 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebacba7-0b4a-4ac7-b583-2ee2e3af51bc None admin] PATH_INFO: `/v3/roles/dd7069600e364802831ce7c375e57fcd` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:39.134367 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebacba7-0b4a-4ac7-b583-2ee2e3af51bc None admin] RBAC: Authorizing `identity:get_role(role_id=dd7069600e364802831ce7c375e57fcd)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:39.135797 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebacba7-0b4a-4ac7-b583-2ee2e3af51bc None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:39.137154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 564/1120] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:26:38 2022] GET /identity/v3/roles/dd7069600e364802831ce7c375e57fcd => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:39.143378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fc83c-6431-4386-b299-6ee86ae841c1 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:39.239391 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fc83c-6431-4386-b299-6ee86ae841c1 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:39.253985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:39.273581 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd886d32-1b26-4e8a-9bc5-aca6ec9c70c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:39.274204 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd886d32-1b26-4e8a-9bc5-aca6ec9c70c9 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:39.274482 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd886d32-1b26-4e8a-9bc5-aca6ec9c70c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:39.274756 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd886d32-1b26-4e8a-9bc5-aca6ec9c70c9 None admin] PATH_INFO: `/v3/users/f68f3289754040068897e35ddb914b73` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:39.276366 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd886d32-1b26-4e8a-9bc5-aca6ec9c70c9 None admin] RBAC: Authorizing `identity:get_user(user_id=f68f3289754040068897e35ddb914b73)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:39.277400 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd886d32-1b26-4e8a-9bc5-aca6ec9c70c9 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:39.279043 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 557/1121] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:26:39 2022] GET /identity/v3/users/f68f3289754040068897e35ddb914b73 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:39.285088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebacba7-0b4a-4ac7-b583-2ee2e3af51bc None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:39.385422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebacba7-0b4a-4ac7-b583-2ee2e3af51bc None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:39.420127 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202159c3-a800-4fc1-91b8-fe0cfcb7bbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:39.420963 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202159c3-a800-4fc1-91b8-fe0cfcb7bbd5 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:39.421248 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202159c3-a800-4fc1-91b8-fe0cfcb7bbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:39.421530 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202159c3-a800-4fc1-91b8-fe0cfcb7bbd5 None admin] PATH_INFO: `/v3/projects/24c42c1b704a471a9b6b21cd9509ee9a` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:39.422711 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202159c3-a800-4fc1-91b8-fe0cfcb7bbd5 None admin] RBAC: Authorizing `identity:get_project(project_id=24c42c1b704a471a9b6b21cd9509ee9a)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:39.424198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202159c3-a800-4fc1-91b8-fe0cfcb7bbd5 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:39.425867 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 565/1122] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:26:39 2022] GET /identity/v3/projects/24c42c1b704a471a9b6b21cd9509ee9a => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:39.431970 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd886d32-1b26-4e8a-9bc5-aca6ec9c70c9 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:39.531936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd886d32-1b26-4e8a-9bc5-aca6ec9c70c9 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:39.565979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68231db-226f-47f0-abf7-aef1f5b1fce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:39.566650 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68231db-226f-47f0-abf7-aef1f5b1fce2 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:39.566934 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68231db-226f-47f0-abf7-aef1f5b1fce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:39.567213 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68231db-226f-47f0-abf7-aef1f5b1fce2 None admin] PATH_INFO: `/v3/projects/24c42c1b704a471a9b6b21cd9509ee9a/users/f68f3289754040068897e35ddb914b73/roles/dd7069600e364802831ce7c375e57fcd` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:39.569419 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68231db-226f-47f0-abf7-aef1f5b1fce2 None admin] RBAC: Authorizing `identity:create_grant(project_id=24c42c1b704a471a9b6b21cd9509ee9a, user_id=f68f3289754040068897e35ddb914b73, role_id=dd7069600e364802831ce7c375e57fcd)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:39.570866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68231db-226f-47f0-abf7-aef1f5b1fce2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:39.725004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 558/1123] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:26:39 2022] PUT /identity/v3/projects/24c42c1b704a471a9b6b21cd9509ee9a/users/f68f3289754040068897e35ddb914b73/roles/dd7069600e364802831ce7c375e57fcd => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:41.767452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539dd7d-7cef-4e45-9ec6-4c71b9d9600a None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:41.768015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539dd7d-7cef-4e45-9ec6-4c71b9d9600a None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:41.768015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539dd7d-7cef-4e45-9ec6-4c71b9d9600a None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:41.769342 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 566/1124] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:41.774649 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b0968-62bb-46a1-9d0b-72016717c8e6 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:41.775085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b0968-62bb-46a1-9d0b-72016717c8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:41.775202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b0968-62bb-46a1-9d0b-72016717c8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:41.793108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-6c1b0968-62bb-46a1-9d0b-72016717c8e6 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:41.794831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6c1b0968-62bb-46a1-9d0b-72016717c8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:41.830604 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:41.862378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 559/1125] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:41.886160 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539dd7d-7cef-4e45-9ec6-4c71b9d9600a None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:41.889999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:41.992670 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539dd7d-7cef-4e45-9ec6-4c71b9d9600a None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:42.026373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52266e-46ed-4fa1-bcff-8de6fe88def1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:42.027013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52266e-46ed-4fa1-bcff-8de6fe88def1 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:42.027321 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52266e-46ed-4fa1-bcff-8de6fe88def1 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:42.027603 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52266e-46ed-4fa1-bcff-8de6fe88def1 None admin] PATH_INFO: `/v3/roles/dd7069600e364802831ce7c375e57fcd` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:42.029737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52266e-46ed-4fa1-bcff-8de6fe88def1 None admin] RBAC: Authorizing `identity:get_role(role_id=dd7069600e364802831ce7c375e57fcd)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:42.032787 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52266e-46ed-4fa1-bcff-8de6fe88def1 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:42.036704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 567/1126] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:26:41 2022] GET /identity/v3/roles/dd7069600e364802831ce7c375e57fcd => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:42.043022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b0968-62bb-46a1-9d0b-72016717c8e6 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:42.143809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b0968-62bb-46a1-9d0b-72016717c8e6 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:42.178702 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68d4b2-b4ec-4315-993c-1730cedac0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:42.179357 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68d4b2-b4ec-4315-993c-1730cedac0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:42.179635 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68d4b2-b4ec-4315-993c-1730cedac0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:42.179904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68d4b2-b4ec-4315-993c-1730cedac0e5 None admin] PATH_INFO: `/v3/users/f68f3289754040068897e35ddb914b73` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:42.181056 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68d4b2-b4ec-4315-993c-1730cedac0e5 None admin] RBAC: Authorizing `identity:get_user(user_id=f68f3289754040068897e35ddb914b73)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:42.182493 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68d4b2-b4ec-4315-993c-1730cedac0e5 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:42.184121 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 560/1127] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:26:42 2022] GET /identity/v3/users/f68f3289754040068897e35ddb914b73 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:42.191007 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52266e-46ed-4fa1-bcff-8de6fe88def1 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:42.261617 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:42.290984 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52266e-46ed-4fa1-bcff-8de6fe88def1 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:42.325137 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f65973-4da8-43e6-9ab2-6503518982d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:42.325752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f65973-4da8-43e6-9ab2-6503518982d0 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:42.326587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f65973-4da8-43e6-9ab2-6503518982d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:42.326868 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f65973-4da8-43e6-9ab2-6503518982d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:42.393335 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f65973-4da8-43e6-9ab2-6503518982d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:42.394855 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f65973-4da8-43e6-9ab2-6503518982d0 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:42.462301 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:42.491682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 568/1128] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:26:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:26:42.498313 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68d4b2-b4ec-4315-993c-1730cedac0e5 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:42.544971 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:42.604421 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68d4b2-b4ec-4315-993c-1730cedac0e5 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:42.637679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02cfb4-ad13-4275-8c00-0a9ceb84c92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:42.639044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02cfb4-ad13-4275-8c00-0a9ceb84c92c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:42.639356 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02cfb4-ad13-4275-8c00-0a9ceb84c92c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:42.639636 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02cfb4-ad13-4275-8c00-0a9ceb84c92c None admin] PATH_INFO: `/v3/projects/24c42c1b704a471a9b6b21cd9509ee9a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:42.640804 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02cfb4-ad13-4275-8c00-0a9ceb84c92c None admin] RBAC: Authorizing `identity:get_project(project_id=24c42c1b704a471a9b6b21cd9509ee9a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:42.642243 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02cfb4-ad13-4275-8c00-0a9ceb84c92c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:42.643958 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 561/1129] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:26:42 2022] GET /identity/v3/projects/24c42c1b704a471a9b6b21cd9509ee9a => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:42.650273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f65973-4da8-43e6-9ab2-6503518982d0 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:42.767971 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f65973-4da8-43e6-9ab2-6503518982d0 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:42.809331 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cc0b1-87e6-44dc-8325-48be3c069278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:42.810774 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cc0b1-87e6-44dc-8325-48be3c069278 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:42.811256 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cc0b1-87e6-44dc-8325-48be3c069278 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:42.811798 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cc0b1-87e6-44dc-8325-48be3c069278 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:42.812867 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cc0b1-87e6-44dc-8325-48be3c069278 None admin] RBAC: Adding query filter params (role.id=dd7069600e364802831ce7c375e57fcd, scope.project.id=24c42c1b704a471a9b6b21cd9509ee9a, user.id=f68f3289754040068897e35ddb914b73) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:42.813188 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cc0b1-87e6-44dc-8325-48be3c069278 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:42.814911 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cc0b1-87e6-44dc-8325-48be3c069278 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:42.822060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 569/1130] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:26:42 2022] GET /identity/v3/role_assignments?user.id=f68f3289754040068897e35ddb914b73&scope.project.id=24c42c1b704a471a9b6b21cd9509ee9a&role.id=dd7069600e364802831ce7c375e57fcd => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:44.859686 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724972a-e734-4083-a34b-fa07a3728792 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:44.860300 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724972a-e734-4083-a34b-fa07a3728792 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:44.860300 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724972a-e734-4083-a34b-fa07a3728792 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:44.861509 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 562/1131] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:44.866635 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a18991-3841-4f00-a1b3-5dc4db9f6b91 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:44.867067 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a18991-3841-4f00-a1b3-5dc4db9f6b91 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:44.867175 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a18991-3841-4f00-a1b3-5dc4db9f6b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:44.885871 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-c5a18991-3841-4f00-a1b3-5dc4db9f6b91 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:44.887058 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c5a18991-3841-4f00-a1b3-5dc4db9f6b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:44.918112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:44.956263 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 570/1132] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:44.980084 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724972a-e734-4083-a34b-fa07a3728792 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:45.080400 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724972a-e734-4083-a34b-fa07a3728792 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:45.089542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:45.114476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaac533-8be2-4496-b554-a988b8b04afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:45.115019 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaac533-8be2-4496-b554-a988b8b04afc None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:45.115329 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaac533-8be2-4496-b554-a988b8b04afc None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:45.115605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaac533-8be2-4496-b554-a988b8b04afc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:45.116747 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaac533-8be2-4496-b554-a988b8b04afc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:45.118183 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaac533-8be2-4496-b554-a988b8b04afc None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:45.119823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 563/1133] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:45.126691 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a18991-3841-4f00-a1b3-5dc4db9f6b91 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:45.223723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a18991-3841-4f00-a1b3-5dc4db9f6b91 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:45.258442 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4269a4-90a0-4f25-a1a3-4ff7646589b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:45.259064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4269a4-90a0-4f25-a1a3-4ff7646589b9 None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:45.259381 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4269a4-90a0-4f25-a1a3-4ff7646589b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:45.259662 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4269a4-90a0-4f25-a1a3-4ff7646589b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:45.260364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4269a4-90a0-4f25-a1a3-4ff7646589b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:45.261827 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4269a4-90a0-4f25-a1a3-4ff7646589b9 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:45.378090 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 571/1134] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 18:26:45 2022] POST /identity/v3/projects => generated 311 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:47.415047 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707801b5-e390-4b95-b113-83b07b17ed58 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:47.415741 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707801b5-e390-4b95-b113-83b07b17ed58 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:47.415741 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707801b5-e390-4b95-b113-83b07b17ed58 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:47.417009 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 564/1135] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:47.422599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cced49-062b-4ee0-afd8-2970b6923e45 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:47.423114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cced49-062b-4ee0-afd8-2970b6923e45 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:47.423234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cced49-062b-4ee0-afd8-2970b6923e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:47.442147 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-c4cced49-062b-4ee0-afd8-2970b6923e45 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:47.443376 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c4cced49-062b-4ee0-afd8-2970b6923e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:47.457738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:47.514309 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 572/1136] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:47.538375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707801b5-e390-4b95-b113-83b07b17ed58 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:47.642258 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707801b5-e390-4b95-b113-83b07b17ed58 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:47.677832 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e078978-2e07-4d17-9caa-cc074417d160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:47.678402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e078978-2e07-4d17-9caa-cc074417d160 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:47.678684 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e078978-2e07-4d17-9caa-cc074417d160 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:47.678958 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e078978-2e07-4d17-9caa-cc074417d160 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:47.680159 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e078978-2e07-4d17-9caa-cc074417d160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:47.681597 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e078978-2e07-4d17-9caa-cc074417d160 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:47.683238 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 565/1137] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:26:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:47.689848 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cced49-062b-4ee0-afd8-2970b6923e45 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:47.791487 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cced49-062b-4ee0-afd8-2970b6923e45 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:47.826913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536884ab-6b5b-4160-87b2-61a97117d3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:47.827551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536884ab-6b5b-4160-87b2-61a97117d3c3 None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:47.827834 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536884ab-6b5b-4160-87b2-61a97117d3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:47.828110 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536884ab-6b5b-4160-87b2-61a97117d3c3 None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:47.828803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536884ab-6b5b-4160-87b2-61a97117d3c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:47.830245 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536884ab-6b5b-4160-87b2-61a97117d3c3 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:47.981894 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 573/1138] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 18:26:47 2022] POST /identity/v3/users => generated 286 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:50.032846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d3463-7721-4301-a15a-8a727f647fc5 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:50.033386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d3463-7721-4301-a15a-8a727f647fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:50.033386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d3463-7721-4301-a15a-8a727f647fc5 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:50.034762 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 566/1139] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:50.040024 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea42a4-3726-4566-83d4-25356b090674 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:50.040485 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea42a4-3726-4566-83d4-25356b090674 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:50.040581 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea42a4-3726-4566-83d4-25356b090674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:50.048362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:50.060761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-7bea42a4-3726-4566-83d4-25356b090674 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:50.062237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-7bea42a4-3726-4566-83d4-25356b090674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:50.132804 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 574/1140] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:50.156140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d3463-7721-4301-a15a-8a727f647fc5 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:50.204660 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:50.259369 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d3463-7721-4301-a15a-8a727f647fc5 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:50.293512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26872c00-e78c-4a2b-93eb-43bf34f3de65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:50.294140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26872c00-e78c-4a2b-93eb-43bf34f3de65 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:50.295129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26872c00-e78c-4a2b-93eb-43bf34f3de65 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:50.295501 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26872c00-e78c-4a2b-93eb-43bf34f3de65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:50.306422 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26872c00-e78c-4a2b-93eb-43bf34f3de65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:26:50.312177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-26872c00-e78c-4a2b-93eb-43bf34f3de65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:26:50.312177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:50.312177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:50.312177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:50.312177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:50.312177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:50.312177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:50.312177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:50.312177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:50.312177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:50.312177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:50.312177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:50.312177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:26:50.312177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:26:50.312177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:26:50.312177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:26:50.313307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:26:50.313307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:26:50.313307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:26:50.313307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:26:50.313307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:50.313307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:50.313307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:50.313307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:50.313307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:50.313307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:50.313307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:50.313307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:50.313307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:50.313307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:50.313307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:50.313307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:50.314351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:50.314351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:50.314351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:50.314351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:50.314351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:26:50.314351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:26:50.314351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:26:50.314351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:26:50.314351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:26:50.314351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:26:50.314351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:26:50.314351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:50.314351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 567/1141] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:26:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:50.319747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea42a4-3726-4566-83d4-25356b090674 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:50.421873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea42a4-3726-4566-83d4-25356b090674 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:50.456057 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9bf9d7-e404-4c80-88f5-65ed53fe938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:50.456680 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bf9d7-e404-4c80-88f5-65ed53fe938b None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:50.456956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bf9d7-e404-4c80-88f5-65ed53fe938b None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:50.457334 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bf9d7-e404-4c80-88f5-65ed53fe938b None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:50.458053 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9bf9d7-e404-4c80-88f5-65ed53fe938b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:50.458352 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9bf9d7-e404-4c80-88f5-65ed53fe938b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:50.459793 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9bf9d7-e404-4c80-88f5-65ed53fe938b None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:50.461141 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:50.468895 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 575/1142] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:26:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:50.474698 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26872c00-e78c-4a2b-93eb-43bf34f3de65 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:50.577732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26872c00-e78c-4a2b-93eb-43bf34f3de65 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:50.580219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:50.611983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38369e-3da6-4cf7-a7ef-23e3c84b15eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:50.612642 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38369e-3da6-4cf7-a7ef-23e3c84b15eb None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:50.612932 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38369e-3da6-4cf7-a7ef-23e3c84b15eb None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:50.613213 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38369e-3da6-4cf7-a7ef-23e3c84b15eb None admin] PATH_INFO: `/v3/users/18d5949afcac4d5cb3e8f841d8e33980` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:50.632651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38369e-3da6-4cf7-a7ef-23e3c84b15eb None admin] RBAC: Authorizing `identity:get_user(user_id=18d5949afcac4d5cb3e8f841d8e33980)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:50.636627 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38369e-3da6-4cf7-a7ef-23e3c84b15eb None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:50.639362 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 568/1143] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:26:50 2022] GET /identity/v3/users/18d5949afcac4d5cb3e8f841d8e33980 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:50.645239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9bf9d7-e404-4c80-88f5-65ed53fe938b None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:50.743992 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9bf9d7-e404-4c80-88f5-65ed53fe938b None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:50.776729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d50e6-84ee-49e7-821a-8dec052e45e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:50.777342 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d50e6-84ee-49e7-821a-8dec052e45e6 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:50.777626 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d50e6-84ee-49e7-821a-8dec052e45e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:50.777895 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d50e6-84ee-49e7-821a-8dec052e45e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:50.837278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:50.843908 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d50e6-84ee-49e7-821a-8dec052e45e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:50.847619 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d50e6-84ee-49e7-821a-8dec052e45e6 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:50.945300 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 576/1144] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:26:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:26:50.951571 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38369e-3da6-4cf7-a7ef-23e3c84b15eb None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:51.054299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38369e-3da6-4cf7-a7ef-23e3c84b15eb None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:51.087447 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b58e82-4616-474d-99e6-30a57eb962e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:51.088016 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b58e82-4616-474d-99e6-30a57eb962e4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:51.088296 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b58e82-4616-474d-99e6-30a57eb962e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:51.088569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b58e82-4616-474d-99e6-30a57eb962e4 None admin] PATH_INFO: `/v3/projects/b28fabc898604b8ebce55e50f6a34df1` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:51.089718 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b58e82-4616-474d-99e6-30a57eb962e4 None admin] RBAC: Authorizing `identity:get_project(project_id=b28fabc898604b8ebce55e50f6a34df1)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:51.091731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b58e82-4616-474d-99e6-30a57eb962e4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:51.093409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 569/1145] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:26:50 2022] GET /identity/v3/projects/b28fabc898604b8ebce55e50f6a34df1 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:51.100085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d50e6-84ee-49e7-821a-8dec052e45e6 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:51.192915 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:51.198423 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d50e6-84ee-49e7-821a-8dec052e45e6 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:51.231164 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b61a5-34fa-47d1-829b-808aa9387731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:51.231849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b61a5-34fa-47d1-829b-808aa9387731 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:51.232397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b61a5-34fa-47d1-829b-808aa9387731 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:51.232900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b61a5-34fa-47d1-829b-808aa9387731 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:51.234048 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b61a5-34fa-47d1-829b-808aa9387731 None admin] RBAC: Adding query filter params (role.id=4ae8d11d74f14bcc80117d897ba2f5b6, scope.project.id=b28fabc898604b8ebce55e50f6a34df1, user.id=18d5949afcac4d5cb3e8f841d8e33980) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:51.234374 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b61a5-34fa-47d1-829b-808aa9387731 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:51.235903 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b61a5-34fa-47d1-829b-808aa9387731 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:51.241303 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 577/1146] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:26:51 2022] GET /identity/v3/role_assignments?user.id=18d5949afcac4d5cb3e8f841d8e33980&scope.project.id=b28fabc898604b8ebce55e50f6a34df1&role.id=4ae8d11d74f14bcc80117d897ba2f5b6 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:53.244124 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8fe5d-59ab-4c19-9a0f-e9c637b3fb27 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:53.304945 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8fe5d-59ab-4c19-9a0f-e9c637b3fb27 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:53.304945 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8fe5d-59ab-4c19-9a0f-e9c637b3fb27 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:53.304945 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 570/1147] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:53.305242 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a75c0e-8ba2-4397-be96-59f3d75d7a38 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:53.305242 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a75c0e-8ba2-4397-be96-59f3d75d7a38 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:53.305242 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a75c0e-8ba2-4397-be96-59f3d75d7a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:53.305242 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-92a75c0e-8ba2-4397-be96-59f3d75d7a38 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:53.305242 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-92a75c0e-8ba2-4397-be96-59f3d75d7a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:53.353395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 578/1148] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:53.376950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8fe5d-59ab-4c19-9a0f-e9c637b3fb27 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:53.410638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:53.486344 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8fe5d-59ab-4c19-9a0f-e9c637b3fb27 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:53.521125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a07c5a-5961-4ce4-8e51-2ebc47ea5dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:53.521691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a07c5a-5961-4ce4-8e51-2ebc47ea5dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:53.521972 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a07c5a-5961-4ce4-8e51-2ebc47ea5dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:53.522250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a07c5a-5961-4ce4-8e51-2ebc47ea5dd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:53.533027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a07c5a-5961-4ce4-8e51-2ebc47ea5dd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:26:53.538006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-62a07c5a-5961-4ce4-8e51-2ebc47ea5dd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:26:53.538006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:53.538006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:53.538006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:53.538006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:53.538006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:53.538006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:53.538006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:53.538006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:53.538006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:53.538006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:53.538006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:53.538006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:26:53.538006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:26:53.538006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:26:53.538006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:26:53.539077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:26:53.539077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:26:53.539077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:26:53.539077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:26:53.539077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:53.539077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:53.539077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:53.539077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:53.539077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:53.539077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:53.539077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:53.539077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:53.539077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:53.539077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:53.539077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:53.539077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:53.540289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:53.540289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:53.540289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:53.540289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:53.540289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:26:53.540289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:26:53.540289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:26:53.540289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:26:53.540289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:26:53.540289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:26:53.540289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:26:53.540289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:26:53.540289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 571/1149] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:26:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:53.545879 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a75c0e-8ba2-4397-be96-59f3d75d7a38 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:53.639841 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:53.650603 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a75c0e-8ba2-4397-be96-59f3d75d7a38 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:53.686913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc35b69-82ed-479e-b703-32415ff6108b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:53.687566 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc35b69-82ed-479e-b703-32415ff6108b None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:53.687852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc35b69-82ed-479e-b703-32415ff6108b None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:53.688132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc35b69-82ed-479e-b703-32415ff6108b None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:53.688849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc35b69-82ed-479e-b703-32415ff6108b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:53.689159 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc35b69-82ed-479e-b703-32415ff6108b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:53.690543 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc35b69-82ed-479e-b703-32415ff6108b None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:53.698746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 579/1150] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:26:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:53.705543 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a07c5a-5961-4ce4-8e51-2ebc47ea5dd8 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:53.797744 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:53.807354 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a07c5a-5961-4ce4-8e51-2ebc47ea5dd8 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:53.842989 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce314d-2fcb-4b78-8146-03d3112e4fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:53.843659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce314d-2fcb-4b78-8146-03d3112e4fbf None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:53.843940 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce314d-2fcb-4b78-8146-03d3112e4fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:53.844212 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce314d-2fcb-4b78-8146-03d3112e4fbf None admin] PATH_INFO: `/v3/users/18d5949afcac4d5cb3e8f841d8e33980` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:53.845382 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce314d-2fcb-4b78-8146-03d3112e4fbf None admin] RBAC: Authorizing `identity:get_user(user_id=18d5949afcac4d5cb3e8f841d8e33980)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:53.846827 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce314d-2fcb-4b78-8146-03d3112e4fbf None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:53.848486 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 572/1151] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:26:53 2022] GET /identity/v3/users/18d5949afcac4d5cb3e8f841d8e33980 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:53.854408 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc35b69-82ed-479e-b703-32415ff6108b None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:53.955755 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc35b69-82ed-479e-b703-32415ff6108b None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:53.989857 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80090750-36b3-45f3-8ce3-f438aafad2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:53.990496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80090750-36b3-45f3-8ce3-f438aafad2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:53.990776 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80090750-36b3-45f3-8ce3-f438aafad2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:53.991052 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80090750-36b3-45f3-8ce3-f438aafad2d0 None admin] PATH_INFO: `/v3/projects/b28fabc898604b8ebce55e50f6a34df1` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:53.992231 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80090750-36b3-45f3-8ce3-f438aafad2d0 None admin] RBAC: Authorizing `identity:get_project(project_id=b28fabc898604b8ebce55e50f6a34df1)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:53.993665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80090750-36b3-45f3-8ce3-f438aafad2d0 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:53.995365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 580/1152] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:26:53 2022] GET /identity/v3/projects/b28fabc898604b8ebce55e50f6a34df1 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:54.002184 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce314d-2fcb-4b78-8146-03d3112e4fbf None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:54.100760 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce314d-2fcb-4b78-8146-03d3112e4fbf None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:54.135382 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81703039-ffbc-4472-9462-d55ec29f7287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:54.136055 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81703039-ffbc-4472-9462-d55ec29f7287 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:54.136337 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81703039-ffbc-4472-9462-d55ec29f7287 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:54.136614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81703039-ffbc-4472-9462-d55ec29f7287 None admin] PATH_INFO: `/v3/projects/b28fabc898604b8ebce55e50f6a34df1/users/18d5949afcac4d5cb3e8f841d8e33980/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:54.139321 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81703039-ffbc-4472-9462-d55ec29f7287 None admin] RBAC: Authorizing `identity:create_grant(project_id=b28fabc898604b8ebce55e50f6a34df1, user_id=18d5949afcac4d5cb3e8f841d8e33980, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:54.140760 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81703039-ffbc-4472-9462-d55ec29f7287 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:54.239968 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 573/1153] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:26:54 2022] PUT /identity/v3/projects/b28fabc898604b8ebce55e50f6a34df1/users/18d5949afcac4d5cb3e8f841d8e33980/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:56.261953 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc194ef-ff4c-42ed-9f9b-316ae7f6b2cc None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:56.262519 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc194ef-ff4c-42ed-9f9b-316ae7f6b2cc None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:56.262519 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc194ef-ff4c-42ed-9f9b-316ae7f6b2cc None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:56.263896 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 581/1154] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:56.269193 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23597ba7-985f-4bf8-9ad6-12fcb441f9b9 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:56.269625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23597ba7-985f-4bf8-9ad6-12fcb441f9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:56.269730 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23597ba7-985f-4bf8-9ad6-12fcb441f9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:56.288726 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-23597ba7-985f-4bf8-9ad6-12fcb441f9b9 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:56.289946 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-23597ba7-985f-4bf8-9ad6-12fcb441f9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:56.304866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:56.358729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 574/1155] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:56.384115 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc194ef-ff4c-42ed-9f9b-316ae7f6b2cc None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:56.408702 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:56.490249 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc194ef-ff4c-42ed-9f9b-316ae7f6b2cc None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:56.524807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434dabcb-eb83-4479-9d30-a0beee31769a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:56.525386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dabcb-eb83-4479-9d30-a0beee31769a None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:56.525667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dabcb-eb83-4479-9d30-a0beee31769a None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:56.525939 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dabcb-eb83-4479-9d30-a0beee31769a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:56.536469 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434dabcb-eb83-4479-9d30-a0beee31769a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:26:56.541377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-434dabcb-eb83-4479-9d30-a0beee31769a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:26:56.541377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:26:56.541377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:26:56.541377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:26:56.541377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:26:56.541377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:26:56.541377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:26:56.541377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:26:56.541377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:26:56.541377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:26:56.541377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:26:56.541377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:26:56.541377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:26:56.541377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:26:56.541377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:26:56.541377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:26:56.542527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:26:56.542527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:26:56.542527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:26:56.542527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:26:56.542527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:26:56.542527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:26:56.542527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:26:56.542527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:26:56.542527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:26:56.542527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:26:56.542527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:26:56.542527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:26:56.542527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:26:56.542527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:26:56.542527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:26:56.542527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:26:56.543778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:26:56.543778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:26:56.543778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:26:56.543778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:26:56.543778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:26:56.543778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:26:56.543778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:26:56.543778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:26:56.543778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:26:56.543778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:26:56.543778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:26:56.543778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:26:56.543778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 582/1156] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:26:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:26:56.549342 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23597ba7-985f-4bf8-9ad6-12fcb441f9b9 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:56.647473 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23597ba7-985f-4bf8-9ad6-12fcb441f9b9 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:56.681296 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f6da4-acae-46d0-9697-512ab2e096f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:56.681911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f6da4-acae-46d0-9697-512ab2e096f1 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:56.682192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f6da4-acae-46d0-9697-512ab2e096f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:56.682468 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f6da4-acae-46d0-9697-512ab2e096f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:56.683187 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f6da4-acae-46d0-9697-512ab2e096f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:56.683519 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f6da4-acae-46d0-9697-512ab2e096f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:56.685453 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f6da4-acae-46d0-9697-512ab2e096f1 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:56.693652 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 575/1157] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:26:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:56.699555 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434dabcb-eb83-4479-9d30-a0beee31769a None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:56.784074 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:56.803550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434dabcb-eb83-4479-9d30-a0beee31769a None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:56.837728 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc977e18-65d1-4810-8676-4ae85e32c210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:56.838472 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc977e18-65d1-4810-8676-4ae85e32c210 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:56.838807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc977e18-65d1-4810-8676-4ae85e32c210 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:56.839520 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc977e18-65d1-4810-8676-4ae85e32c210 None admin] PATH_INFO: `/v3/users/18d5949afcac4d5cb3e8f841d8e33980` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:56.840741 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc977e18-65d1-4810-8676-4ae85e32c210 None admin] RBAC: Authorizing `identity:get_user(user_id=18d5949afcac4d5cb3e8f841d8e33980)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:56.842244 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc977e18-65d1-4810-8676-4ae85e32c210 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:56.843939 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 583/1158] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:26:56 2022] GET /identity/v3/users/18d5949afcac4d5cb3e8f841d8e33980 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:56.850612 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f6da4-acae-46d0-9697-512ab2e096f1 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:56.863427 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:56.955132 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f6da4-acae-46d0-9697-512ab2e096f1 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:56.990570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ad984-b3e6-45a6-9ece-09ad2fa00604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:56.990985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ad984-b3e6-45a6-9ece-09ad2fa00604 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:56.991101 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ad984-b3e6-45a6-9ece-09ad2fa00604 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:56.991321 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ad984-b3e6-45a6-9ece-09ad2fa00604 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:57.071644 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ad984-b3e6-45a6-9ece-09ad2fa00604 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:57.073789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ad984-b3e6-45a6-9ece-09ad2fa00604 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:57.088573 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:57.179857 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 576/1159] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:26:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:26:57.185848 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc977e18-65d1-4810-8676-4ae85e32c210 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:57.286945 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc977e18-65d1-4810-8676-4ae85e32c210 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:57.321302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd5451-dae5-4be0-ba43-a9f4d9754504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:57.321996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd5451-dae5-4be0-ba43-a9f4d9754504 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:57.322278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd5451-dae5-4be0-ba43-a9f4d9754504 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:57.322499 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd5451-dae5-4be0-ba43-a9f4d9754504 None admin] PATH_INFO: `/v3/projects/b28fabc898604b8ebce55e50f6a34df1` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:57.323670 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd5451-dae5-4be0-ba43-a9f4d9754504 None admin] RBAC: Authorizing `identity:get_project(project_id=b28fabc898604b8ebce55e50f6a34df1)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:57.325145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd5451-dae5-4be0-ba43-a9f4d9754504 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:57.326993 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 584/1160] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:26:57 2022] GET /identity/v3/projects/b28fabc898604b8ebce55e50f6a34df1 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:57.333392 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ad984-b3e6-45a6-9ece-09ad2fa00604 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:57.437128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ad984-b3e6-45a6-9ece-09ad2fa00604 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:57.448116 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:57.472752 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c3df0-71f3-421a-baf7-6c5205bd4922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:57.473543 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c3df0-71f3-421a-baf7-6c5205bd4922 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:57.473977 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c3df0-71f3-421a-baf7-6c5205bd4922 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:57.474354 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c3df0-71f3-421a-baf7-6c5205bd4922 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:57.475281 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c3df0-71f3-421a-baf7-6c5205bd4922 None admin] RBAC: Adding query filter params (role.id=4ae8d11d74f14bcc80117d897ba2f5b6, scope.project.id=b28fabc898604b8ebce55e50f6a34df1, user.id=18d5949afcac4d5cb3e8f841d8e33980) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:57.475776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c3df0-71f3-421a-baf7-6c5205bd4922 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:57.477304 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c3df0-71f3-421a-baf7-6c5205bd4922 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:57.483661 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 577/1161] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:26:57 2022] GET /identity/v3/role_assignments?user.id=18d5949afcac4d5cb3e8f841d8e33980&scope.project.id=b28fabc898604b8ebce55e50f6a34df1&role.id=4ae8d11d74f14bcc80117d897ba2f5b6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:59.553080 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6289d-54fe-4be6-9c05-2518b5e3d15b None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:59.553613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6289d-54fe-4be6-9c05-2518b5e3d15b None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:59.553613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6289d-54fe-4be6-9c05-2518b5e3d15b None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:59.554966 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 585/1162] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:26:59.560812 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7051226-164e-4d2c-8650-aa5d4defc242 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:59.561247 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7051226-164e-4d2c-8650-aa5d4defc242 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:59.561378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7051226-164e-4d2c-8650-aa5d4defc242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:59.579993 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b7051226-164e-4d2c-8650-aa5d4defc242 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:59.581201 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b7051226-164e-4d2c-8650-aa5d4defc242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:59.648343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 578/1163] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:26:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:26:59.670531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6289d-54fe-4be6-9c05-2518b5e3d15b None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:59.688697 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:59.771560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6289d-54fe-4be6-9c05-2518b5e3d15b None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:59.806094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c7719-10ed-4084-ac9a-2ddf7e5e939d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:59.806626 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c7719-10ed-4084-ac9a-2ddf7e5e939d None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:59.806907 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c7719-10ed-4084-ac9a-2ddf7e5e939d None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:59.807178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c7719-10ed-4084-ac9a-2ddf7e5e939d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:59.874475 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c7719-10ed-4084-ac9a-2ddf7e5e939d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:59.875962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c7719-10ed-4084-ac9a-2ddf7e5e939d None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:59.893659 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:59.977693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 586/1164] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:26:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 18:26:59.984321 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7051226-164e-4d2c-8650-aa5d4defc242 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:00.084831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7051226-164e-4d2c-8650-aa5d4defc242 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:00.087092 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:00.121483 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55289d97-1410-4e97-b48d-e8b6fcde9365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:00.122534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55289d97-1410-4e97-b48d-e8b6fcde9365 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:00.122928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55289d97-1410-4e97-b48d-e8b6fcde9365 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:00.123212 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55289d97-1410-4e97-b48d-e8b6fcde9365 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:00.130134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55289d97-1410-4e97-b48d-e8b6fcde9365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:00.131645 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55289d97-1410-4e97-b48d-e8b6fcde9365 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:00.143703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-55289d97-1410-4e97-b48d-e8b6fcde9365 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 27 18:27:00.143703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:27:00.143703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 27 18:27:00.143703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 27 18:27:00.143703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:27:00.143703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:27:00.143703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:27:00.143703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:27:00.143703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 27 18:27:00.143703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:27:00.143703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:27:00.143703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:27:00.143703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:27:00.143703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:27:00.143703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:27:00.143703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:27:00.143703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:27:00.145134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:27:00.145134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:27:00.145134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:27:00.145134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:27:00.145134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:27:00.145134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:27:00.145134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:27:00.145134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:27:00.145134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:27:00.145134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:27:00.145134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:27:00.145134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:27:00.145134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:27:00.145134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:27:00.145134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:27:00.145134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:27:00.146128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:27:00.146128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:27:00.146128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:27:00.146128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:27:00.146128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:27:00.146128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:27:00.146128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:27:00.146128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:27:00.146128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:27:00.146128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:27:00.146128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 27 18:27:00.146128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:27:00.146128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 27 18:27:00.146128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:27:00.146128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 579/1165] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 18:26:59 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:27:00.151423 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c7719-10ed-4084-ac9a-2ddf7e5e939d None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:00.253055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c7719-10ed-4084-ac9a-2ddf7e5e939d None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:00.269707 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:00.288675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01917145-2d63-45c5-85da-1695af41c2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:00.289295 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01917145-2d63-45c5-85da-1695af41c2ee None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:00.289575 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01917145-2d63-45c5-85da-1695af41c2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:00.289849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01917145-2d63-45c5-85da-1695af41c2ee None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:00.290543 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01917145-2d63-45c5-85da-1695af41c2ee None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:27:00.290889 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01917145-2d63-45c5-85da-1695af41c2ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:00.292317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01917145-2d63-45c5-85da-1695af41c2ee None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:00.299954 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 587/1166] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Jul 27 18:27:00 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:27:02.345202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4408f84-38e1-4a9a-b6a8-cbcc577782a0 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:02.345781 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4408f84-38e1-4a9a-b6a8-cbcc577782a0 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:02.345781 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4408f84-38e1-4a9a-b6a8-cbcc577782a0 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:02.347121 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 580/1167] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:27:02.352309 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c8845-a43f-4886-ac5f-93f20ee68154 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:02.352761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c8845-a43f-4886-ac5f-93f20ee68154 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:02.352873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c8845-a43f-4886-ac5f-93f20ee68154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:02.372442 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-987c8845-a43f-4886-ac5f-93f20ee68154 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:02.373849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-987c8845-a43f-4886-ac5f-93f20ee68154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:02.443436 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 588/1168] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:27:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:27:02.466318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4408f84-38e1-4a9a-b6a8-cbcc577782a0 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:02.569375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4408f84-38e1-4a9a-b6a8-cbcc577782a0 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:02.614832 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442e7fd-ee96-432c-b325-b219ff06fc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:02.615402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442e7fd-ee96-432c-b325-b219ff06fc58 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:02.615689 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442e7fd-ee96-432c-b325-b219ff06fc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:02.615966 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442e7fd-ee96-432c-b325-b219ff06fc58 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:02.616683 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442e7fd-ee96-432c-b325-b219ff06fc58 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:02.618057 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442e7fd-ee96-432c-b325-b219ff06fc58 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:02.863434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 581/1169] 10.222.0.65 () {60 vars in 1138 bytes} [Wed Jul 27 18:27:02 2022] POST /identity/v3/domains => generated 267 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:27:05.069283 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286559d-d73c-4fd0-8fd2-49642b0c5db5 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:05.069845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286559d-d73c-4fd0-8fd2-49642b0c5db5 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:05.069845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286559d-d73c-4fd0-8fd2-49642b0c5db5 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:05.071199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 589/1170] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:27:05.077117 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddace6a-79dd-4be9-9e40-b0d81a89ed07 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:05.077555 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddace6a-79dd-4be9-9e40-b0d81a89ed07 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:05.077677 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddace6a-79dd-4be9-9e40-b0d81a89ed07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:05.096415 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-fddace6a-79dd-4be9-9e40-b0d81a89ed07 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:05.097618 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-fddace6a-79dd-4be9-9e40-b0d81a89ed07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:05.116048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:05.168249 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 582/1171] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:27:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:27:05.192175 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286559d-d73c-4fd0-8fd2-49642b0c5db5 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:05.293371 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286559d-d73c-4fd0-8fd2-49642b0c5db5 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:05.304743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:05.327914 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f3d70-edce-4c4d-ac19-d0e6079f23be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:05.328482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f3d70-edce-4c4d-ac19-d0e6079f23be None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:05.328768 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f3d70-edce-4c4d-ac19-d0e6079f23be None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:05.329048 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f3d70-edce-4c4d-ac19-d0e6079f23be None admin] PATH_INFO: `/v3/domains/6c4d00c604934d05b58cd55346bc5b10` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:05.339729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f3d70-edce-4c4d-ac19-d0e6079f23be None admin] RBAC: Authorizing `identity:get_domain(domain_id=6c4d00c604934d05b58cd55346bc5b10)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:05.341759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f3d70-edce-4c4d-ac19-d0e6079f23be None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:05.343417 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 590/1172] 10.222.0.65 () {56 vars in 1183 bytes} [Wed Jul 27 18:27:05 2022] GET /identity/v3/domains/6c4d00c604934d05b58cd55346bc5b10 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:27:05.349439 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddace6a-79dd-4be9-9e40-b0d81a89ed07 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:05.449053 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddace6a-79dd-4be9-9e40-b0d81a89ed07 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:05.482739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177230f-5cc9-42b2-8be3-679039e5e431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:05.483370 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177230f-5cc9-42b2-8be3-679039e5e431 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:05.483654 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177230f-5cc9-42b2-8be3-679039e5e431 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:05.483930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177230f-5cc9-42b2-8be3-679039e5e431 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:05.484615 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177230f-5cc9-42b2-8be3-679039e5e431 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:05.486048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177230f-5cc9-42b2-8be3-679039e5e431 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:05.572594 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 583/1173] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 18:27:05 2022] POST /identity/v3/projects => generated 361 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:27:07.611370 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ee592-cb99-481a-b574-3210dcfb4552 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:07.611938 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ee592-cb99-481a-b574-3210dcfb4552 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:07.611938 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ee592-cb99-481a-b574-3210dcfb4552 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:07.613329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 591/1174] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:27:07.618556 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72150051-5808-4379-b160-0b6f7ec57a9c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:07.618974 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72150051-5808-4379-b160-0b6f7ec57a9c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:07.619110 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72150051-5808-4379-b160-0b6f7ec57a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:07.634912 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:07.642082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-72150051-5808-4379-b160-0b6f7ec57a9c None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:07.643454 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-72150051-5808-4379-b160-0b6f7ec57a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:07.710766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 584/1175] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:27:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:27:07.736315 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ee592-cb99-481a-b574-3210dcfb4552 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:07.836072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ee592-cb99-481a-b574-3210dcfb4552 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:07.870389 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc2386-22b5-4327-ab6d-61df5970bd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:07.871031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc2386-22b5-4327-ab6d-61df5970bd8d None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:07.871341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc2386-22b5-4327-ab6d-61df5970bd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:07.871617 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc2386-22b5-4327-ab6d-61df5970bd8d None admin] PATH_INFO: `/v3/domains/6c4d00c604934d05b58cd55346bc5b10` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:07.873084 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc2386-22b5-4327-ab6d-61df5970bd8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=6c4d00c604934d05b58cd55346bc5b10)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:07.874522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc2386-22b5-4327-ab6d-61df5970bd8d None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:07.876161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 592/1176] 10.222.0.65 () {56 vars in 1183 bytes} [Wed Jul 27 18:27:07 2022] GET /identity/v3/domains/6c4d00c604934d05b58cd55346bc5b10 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:27:07.882138 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72150051-5808-4379-b160-0b6f7ec57a9c None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:07.982484 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72150051-5808-4379-b160-0b6f7ec57a9c None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:08.017548 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040e814-cc74-4c14-91b1-aa7eb8c95882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:08.018180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040e814-cc74-4c14-91b1-aa7eb8c95882 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:08.018464 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040e814-cc74-4c14-91b1-aa7eb8c95882 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:08.018748 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040e814-cc74-4c14-91b1-aa7eb8c95882 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:08.019478 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040e814-cc74-4c14-91b1-aa7eb8c95882 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:08.020923 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040e814-cc74-4c14-91b1-aa7eb8c95882 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:08.030339 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:08.129912 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 585/1177] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 18:27:07 2022] POST /identity/v3/users => generated 311 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:27:10.182614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef7e41-3fd6-41b0-b8ba-9663b0687b4e None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:10.183152 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef7e41-3fd6-41b0-b8ba-9663b0687b4e None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:10.183152 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef7e41-3fd6-41b0-b8ba-9663b0687b4e None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:10.184809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 593/1178] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:27:10.190040 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6703a7-349d-49c5-a628-7d79ef6ce8f9 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:10.190460 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6703a7-349d-49c5-a628-7d79ef6ce8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:10.190600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6703a7-349d-49c5-a628-7d79ef6ce8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:10.209861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-1a6703a7-349d-49c5-a628-7d79ef6ce8f9 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:10.211046 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1a6703a7-349d-49c5-a628-7d79ef6ce8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:10.276729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 586/1179] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:27:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:27:10.300335 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef7e41-3fd6-41b0-b8ba-9663b0687b4e None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:10.350387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:10.411758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef7e41-3fd6-41b0-b8ba-9663b0687b4e None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:10.447519 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51078f5e-8124-4be2-8c71-0d42cbb11857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:10.448073 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51078f5e-8124-4be2-8c71-0d42cbb11857 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:10.448352 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51078f5e-8124-4be2-8c71-0d42cbb11857 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:10.448626 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51078f5e-8124-4be2-8c71-0d42cbb11857 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:10.459358 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51078f5e-8124-4be2-8c71-0d42cbb11857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:27:10.464169 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-51078f5e-8124-4be2-8c71-0d42cbb11857 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:27:10.464169 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:27:10.464169 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:27:10.464169 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:27:10.464169 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:27:10.464169 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:27:10.464169 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:27:10.464169 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:27:10.464169 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:27:10.464169 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:27:10.464169 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:27:10.464169 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:27:10.464169 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:27:10.464169 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:27:10.464169 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:27:10.464169 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:27:10.465292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:27:10.465292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:27:10.465292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:27:10.465292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:27:10.465292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:27:10.465292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:27:10.465292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:27:10.465292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:27:10.465292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:27:10.465292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:27:10.465292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:27:10.465292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:27:10.465292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:27:10.465292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:27:10.465292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:27:10.465292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:27:10.471842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:27:10.471842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:27:10.471842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:27:10.471842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:27:10.471842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:27:10.471842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:27:10.471842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:27:10.471842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:27:10.471842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:27:10.471842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:27:10.471842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:27:10.471842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:27:10.471842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 594/1180] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:27:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:27:10.472739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6703a7-349d-49c5-a628-7d79ef6ce8f9 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:10.571518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6703a7-349d-49c5-a628-7d79ef6ce8f9 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:10.594277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:10.605441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8583c76-0aef-4f06-a532-29c0c923ce99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:10.606575 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8583c76-0aef-4f06-a532-29c0c923ce99 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:10.606575 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8583c76-0aef-4f06-a532-29c0c923ce99 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:10.606575 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8583c76-0aef-4f06-a532-29c0c923ce99 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:10.607327 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8583c76-0aef-4f06-a532-29c0c923ce99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:27:10.607638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8583c76-0aef-4f06-a532-29c0c923ce99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:10.609013 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8583c76-0aef-4f06-a532-29c0c923ce99 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:10.617028 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 587/1181] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:27:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:27:10.623700 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51078f5e-8124-4be2-8c71-0d42cbb11857 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:10.765628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:10.769207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51078f5e-8124-4be2-8c71-0d42cbb11857 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:10.801316 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6659d8-acbe-4354-b2d0-bf5a9c6541ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:10.801943 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6659d8-acbe-4354-b2d0-bf5a9c6541ab None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:10.802223 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6659d8-acbe-4354-b2d0-bf5a9c6541ab None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:10.802495 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6659d8-acbe-4354-b2d0-bf5a9c6541ab None admin] PATH_INFO: `/v3/users/cb33616d5b5045f097d7b2f258133a76` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:10.816152 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6659d8-acbe-4354-b2d0-bf5a9c6541ab None admin] RBAC: Authorizing `identity:get_user(user_id=cb33616d5b5045f097d7b2f258133a76)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:10.817600 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6659d8-acbe-4354-b2d0-bf5a9c6541ab None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:10.819210 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 595/1182] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:27:10 2022] GET /identity/v3/users/cb33616d5b5045f097d7b2f258133a76 => generated 311 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:27:10.825773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8583c76-0aef-4f06-a532-29c0c923ce99 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:10.923545 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8583c76-0aef-4f06-a532-29c0c923ce99 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:10.957533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe48a7-8741-426d-a7bc-9df8af4502e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:10.958161 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe48a7-8741-426d-a7bc-9df8af4502e4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:10.958447 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe48a7-8741-426d-a7bc-9df8af4502e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:10.958726 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe48a7-8741-426d-a7bc-9df8af4502e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:11.011282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:11.026954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe48a7-8741-426d-a7bc-9df8af4502e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:11.029067 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe48a7-8741-426d-a7bc-9df8af4502e4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:11.128210 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 588/1183] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:27:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:27:11.134143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6659d8-acbe-4354-b2d0-bf5a9c6541ab None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:11.234297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6659d8-acbe-4354-b2d0-bf5a9c6541ab None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:11.268610 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02aa8f-83b4-4221-a9d3-b2e21628fa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:11.269249 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02aa8f-83b4-4221-a9d3-b2e21628fa04 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:11.269539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02aa8f-83b4-4221-a9d3-b2e21628fa04 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:11.269813 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02aa8f-83b4-4221-a9d3-b2e21628fa04 None admin] PATH_INFO: `/v3/projects/79d4bff3fffa46b3a9b0a0a82864a12d` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:11.270960 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02aa8f-83b4-4221-a9d3-b2e21628fa04 None admin] RBAC: Authorizing `identity:get_project(project_id=79d4bff3fffa46b3a9b0a0a82864a12d)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:11.272424 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02aa8f-83b4-4221-a9d3-b2e21628fa04 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:11.274096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 596/1184] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:27:11 2022] GET /identity/v3/projects/79d4bff3fffa46b3a9b0a0a82864a12d => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:27:11.280569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe48a7-8741-426d-a7bc-9df8af4502e4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:11.361081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:11.377117 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe48a7-8741-426d-a7bc-9df8af4502e4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:11.414612 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703b964-2971-4b47-825f-35b65bbd53b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:11.415238 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703b964-2971-4b47-825f-35b65bbd53b5 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:11.415542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703b964-2971-4b47-825f-35b65bbd53b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:11.415814 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703b964-2971-4b47-825f-35b65bbd53b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:11.416602 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703b964-2971-4b47-825f-35b65bbd53b5 None admin] RBAC: Adding query filter params (role.id=4ae8d11d74f14bcc80117d897ba2f5b6, scope.project.id=79d4bff3fffa46b3a9b0a0a82864a12d, user.id=cb33616d5b5045f097d7b2f258133a76) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:27:11.416907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703b964-2971-4b47-825f-35b65bbd53b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:11.418346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703b964-2971-4b47-825f-35b65bbd53b5 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:11.424184 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 589/1185] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:27:11 2022] GET /identity/v3/role_assignments?user.id=cb33616d5b5045f097d7b2f258133a76&scope.project.id=79d4bff3fffa46b3a9b0a0a82864a12d&role.id=4ae8d11d74f14bcc80117d897ba2f5b6 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:27:13.456453 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1feb52-9295-453c-993f-e308f440e414 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:13.456996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1feb52-9295-453c-993f-e308f440e414 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:13.456996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1feb52-9295-453c-993f-e308f440e414 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:13.458380 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 597/1186] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:27:13.463832 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a62d2-e4c1-4cb7-81f5-cb698617a763 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:13.464249 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a62d2-e4c1-4cb7-81f5-cb698617a763 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:13.464398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a62d2-e4c1-4cb7-81f5-cb698617a763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:13.482864 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-129a62d2-e4c1-4cb7-81f5-cb698617a763 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:13.484108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-129a62d2-e4c1-4cb7-81f5-cb698617a763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:13.551373 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 590/1187] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:27:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:27:13.574177 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1feb52-9295-453c-993f-e308f440e414 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:13.599386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:13.673890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1feb52-9295-453c-993f-e308f440e414 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:13.707141 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1dc8c-9129-4269-b706-e33a5bcd1fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:13.707738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1dc8c-9129-4269-b706-e33a5bcd1fbe None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:13.708022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1dc8c-9129-4269-b706-e33a5bcd1fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:13.708296 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1dc8c-9129-4269-b706-e33a5bcd1fbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:13.718817 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1dc8c-9129-4269-b706-e33a5bcd1fbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:27:13.723690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-9cf1dc8c-9129-4269-b706-e33a5bcd1fbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:27:13.723690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:27:13.723690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:27:13.723690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:27:13.723690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:27:13.723690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:27:13.723690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:27:13.723690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:27:13.723690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:27:13.723690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:27:13.723690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:27:13.723690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:27:13.723690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:27:13.723690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:27:13.723690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:27:13.723690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:27:13.724789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:27:13.724789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:27:13.724789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:27:13.724789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:27:13.724789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:27:13.724789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:27:13.724789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:27:13.724789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:27:13.724789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:27:13.724789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:27:13.724789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:27:13.724789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:27:13.724789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:27:13.724789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:27:13.724789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:27:13.724789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:27:13.725759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:27:13.725759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:27:13.725759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:27:13.725759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:27:13.725759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:27:13.725759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:27:13.725759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:27:13.725759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:27:13.725759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:27:13.725759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:27:13.725759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:27:13.725759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:27:13.725759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 598/1188] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:27:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:27:13.731007 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a62d2-e4c1-4cb7-81f5-cb698617a763 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:13.807451 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:13.828218 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a62d2-e4c1-4cb7-81f5-cb698617a763 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:13.862476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5edce-4567-4818-a13b-d83152729417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:13.863088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5edce-4567-4818-a13b-d83152729417 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:13.863393 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5edce-4567-4818-a13b-d83152729417 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:13.863665 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5edce-4567-4818-a13b-d83152729417 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:13.864375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5edce-4567-4818-a13b-d83152729417 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:27:13.864674 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5edce-4567-4818-a13b-d83152729417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:13.866037 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5edce-4567-4818-a13b-d83152729417 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:13.874760 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 591/1189] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:27:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:27:13.880650 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1dc8c-9129-4269-b706-e33a5bcd1fbe None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:13.963815 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:13.979517 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1dc8c-9129-4269-b706-e33a5bcd1fbe None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:14.015732 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a00fde-f428-44d4-a8c8-10033a74f896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:14.016373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a00fde-f428-44d4-a8c8-10033a74f896 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:14.016657 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a00fde-f428-44d4-a8c8-10033a74f896 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:14.016935 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a00fde-f428-44d4-a8c8-10033a74f896 None admin] PATH_INFO: `/v3/users/cb33616d5b5045f097d7b2f258133a76` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:14.018122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a00fde-f428-44d4-a8c8-10033a74f896 None admin] RBAC: Authorizing `identity:get_user(user_id=cb33616d5b5045f097d7b2f258133a76)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:14.019598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a00fde-f428-44d4-a8c8-10033a74f896 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:14.021212 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 599/1190] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:27:13 2022] GET /identity/v3/users/cb33616d5b5045f097d7b2f258133a76 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:27:14.027082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5edce-4567-4818-a13b-d83152729417 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:14.129629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5edce-4567-4818-a13b-d83152729417 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:14.163420 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00309ce8-28cc-4e37-8065-25d4942d5416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:14.164058 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00309ce8-28cc-4e37-8065-25d4942d5416 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:14.164343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00309ce8-28cc-4e37-8065-25d4942d5416 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:14.164620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00309ce8-28cc-4e37-8065-25d4942d5416 None admin] PATH_INFO: `/v3/projects/79d4bff3fffa46b3a9b0a0a82864a12d` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:14.165775 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00309ce8-28cc-4e37-8065-25d4942d5416 None admin] RBAC: Authorizing `identity:get_project(project_id=79d4bff3fffa46b3a9b0a0a82864a12d)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:14.167209 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00309ce8-28cc-4e37-8065-25d4942d5416 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:14.169340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 592/1191] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:27:14 2022] GET /identity/v3/projects/79d4bff3fffa46b3a9b0a0a82864a12d => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:27:14.175521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a00fde-f428-44d4-a8c8-10033a74f896 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:14.273824 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a00fde-f428-44d4-a8c8-10033a74f896 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:14.306098 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828e34a-f294-4c77-858b-f0c98e8988d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:14.306752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828e34a-f294-4c77-858b-f0c98e8988d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:14.307031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828e34a-f294-4c77-858b-f0c98e8988d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:14.307327 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828e34a-f294-4c77-858b-f0c98e8988d1 None admin] PATH_INFO: `/v3/projects/79d4bff3fffa46b3a9b0a0a82864a12d/users/cb33616d5b5045f097d7b2f258133a76/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:14.309740 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828e34a-f294-4c77-858b-f0c98e8988d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=79d4bff3fffa46b3a9b0a0a82864a12d, user_id=cb33616d5b5045f097d7b2f258133a76, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:14.311276 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828e34a-f294-4c77-858b-f0c98e8988d1 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:14.461593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 600/1192] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:27:14 2022] PUT /identity/v3/projects/79d4bff3fffa46b3a9b0a0a82864a12d/users/cb33616d5b5045f097d7b2f258133a76/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:27:16.437631 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c8944-c3c5-4724-b8ed-e6dd7a78b801 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:16.438172 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c8944-c3c5-4724-b8ed-e6dd7a78b801 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:16.438172 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c8944-c3c5-4724-b8ed-e6dd7a78b801 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:16.439570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 593/1193] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:27:16.444661 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670998a5-e924-4335-a411-c46fea628608 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:16.445101 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670998a5-e924-4335-a411-c46fea628608 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:16.445219 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670998a5-e924-4335-a411-c46fea628608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:16.463486 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-670998a5-e924-4335-a411-c46fea628608 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:16.464668 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-670998a5-e924-4335-a411-c46fea628608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:16.472764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:16.532280 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 601/1194] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:27:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:27:16.555974 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c8944-c3c5-4724-b8ed-e6dd7a78b801 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:16.568118 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:16.658253 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c8944-c3c5-4724-b8ed-e6dd7a78b801 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:16.691677 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e48fb-10ea-4a4a-81a5-114526a4ceb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:16.692241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e48fb-10ea-4a4a-81a5-114526a4ceb7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:16.692520 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e48fb-10ea-4a4a-81a5-114526a4ceb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:16.692794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e48fb-10ea-4a4a-81a5-114526a4ceb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:16.703815 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e48fb-10ea-4a4a-81a5-114526a4ceb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:27:16.708666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-e06e48fb-10ea-4a4a-81a5-114526a4ceb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:27:16.708666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:27:16.708666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:27:16.708666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:27:16.708666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:27:16.708666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:27:16.708666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:27:16.708666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:27:16.708666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:27:16.708666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:27:16.708666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:27:16.708666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:27:16.708666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:27:16.708666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:27:16.708666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:27:16.708666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:27:16.709789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:27:16.709789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:27:16.709789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:27:16.709789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:27:16.709789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:27:16.709789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:27:16.709789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:27:16.709789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:27:16.709789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:27:16.709789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:27:16.709789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:27:16.709789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:27:16.709789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:27:16.709789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:27:16.709789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:27:16.709789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:27:16.710944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:27:16.710944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:27:16.710944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:27:16.710944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:27:16.710944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:27:16.710944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:27:16.710944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:27:16.710944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:27:16.710944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:27:16.710944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:27:16.710944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:27:16.710944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:27:16.710944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 594/1195] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:27:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:27:16.716164 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670998a5-e924-4335-a411-c46fea628608 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:16.813023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670998a5-e924-4335-a411-c46fea628608 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:16.846256 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34094c-c649-4356-9a17-1e199d57498c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:16.846873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34094c-c649-4356-9a17-1e199d57498c None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:16.847158 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34094c-c649-4356-9a17-1e199d57498c None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:16.847462 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34094c-c649-4356-9a17-1e199d57498c None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:16.848177 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34094c-c649-4356-9a17-1e199d57498c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:27:16.848485 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34094c-c649-4356-9a17-1e199d57498c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:16.849863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34094c-c649-4356-9a17-1e199d57498c None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:16.857820 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 602/1196] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:27:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:27:16.863691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e48fb-10ea-4a4a-81a5-114526a4ceb7 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:16.933276 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:16.966270 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e48fb-10ea-4a4a-81a5-114526a4ceb7 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:17.000265 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5d1df-6f1b-4e82-8c49-fd721f56c0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:17.000893 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5d1df-6f1b-4e82-8c49-fd721f56c0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:17.001173 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5d1df-6f1b-4e82-8c49-fd721f56c0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:17.001454 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5d1df-6f1b-4e82-8c49-fd721f56c0b5 None admin] PATH_INFO: `/v3/users/cb33616d5b5045f097d7b2f258133a76` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:17.002602 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5d1df-6f1b-4e82-8c49-fd721f56c0b5 None admin] RBAC: Authorizing `identity:get_user(user_id=cb33616d5b5045f097d7b2f258133a76)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:17.004077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5d1df-6f1b-4e82-8c49-fd721f56c0b5 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:17.005679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 595/1197] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 18:27:16 2022] GET /identity/v3/users/cb33616d5b5045f097d7b2f258133a76 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:27:17.011577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34094c-c649-4356-9a17-1e199d57498c None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:17.015405 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:17.111242 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34094c-c649-4356-9a17-1e199d57498c None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:17.145558 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa5bd2-e79e-404e-9cf3-8444a8631f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:17.146173 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa5bd2-e79e-404e-9cf3-8444a8631f4f None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:17.146459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa5bd2-e79e-404e-9cf3-8444a8631f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:17.146736 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa5bd2-e79e-404e-9cf3-8444a8631f4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:17.213043 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa5bd2-e79e-404e-9cf3-8444a8631f4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:17.214502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa5bd2-e79e-404e-9cf3-8444a8631f4f None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:17.217859 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:17.316226 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 603/1198] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:27:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:27:17.322474 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5d1df-6f1b-4e82-8c49-fd721f56c0b5 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:17.421553 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5d1df-6f1b-4e82-8c49-fd721f56c0b5 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:17.457262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444ce38-b6b5-4c28-8543-459e2742d0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:17.457960 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444ce38-b6b5-4c28-8543-459e2742d0cb None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:17.458161 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444ce38-b6b5-4c28-8543-459e2742d0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:17.458434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444ce38-b6b5-4c28-8543-459e2742d0cb None admin] PATH_INFO: `/v3/projects/79d4bff3fffa46b3a9b0a0a82864a12d` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:17.459608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444ce38-b6b5-4c28-8543-459e2742d0cb None admin] RBAC: Authorizing `identity:get_project(project_id=79d4bff3fffa46b3a9b0a0a82864a12d)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:17.461052 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444ce38-b6b5-4c28-8543-459e2742d0cb None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:17.462715 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 596/1199] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 18:27:17 2022] GET /identity/v3/projects/79d4bff3fffa46b3a9b0a0a82864a12d => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:27:17.469183 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa5bd2-e79e-404e-9cf3-8444a8631f4f None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:17.567568 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa5bd2-e79e-404e-9cf3-8444a8631f4f None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:17.569976 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:17.601310 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4b2a9-cc0e-4b35-b7a2-30cc4fd377b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:17.601919 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4b2a9-cc0e-4b35-b7a2-30cc4fd377b0 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:17.602202 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4b2a9-cc0e-4b35-b7a2-30cc4fd377b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:17.602492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4b2a9-cc0e-4b35-b7a2-30cc4fd377b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:17.603691 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4b2a9-cc0e-4b35-b7a2-30cc4fd377b0 None admin] RBAC: Adding query filter params (role.id=4ae8d11d74f14bcc80117d897ba2f5b6, scope.project.id=79d4bff3fffa46b3a9b0a0a82864a12d, user.id=cb33616d5b5045f097d7b2f258133a76) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:27:17.604074 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4b2a9-cc0e-4b35-b7a2-30cc4fd377b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:17.606031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4b2a9-cc0e-4b35-b7a2-30cc4fd377b0 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:17.611876 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 604/1200] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:27:17 2022] GET /identity/v3/role_assignments?user.id=cb33616d5b5045f097d7b2f258133a76&scope.project.id=79d4bff3fffa46b3a9b0a0a82864a12d&role.id=4ae8d11d74f14bcc80117d897ba2f5b6 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:27:27.453016 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=98 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:27.609182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=16 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:33.163600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857b6cf-816f-4074-b841-ac2ff885ed33 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:33.164208 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857b6cf-816f-4074-b841-ac2ff885ed33 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:33.164208 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857b6cf-816f-4074-b841-ac2ff885ed33 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:33.165522 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 597/1201] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:28:33.170689 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d175e-c5fe-489a-85b2-50c5a591ed1e None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:33.171137 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d175e-c5fe-489a-85b2-50c5a591ed1e None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:33.171249 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d175e-c5fe-489a-85b2-50c5a591ed1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:33.189972 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-d01d175e-c5fe-489a-85b2-50c5a591ed1e None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:28:33.191455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-d01d175e-c5fe-489a-85b2-50c5a591ed1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:28:33.259278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 605/1202] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:28:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:28:33.283998 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857b6cf-816f-4074-b841-ac2ff885ed33 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:33.397517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857b6cf-816f-4074-b841-ac2ff885ed33 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:33.431958 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5f65f-c93d-4a0f-94aa-5e2afdba2010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:33.432496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5f65f-c93d-4a0f-94aa-5e2afdba2010 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:33.432777 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5f65f-c93d-4a0f-94aa-5e2afdba2010 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:33.433052 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5f65f-c93d-4a0f-94aa-5e2afdba2010 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:33.444243 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5f65f-c93d-4a0f-94aa-5e2afdba2010 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:33.445724 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5f65f-c93d-4a0f-94aa-5e2afdba2010 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:33.460349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-c9c5f65f-c93d-4a0f-94aa-5e2afdba2010 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:33.460349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:33.460349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:33.460349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:33.460349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:33.460349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:33.460349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:33.460349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:33.460349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:33.460349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:33.460349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:33.460349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:33.460349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:28:33.460349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:28:33.460349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:28:33.462089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:28:33.462089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:33.462089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:33.462089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:33.462089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:33.462089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:33.462089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:33.462089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:33.462089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:33.462089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:33.462089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:33.462089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:33.462089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:33.462089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:33.462089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:33.462089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:33.462089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:33.463411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:28:33.463411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:28:33.463411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:33.463411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:28:33.463411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 598/1203] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:33.467687 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d175e-c5fe-489a-85b2-50c5a591ed1e None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:33.567122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d175e-c5fe-489a-85b2-50c5a591ed1e None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:33.594871 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:33.601604 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d3dcf-cc6b-46f4-a825-dc49b19dea94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:33.602298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d3dcf-cc6b-46f4-a825-dc49b19dea94 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:33.602626 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d3dcf-cc6b-46f4-a825-dc49b19dea94 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:33.602949 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d3dcf-cc6b-46f4-a825-dc49b19dea94 None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:33.603755 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d3dcf-cc6b-46f4-a825-dc49b19dea94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:33.607445 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d3dcf-cc6b-46f4-a825-dc49b19dea94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:33.607445 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d3dcf-cc6b-46f4-a825-dc49b19dea94 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:33.617411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 606/1204] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:33.623527 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5f65f-c93d-4a0f-94aa-5e2afdba2010 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:33.675934 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:33.721482 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5f65f-c93d-4a0f-94aa-5e2afdba2010 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:33.754335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857af5d-3b45-4848-96f6-cb1b2273f5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:33.754949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857af5d-3b45-4848-96f6-cb1b2273f5df None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:33.755226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857af5d-3b45-4848-96f6-cb1b2273f5df None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:33.755531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857af5d-3b45-4848-96f6-cb1b2273f5df None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:33.756197 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857af5d-3b45-4848-96f6-cb1b2273f5df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:33.757628 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857af5d-3b45-4848-96f6-cb1b2273f5df None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:33.905724 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 599/1205] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 18:28:33 2022] POST /identity/v3/users => generated 251 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:28:35.976589 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec1519-e924-4975-8255-9d18f3037e39 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:35.977166 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec1519-e924-4975-8255-9d18f3037e39 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:35.977166 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec1519-e924-4975-8255-9d18f3037e39 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:35.978566 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 607/1206] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:28:35.983944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa8092-28af-4c9e-9533-221543cd0d7c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:35.984358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa8092-28af-4c9e-9533-221543cd0d7c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:35.984519 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa8092-28af-4c9e-9533-221543cd0d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:36.003409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-31fa8092-28af-4c9e-9533-221543cd0d7c None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:28:36.004593 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-31fa8092-28af-4c9e-9533-221543cd0d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:28:36.072922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 600/1207] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:28:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:28:36.096473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec1519-e924-4975-8255-9d18f3037e39 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:36.199652 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec1519-e924-4975-8255-9d18f3037e39 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:36.234267 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2b60e-3ca7-4183-9830-1e6c9be812a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:36.234842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2b60e-3ca7-4183-9830-1e6c9be812a6 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:36.235125 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2b60e-3ca7-4183-9830-1e6c9be812a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:36.235437 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2b60e-3ca7-4183-9830-1e6c9be812a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:36.245689 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2b60e-3ca7-4183-9830-1e6c9be812a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:28:36.250634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-6cb2b60e-3ca7-4183-9830-1e6c9be812a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:28:36.250634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:36.250634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:36.250634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:36.250634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:36.250634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:36.250634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:36.250634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:36.250634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:36.250634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:36.250634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:36.250634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:36.250634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:28:36.250634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:28:36.250634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:28:36.250634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:28:36.251789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:28:36.251789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:28:36.251789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:28:36.251789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:28:36.251789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:36.251789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:36.251789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:36.251789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:36.251789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:36.251789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:36.251789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:36.251789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:36.251789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:36.251789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:36.251789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:36.251789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:36.253088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:36.253088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:36.253088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:36.253088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:36.253088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:28:36.253088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:28:36.253088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:28:36.253088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:28:36.253088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:28:36.253088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:28:36.253088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:28:36.253088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:28:36.253088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 608/1208] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:28:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:36.258127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa8092-28af-4c9e-9533-221543cd0d7c None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:36.298651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:36.358157 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa8092-28af-4c9e-9533-221543cd0d7c None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:36.396649 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2d925-1e43-4b80-9dff-e0a759260aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:36.397322 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2d925-1e43-4b80-9dff-e0a759260aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:36.397605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2d925-1e43-4b80-9dff-e0a759260aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:36.397881 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2d925-1e43-4b80-9dff-e0a759260aa2 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:36.398612 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2d925-1e43-4b80-9dff-e0a759260aa2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:36.398918 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2d925-1e43-4b80-9dff-e0a759260aa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:36.400340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2d925-1e43-4b80-9dff-e0a759260aa2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:36.409734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 601/1209] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 18:28:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:36.415747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2b60e-3ca7-4183-9830-1e6c9be812a6 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:36.466277 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:36.516345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2b60e-3ca7-4183-9830-1e6c9be812a6 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:36.550706 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d26f0-6ec9-4e22-bf88-4330d2b9caca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:36.551943 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d26f0-6ec9-4e22-bf88-4330d2b9caca None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:36.551943 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d26f0-6ec9-4e22-bf88-4330d2b9caca None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:36.551943 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d26f0-6ec9-4e22-bf88-4330d2b9caca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:36.562905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d26f0-6ec9-4e22-bf88-4330d2b9caca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:36.564928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d26f0-6ec9-4e22-bf88-4330d2b9caca None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:36.578852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-df6d26f0-6ec9-4e22-bf88-4330d2b9caca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:36.578852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:36.578852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:36.578852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:36.578852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:36.578852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:36.578852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:36.578852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:36.578852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:36.578852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:36.578852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:36.578852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:36.578852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:28:36.578852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:28:36.578852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:28:36.580630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:28:36.580630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:36.580630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:36.580630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:36.580630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:36.580630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:36.580630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:36.580630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:36.580630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:36.580630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:36.580630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:36.580630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:36.580630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:36.580630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:36.580630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:36.580630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:36.580630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:36.581906 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:28:36.581906 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:28:36.581906 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:36.581906 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:28:36.581906 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 609/1210] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:36.586530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2d925-1e43-4b80-9dff-e0a759260aa2 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:36.682922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:36.685702 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2d925-1e43-4b80-9dff-e0a759260aa2 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:36.719134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7b4de-b969-4a86-aeab-7203d8cddc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:36.719777 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7b4de-b969-4a86-aeab-7203d8cddc52 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:36.720061 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7b4de-b969-4a86-aeab-7203d8cddc52 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:36.720341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7b4de-b969-4a86-aeab-7203d8cddc52 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:36.721178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7b4de-b969-4a86-aeab-7203d8cddc52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:36.721491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7b4de-b969-4a86-aeab-7203d8cddc52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:36.722869 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7b4de-b969-4a86-aeab-7203d8cddc52 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:36.734535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 602/1211] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:36.740676 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d26f0-6ec9-4e22-bf88-4330d2b9caca None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:36.842198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d26f0-6ec9-4e22-bf88-4330d2b9caca None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:36.843747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:36.878050 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587468d8-4524-4b40-aab4-2041eba84f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:36.878732 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587468d8-4524-4b40-aab4-2041eba84f42 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:36.879016 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587468d8-4524-4b40-aab4-2041eba84f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:36.879316 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587468d8-4524-4b40-aab4-2041eba84f42 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:36.886493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587468d8-4524-4b40-aab4-2041eba84f42 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:36.888118 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587468d8-4524-4b40-aab4-2041eba84f42 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:36.900345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-587468d8-4524-4b40-aab4-2041eba84f42 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:28:36.900345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:36.900345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:36.900345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:36.900345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:36.900345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:36.900345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:36.900345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:36.900345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:36.900345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:36.900345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:36.900345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:36.900345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:28:36.900345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:28:36.900345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:28:36.900345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:28:36.901631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:36.901631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:36.901631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:28:36.901631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:28:36.901631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:28:36.901631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:28:36.901631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:36.901631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:36.901631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:36.901631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:36.901631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:36.901631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:36.901631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:36.901631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:36.901631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:36.901631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:36.901631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:36.901631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:36.902608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:36.902608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:36.902608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:28:36.902608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:28:36.902608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:28:36.902608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:28:36.902608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:28:36.902608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:28:36.902608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:28:36.902608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:28:36.902608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 610/1212] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:28:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:36.907503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7b4de-b969-4a86-aeab-7203d8cddc52 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:37.010750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7b4de-b969-4a86-aeab-7203d8cddc52 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:37.043392 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1f7dd-d07d-4974-b549-7d580e723aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:37.044004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1f7dd-d07d-4974-b549-7d580e723aab None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:37.044283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1f7dd-d07d-4974-b549-7d580e723aab None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:37.044556 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1f7dd-d07d-4974-b549-7d580e723aab None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:37.045343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1f7dd-d07d-4974-b549-7d580e723aab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:37.045651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1f7dd-d07d-4974-b549-7d580e723aab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:37.047081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1f7dd-d07d-4974-b549-7d580e723aab None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:37.064957 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 603/1213] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Jul 27 18:28:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:37.072392 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587468d8-4524-4b40-aab4-2041eba84f42 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:37.181805 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587468d8-4524-4b40-aab4-2041eba84f42 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:37.216117 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2a8c7-f182-41c5-a764-41e3126ba134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:37.216735 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2a8c7-f182-41c5-a764-41e3126ba134 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:37.217018 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2a8c7-f182-41c5-a764-41e3126ba134 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:37.217296 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2a8c7-f182-41c5-a764-41e3126ba134 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:37.247054 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:37.284085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2a8c7-f182-41c5-a764-41e3126ba134 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:37.285541 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2a8c7-f182-41c5-a764-41e3126ba134 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:37.394022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 611/1214] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:28:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 18:28:37.400079 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1f7dd-d07d-4974-b549-7d580e723aab None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:37.420935 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:37.508029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1f7dd-d07d-4974-b549-7d580e723aab None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:37.543343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953ccc2-674f-4163-b7a8-4e2d7558427a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:37.543998 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953ccc2-674f-4163-b7a8-4e2d7558427a None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:37.544288 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953ccc2-674f-4163-b7a8-4e2d7558427a None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:37.544567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953ccc2-674f-4163-b7a8-4e2d7558427a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:37.555712 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953ccc2-674f-4163-b7a8-4e2d7558427a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:37.557180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953ccc2-674f-4163-b7a8-4e2d7558427a None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:37.571828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-4953ccc2-674f-4163-b7a8-4e2d7558427a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:37.571828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:37.571828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:37.571828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:37.571828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:37.571828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:37.571828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:37.571828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:37.571828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:37.571828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:37.571828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:37.571828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:37.571828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:28:37.571828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:28:37.571828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:28:37.573088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:28:37.573088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:37.573088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:37.573088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:37.573088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:37.573088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:37.573088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:37.573088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:37.573088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:37.573088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:37.573088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:37.573088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:37.573088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:37.573088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:37.573088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:37.573088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:37.573088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:37.574260 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:28:37.574260 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:28:37.574260 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:37.574260 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:28:37.574260 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 604/1215] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:37.578911 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2a8c7-f182-41c5-a764-41e3126ba134 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:37.641462 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:37.681563 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2a8c7-f182-41c5-a764-41e3126ba134 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:37.715828 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b800768-bff6-46ce-9c8f-1b1dda7ef429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:37.716444 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b800768-bff6-46ce-9c8f-1b1dda7ef429 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:37.716724 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b800768-bff6-46ce-9c8f-1b1dda7ef429 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:37.716997 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b800768-bff6-46ce-9c8f-1b1dda7ef429 None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:37.717707 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b800768-bff6-46ce-9c8f-1b1dda7ef429 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:37.717985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b800768-bff6-46ce-9c8f-1b1dda7ef429 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:37.719371 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b800768-bff6-46ce-9c8f-1b1dda7ef429 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:37.731682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 612/1216] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:37.737571 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953ccc2-674f-4163-b7a8-4e2d7558427a None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:37.812916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:37.847630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953ccc2-674f-4163-b7a8-4e2d7558427a None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:37.882344 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8c3b1-3f79-468a-a563-e657958f18c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:37.882985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8c3b1-3f79-468a-a563-e657958f18c5 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:37.883293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8c3b1-3f79-468a-a563-e657958f18c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:37.883572 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8c3b1-3f79-468a-a563-e657958f18c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:37.890325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8c3b1-3f79-468a-a563-e657958f18c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:37.892349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8c3b1-3f79-468a-a563-e657958f18c5 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:37.904236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-fdc8c3b1-3f79-468a-a563-e657958f18c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:28:37.904236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:37.904236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:37.904236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:37.904236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:37.904236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:37.904236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:37.904236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:37.904236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:37.904236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:37.904236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:37.904236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:37.904236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:28:37.904236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:28:37.904236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:28:37.905325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:28:37.905325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:37.905325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:37.905325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:37.905325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:37.905325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:37.905325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:37.905325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:37.905325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:37.905325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:37.905325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:37.905325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:37.905325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:37.905325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:37.905325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:37.905325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:37.905325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:37.911240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:28:37.911240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:28:37.911240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:28:37.911240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:28:37.911240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:28:37.911240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:28:37.911240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:28:37.911240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:28:37.911240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 605/1217] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:28:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:37.912667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b800768-bff6-46ce-9c8f-1b1dda7ef429 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:38.014016 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b800768-bff6-46ce-9c8f-1b1dda7ef429 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:38.037412 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:38.048367 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ecb6e-b619-4e13-90fc-9312d603debb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:38.049015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ecb6e-b619-4e13-90fc-9312d603debb None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:38.049298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ecb6e-b619-4e13-90fc-9312d603debb None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:38.049575 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ecb6e-b619-4e13-90fc-9312d603debb None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:38.050322 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ecb6e-b619-4e13-90fc-9312d603debb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:38.050635 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ecb6e-b619-4e13-90fc-9312d603debb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:38.052087 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ecb6e-b619-4e13-90fc-9312d603debb None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:38.063558 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 613/1218] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:28:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:38.070188 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8c3b1-3f79-468a-a563-e657958f18c5 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:38.177836 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8c3b1-3f79-468a-a563-e657958f18c5 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:38.207289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:38.212956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b61cde-c45f-4249-9a71-5db5308b83fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:38.213570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b61cde-c45f-4249-9a71-5db5308b83fe None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:38.213853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b61cde-c45f-4249-9a71-5db5308b83fe None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:38.214127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b61cde-c45f-4249-9a71-5db5308b83fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:38.214912 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b61cde-c45f-4249-9a71-5db5308b83fe None admin] RBAC: Adding query filter params (role.id=ff0af8236fc84d82bf84c8d2d11c11ca, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=aa971da983ea48c3b6d4c68a5d454bde) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:38.215222 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b61cde-c45f-4249-9a71-5db5308b83fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:38.216680 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b61cde-c45f-4249-9a71-5db5308b83fe None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:38.221941 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 606/1219] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:28:38 2022] GET /identity/v3/role_assignments?user.id=aa971da983ea48c3b6d4c68a5d454bde&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=ff0af8236fc84d82bf84c8d2d11c11ca => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:40.257555 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585ef8c-d9a5-483c-8e21-3d5801914d01 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:40.258130 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585ef8c-d9a5-483c-8e21-3d5801914d01 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:40.258130 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585ef8c-d9a5-483c-8e21-3d5801914d01 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:40.259511 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 614/1220] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:28:40.264805 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f33c64-bb17-4ac7-980a-6ea8dd66817c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:40.265222 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f33c64-bb17-4ac7-980a-6ea8dd66817c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:40.265360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f33c64-bb17-4ac7-980a-6ea8dd66817c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:40.285227 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-83f33c64-bb17-4ac7-980a-6ea8dd66817c None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:28:40.286444 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-83f33c64-bb17-4ac7-980a-6ea8dd66817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:28:40.355995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 607/1221] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:28:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:28:40.380209 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585ef8c-d9a5-483c-8e21-3d5801914d01 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:40.496645 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585ef8c-d9a5-483c-8e21-3d5801914d01 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:40.532825 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c819cd7-ff1b-45c1-a1bb-20982e62b2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:40.533415 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c819cd7-ff1b-45c1-a1bb-20982e62b2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:40.533697 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c819cd7-ff1b-45c1-a1bb-20982e62b2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:40.533970 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c819cd7-ff1b-45c1-a1bb-20982e62b2c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:40.544646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c819cd7-ff1b-45c1-a1bb-20982e62b2c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:28:40.549729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-5c819cd7-ff1b-45c1-a1bb-20982e62b2c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:28:40.549729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:40.549729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:40.549729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:40.549729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:40.549729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:40.549729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:40.549729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:40.549729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:40.549729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:40.549729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:40.549729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:40.549729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:28:40.549729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:28:40.549729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:28:40.549729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:28:40.550819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:28:40.550819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:28:40.550819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:28:40.550819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:28:40.550819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:40.550819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:40.550819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:40.550819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:40.550819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:40.550819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:40.550819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:40.550819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:40.550819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:40.550819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:40.550819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:40.550819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:40.552264 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:40.552264 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:40.552264 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:40.552264 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:40.552264 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:28:40.552264 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:28:40.552264 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:28:40.552264 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:28:40.552264 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:28:40.552264 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:28:40.552264 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:28:40.552264 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:28:40.552264 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 615/1222] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:28:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:40.557221 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f33c64-bb17-4ac7-980a-6ea8dd66817c None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:40.658601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f33c64-bb17-4ac7-980a-6ea8dd66817c None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:40.682297 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:40.693443 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb316f-6bbd-4af2-938a-9e14fea17a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:40.694064 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb316f-6bbd-4af2-938a-9e14fea17a82 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:40.694444 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb316f-6bbd-4af2-938a-9e14fea17a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:40.694724 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb316f-6bbd-4af2-938a-9e14fea17a82 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:40.695476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb316f-6bbd-4af2-938a-9e14fea17a82 None admin] RBAC: Adding query filter params (name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:40.695785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb316f-6bbd-4af2-938a-9e14fea17a82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:40.697160 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb316f-6bbd-4af2-938a-9e14fea17a82 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:40.705654 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 608/1223] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 18:28:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:40.711892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c819cd7-ff1b-45c1-a1bb-20982e62b2c0 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:40.757324 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:40.812340 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c819cd7-ff1b-45c1-a1bb-20982e62b2c0 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:40.847115 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e80826-de96-4817-b1e7-6d2d49a03f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:40.847789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e80826-de96-4817-b1e7-6d2d49a03f7c None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:40.848073 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e80826-de96-4817-b1e7-6d2d49a03f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:40.848350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e80826-de96-4817-b1e7-6d2d49a03f7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:40.859010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e80826-de96-4817-b1e7-6d2d49a03f7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:40.860491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e80826-de96-4817-b1e7-6d2d49a03f7c None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:40.876403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-73e80826-de96-4817-b1e7-6d2d49a03f7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:40.876403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:40.876403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:40.876403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:40.876403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:40.876403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:40.876403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:40.876403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:40.876403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:40.876403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:40.876403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:40.876403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:40.876403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:28:40.876403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:28:40.876403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:28:40.878128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:28:40.878128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:40.878128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:40.878128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:40.878128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:40.878128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:40.878128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:40.878128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:40.878128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:40.878128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:40.878128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:40.878128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:40.878128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:40.878128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:40.878128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:40.878128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:40.878128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:40.879052 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:28:40.879052 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:28:40.879052 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:40.879052 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:28:40.879052 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 616/1224] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:40.884079 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb316f-6bbd-4af2-938a-9e14fea17a82 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:40.987470 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb316f-6bbd-4af2-938a-9e14fea17a82 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:41.021852 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc959c1d-4676-4a88-90ad-e6523b02add6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:41.022495 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc959c1d-4676-4a88-90ad-e6523b02add6 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:41.022778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc959c1d-4676-4a88-90ad-e6523b02add6 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:41.023053 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc959c1d-4676-4a88-90ad-e6523b02add6 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:41.023774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc959c1d-4676-4a88-90ad-e6523b02add6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:41.031619 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc959c1d-4676-4a88-90ad-e6523b02add6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:41.031619 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc959c1d-4676-4a88-90ad-e6523b02add6 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:41.037253 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 609/1225] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:41.043193 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e80826-de96-4817-b1e7-6d2d49a03f7c None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:41.152563 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:41.159891 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e80826-de96-4817-b1e7-6d2d49a03f7c None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:41.194152 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f860d4-2511-4b41-aa4b-bc413f071153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:41.194783 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f860d4-2511-4b41-aa4b-bc413f071153 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:41.195060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f860d4-2511-4b41-aa4b-bc413f071153 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:41.195358 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f860d4-2511-4b41-aa4b-bc413f071153 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:41.202240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f860d4-2511-4b41-aa4b-bc413f071153 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:41.203751 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f860d4-2511-4b41-aa4b-bc413f071153 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:41.215900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-68f860d4-2511-4b41-aa4b-bc413f071153 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:28:41.215900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:41.215900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:41.215900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:41.215900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:41.215900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:41.215900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:41.215900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:41.215900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:41.215900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:41.215900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:41.215900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:41.215900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:28:41.215900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:28:41.215900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:28:41.215900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:28:41.226112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:41.226112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:41.226112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:28:41.226112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:28:41.226112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:28:41.226112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:28:41.226112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:41.226112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:41.226112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:41.226112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:41.226112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:41.226112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:41.226112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:41.226112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:41.226112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:41.226112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:41.226112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:41.226112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:41.227254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:41.227254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:41.227254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:28:41.227254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:28:41.227254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:28:41.227254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:28:41.227254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:28:41.227254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:28:41.227254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:28:41.227254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:28:41.227254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 617/1226] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:28:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:41.227988 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc959c1d-4676-4a88-90ad-e6523b02add6 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:41.271279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:41.323689 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc959c1d-4676-4a88-90ad-e6523b02add6 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:41.357602 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82ce86-36f4-4ea5-bc40-14040aa9d9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:41.358221 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82ce86-36f4-4ea5-bc40-14040aa9d9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:41.358503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82ce86-36f4-4ea5-bc40-14040aa9d9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:41.358779 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82ce86-36f4-4ea5-bc40-14040aa9d9e1 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:41.359664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82ce86-36f4-4ea5-bc40-14040aa9d9e1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:41.359971 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82ce86-36f4-4ea5-bc40-14040aa9d9e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:41.362013 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82ce86-36f4-4ea5-bc40-14040aa9d9e1 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:41.379556 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 610/1227] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Jul 27 18:28:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:41.386469 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f860d4-2511-4b41-aa4b-bc413f071153 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:41.493510 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f860d4-2511-4b41-aa4b-bc413f071153 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:41.527530 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9ba82-d051-43c7-929c-8bd4894d4066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:41.528167 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9ba82-d051-43c7-929c-8bd4894d4066 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:41.528446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9ba82-d051-43c7-929c-8bd4894d4066 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:41.528716 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9ba82-d051-43c7-929c-8bd4894d4066 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:41.540505 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9ba82-d051-43c7-929c-8bd4894d4066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:41.541980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9ba82-d051-43c7-929c-8bd4894d4066 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:41.557733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-49e9ba82-d051-43c7-929c-8bd4894d4066 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:41.557733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:41.557733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:41.557733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:41.557733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:41.557733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:41.557733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:41.557733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:41.557733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:41.557733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:41.557733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:41.557733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:41.557733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:28:41.557733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:28:41.557733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:28:41.558852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:28:41.558852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:41.558852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:41.558852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:41.558852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:41.558852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:41.558852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:41.558852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:41.558852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:41.558852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:41.558852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:41.558852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:41.558852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:41.558852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:41.558852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:41.558852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:41.558852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:41.560207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:28:41.560207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:28:41.560207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:41.560207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:28:41.560207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 618/1228] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:41.565215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82ce86-36f4-4ea5-bc40-14040aa9d9e1 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:41.666142 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82ce86-36f4-4ea5-bc40-14040aa9d9e1 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:41.668673 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:41.699863 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dd3d9-41ac-43ee-92ef-39d01b75de18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:41.700475 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dd3d9-41ac-43ee-92ef-39d01b75de18 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:41.700763 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dd3d9-41ac-43ee-92ef-39d01b75de18 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:41.701038 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dd3d9-41ac-43ee-92ef-39d01b75de18 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:41.701785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1dd3d9-41ac-43ee-92ef-39d01b75de18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:41.702088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1dd3d9-41ac-43ee-92ef-39d01b75de18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:41.703469 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1dd3d9-41ac-43ee-92ef-39d01b75de18 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:41.715109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 611/1229] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:28:41.721731 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9ba82-d051-43c7-929c-8bd4894d4066 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:41.731136 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:41.821011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9ba82-d051-43c7-929c-8bd4894d4066 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:41.854727 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a9f06-036e-4a13-8d41-ed8f34a7cea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:41.855388 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a9f06-036e-4a13-8d41-ed8f34a7cea0 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:41.855673 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a9f06-036e-4a13-8d41-ed8f34a7cea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:41.855949 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a9f06-036e-4a13-8d41-ed8f34a7cea0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:41.862553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a9f06-036e-4a13-8d41-ed8f34a7cea0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:41.864042 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a9f06-036e-4a13-8d41-ed8f34a7cea0 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:41.875622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-605a9f06-036e-4a13-8d41-ed8f34a7cea0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:28:41.875622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:41.875622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:41.875622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:41.875622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:41.875622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:41.875622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:41.875622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:41.875622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:41.875622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:41.875622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:41.875622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:41.875622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:28:41.875622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:28:41.875622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:28:41.877239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:28:41.877239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:41.877239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:41.877239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:41.877239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:41.877239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:41.877239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:41.877239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:41.877239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:41.877239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:41.877239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:41.877239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:41.877239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:41.877239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:41.877239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:41.877239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:41.877239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:41.878341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:28:41.878341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:28:41.878341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:28:41.878341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:28:41.878341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:28:41.878341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:28:41.878341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:28:41.878341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:28:41.878341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 619/1230] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:28:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:41.884330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dd3d9-41ac-43ee-92ef-39d01b75de18 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:41.986483 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dd3d9-41ac-43ee-92ef-39d01b75de18 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:42.021186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36dc907-b78c-4ad6-829d-608cdd8de05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:42.021801 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dc907-b78c-4ad6-829d-608cdd8de05e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:42.022081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dc907-b78c-4ad6-829d-608cdd8de05e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:42.022352 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dc907-b78c-4ad6-829d-608cdd8de05e None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:42.023117 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36dc907-b78c-4ad6-829d-608cdd8de05e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:42.023432 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36dc907-b78c-4ad6-829d-608cdd8de05e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:42.024877 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36dc907-b78c-4ad6-829d-608cdd8de05e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:42.036905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 612/1231] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:28:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:42.043004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a9f06-036e-4a13-8d41-ed8f34a7cea0 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:42.109642 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:42.144634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a9f06-036e-4a13-8d41-ed8f34a7cea0 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:42.177136 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096dbc26-e8aa-4393-8d72-1294a6227d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:42.177807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096dbc26-e8aa-4393-8d72-1294a6227d9c None admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:42.178091 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096dbc26-e8aa-4393-8d72-1294a6227d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:42.178370 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096dbc26-e8aa-4393-8d72-1294a6227d9c None admin] PATH_INFO: `/v3/projects/2880a34079d742c38bfdace2c04564c7/users/aa971da983ea48c3b6d4c68a5d454bde/roles/ff0af8236fc84d82bf84c8d2d11c11ca` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:42.197535 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096dbc26-e8aa-4393-8d72-1294a6227d9c None admin] RBAC: Authorizing `identity:create_grant(project_id=2880a34079d742c38bfdace2c04564c7, user_id=aa971da983ea48c3b6d4c68a5d454bde, role_id=ff0af8236fc84d82bf84c8d2d11c11ca)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:42.198989 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096dbc26-e8aa-4393-8d72-1294a6227d9c None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:42.317248 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 620/1232] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:28:42 2022] PUT /identity/v3/projects/2880a34079d742c38bfdace2c04564c7/users/aa971da983ea48c3b6d4c68a5d454bde/roles/ff0af8236fc84d82bf84c8d2d11c11ca => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:28:44.344226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d4112-2674-4bfd-8fc3-0fedce24f8fe None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:44.345157 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d4112-2674-4bfd-8fc3-0fedce24f8fe None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:44.345157 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d4112-2674-4bfd-8fc3-0fedce24f8fe None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:44.347118 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 613/1233] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:28:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:28:44.352464 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ab3ec-8b69-4c34-b00a-420c1c94892f None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:44.352908 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ab3ec-8b69-4c34-b00a-420c1c94892f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:44.353009 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ab3ec-8b69-4c34-b00a-420c1c94892f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:44.371973 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-946ab3ec-8b69-4c34-b00a-420c1c94892f None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:28:44.373188 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-946ab3ec-8b69-4c34-b00a-420c1c94892f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:28:44.442290 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 621/1234] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:28:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:28:44.466190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d4112-2674-4bfd-8fc3-0fedce24f8fe None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:44.491969 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:44.567742 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d4112-2674-4bfd-8fc3-0fedce24f8fe None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:44.602051 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94312ba-746c-4680-8fb3-58cf2967843b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:44.602608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94312ba-746c-4680-8fb3-58cf2967843b None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:44.602885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94312ba-746c-4680-8fb3-58cf2967843b None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:44.603348 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94312ba-746c-4680-8fb3-58cf2967843b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:44.613395 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94312ba-746c-4680-8fb3-58cf2967843b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:28:44.618257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-c94312ba-746c-4680-8fb3-58cf2967843b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:28:44.618257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:44.618257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:44.618257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:44.618257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:44.618257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:44.618257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:44.618257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:44.618257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:44.618257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:44.618257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:44.618257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:44.618257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:28:44.618257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:28:44.618257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:28:44.618257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:28:44.619402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:28:44.619402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:28:44.619402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:28:44.619402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:28:44.619402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:44.619402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:44.619402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:44.619402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:44.619402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:44.619402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:44.619402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:44.619402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:44.619402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:44.619402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:44.619402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:44.619402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:44.620723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:44.620723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:44.620723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:44.620723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:44.620723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:28:44.620723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:28:44.620723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:28:44.620723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:28:44.620723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:28:44.620723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:28:44.620723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:28:44.620723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:28:44.620723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 614/1235] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 18:28:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:44.625970 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ab3ec-8b69-4c34-b00a-420c1c94892f None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:44.674506 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:44.727541 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ab3ec-8b69-4c34-b00a-420c1c94892f None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:44.761094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c6cdf-b891-4e46-b5cb-043fef8d00a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:44.763843 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c6cdf-b891-4e46-b5cb-043fef8d00a0 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:44.763843 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c6cdf-b891-4e46-b5cb-043fef8d00a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:44.763843 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c6cdf-b891-4e46-b5cb-043fef8d00a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:44.763843 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c6cdf-b891-4e46-b5cb-043fef8d00a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:44.763843 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c6cdf-b891-4e46-b5cb-043fef8d00a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:44.764647 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c6cdf-b891-4e46-b5cb-043fef8d00a0 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:44.773038 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 622/1236] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 18:28:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:44.778992 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94312ba-746c-4680-8fb3-58cf2967843b None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:44.863336 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:44.880808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94312ba-746c-4680-8fb3-58cf2967843b None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:44.919387 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348f77c-81eb-4168-8032-e4f2fc0bc860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:44.920028 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348f77c-81eb-4168-8032-e4f2fc0bc860 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:44.920312 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348f77c-81eb-4168-8032-e4f2fc0bc860 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:44.920588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348f77c-81eb-4168-8032-e4f2fc0bc860 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:44.931836 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348f77c-81eb-4168-8032-e4f2fc0bc860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:44.934057 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348f77c-81eb-4168-8032-e4f2fc0bc860 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:44.949244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-a348f77c-81eb-4168-8032-e4f2fc0bc860 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:44.949244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:44.949244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:44.949244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:44.949244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:44.949244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:44.949244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:44.949244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:44.949244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:44.949244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:44.949244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:44.949244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:44.949244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:28:44.949244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:28:44.949244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:28:44.956293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:28:44.956293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:44.956293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:44.956293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:44.956293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:44.956293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:44.956293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:44.956293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:44.956293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:44.956293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:44.956293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:44.956293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:44.956293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:44.956293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:44.956293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:44.956293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:44.956293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:44.957415 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:28:44.957415 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:28:44.957415 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:44.957415 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:28:44.957415 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 615/1237] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:44.957754 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c6cdf-b891-4e46-b5cb-043fef8d00a0 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:45.056226 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c6cdf-b891-4e46-b5cb-043fef8d00a0 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:45.065549 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:45.089940 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6dff9-be8e-4df1-8df7-c32749a626f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:45.090563 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6dff9-be8e-4df1-8df7-c32749a626f6 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:45.090843 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6dff9-be8e-4df1-8df7-c32749a626f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:45.091116 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6dff9-be8e-4df1-8df7-c32749a626f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:45.091873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6dff9-be8e-4df1-8df7-c32749a626f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:45.092175 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6dff9-be8e-4df1-8df7-c32749a626f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:45.093544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6dff9-be8e-4df1-8df7-c32749a626f6 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:45.105027 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 623/1238] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:45.110750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348f77c-81eb-4168-8032-e4f2fc0bc860 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:45.213808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348f77c-81eb-4168-8032-e4f2fc0bc860 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:45.248165 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70ebd3-a675-455a-9a4b-d6dd8c2baa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:45.248804 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70ebd3-a675-455a-9a4b-d6dd8c2baa4c None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:45.249091 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70ebd3-a675-455a-9a4b-d6dd8c2baa4c None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:45.249378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70ebd3-a675-455a-9a4b-d6dd8c2baa4c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:45.253587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:45.259051 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70ebd3-a675-455a-9a4b-d6dd8c2baa4c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:45.260563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70ebd3-a675-455a-9a4b-d6dd8c2baa4c None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:45.272264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-6f70ebd3-a675-455a-9a4b-d6dd8c2baa4c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:28:45.272264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:45.272264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:45.272264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:45.272264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:45.272264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:45.272264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:45.272264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:45.272264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:45.272264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:45.272264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:45.272264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:45.272264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:28:45.272264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:28:45.272264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:28:45.272264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:28:45.273458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:45.273458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:45.273458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:28:45.273458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:28:45.273458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:28:45.273458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:28:45.273458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:45.273458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:45.273458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:45.273458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:45.273458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:45.273458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:45.273458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:45.273458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:45.273458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:45.273458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:45.273458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:45.273458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:45.274620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:45.274620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:45.274620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:28:45.274620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:28:45.274620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:28:45.274620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:28:45.274620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:28:45.274620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:28:45.274620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:28:45.274620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:28:45.274620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 616/1239] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:28:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:45.279316 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6dff9-be8e-4df1-8df7-c32749a626f6 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:45.380386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6dff9-be8e-4df1-8df7-c32749a626f6 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:45.414687 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667929b9-6065-487f-927b-51527eba20fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:45.415327 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667929b9-6065-487f-927b-51527eba20fa None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:45.415669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667929b9-6065-487f-927b-51527eba20fa None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:45.415972 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667929b9-6065-487f-927b-51527eba20fa None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:45.416767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667929b9-6065-487f-927b-51527eba20fa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:45.417076 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667929b9-6065-487f-927b-51527eba20fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:45.418567 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667929b9-6065-487f-927b-51527eba20fa None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:45.436225 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 624/1240] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Jul 27 18:28:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:45.442633 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70ebd3-a675-455a-9a4b-d6dd8c2baa4c None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:45.551043 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70ebd3-a675-455a-9a4b-d6dd8c2baa4c None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:45.590783 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862e1fc-2b0e-4b18-8dff-91240526a65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:45.591432 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862e1fc-2b0e-4b18-8dff-91240526a65f None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:45.591716 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862e1fc-2b0e-4b18-8dff-91240526a65f None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:45.591992 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862e1fc-2b0e-4b18-8dff-91240526a65f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:45.654445 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:45.661547 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862e1fc-2b0e-4b18-8dff-91240526a65f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:45.663011 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862e1fc-2b0e-4b18-8dff-91240526a65f None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:45.760329 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 617/1241] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:28:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:28:45.766168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667929b9-6065-487f-927b-51527eba20fa None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:45.793485 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:45.872916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667929b9-6065-487f-927b-51527eba20fa None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:45.910268 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a147a-b17a-49fb-af15-190f7cb8f84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:45.910912 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a147a-b17a-49fb-af15-190f7cb8f84c None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:45.911186 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a147a-b17a-49fb-af15-190f7cb8f84c None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:45.911501 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a147a-b17a-49fb-af15-190f7cb8f84c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:45.921846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a147a-b17a-49fb-af15-190f7cb8f84c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:45.923394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a147a-b17a-49fb-af15-190f7cb8f84c None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:45.938675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-646a147a-b17a-49fb-af15-190f7cb8f84c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:45.938675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:45.938675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:45.938675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:45.938675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:45.938675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:45.938675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:45.938675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:45.938675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:45.938675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:45.938675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:45.938675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:45.938675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:28:45.938675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:28:45.938675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:28:45.939835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:28:45.939835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:45.939835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:45.939835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:45.939835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:45.939835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:45.939835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:45.939835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:45.939835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:45.939835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:45.939835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:45.939835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:45.939835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:45.939835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:45.939835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:45.939835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:45.939835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:45.941069 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:28:45.941069 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:28:45.941069 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:45.941069 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:28:45.941069 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 625/1242] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:45.946089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862e1fc-2b0e-4b18-8dff-91240526a65f None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:46.047022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:46.052634 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862e1fc-2b0e-4b18-8dff-91240526a65f None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:46.087155 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9ed76-1709-4252-9f22-4c262859a906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:46.087803 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9ed76-1709-4252-9f22-4c262859a906 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:46.088089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9ed76-1709-4252-9f22-4c262859a906 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:46.088366 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9ed76-1709-4252-9f22-4c262859a906 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:46.089057 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9ed76-1709-4252-9f22-4c262859a906 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:46.089364 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9ed76-1709-4252-9f22-4c262859a906 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:46.090730 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9ed76-1709-4252-9f22-4c262859a906 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:46.102776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 618/1243] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:46.108574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a147a-b17a-49fb-af15-190f7cb8f84c None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:46.188444 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:46.209770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a147a-b17a-49fb-af15-190f7cb8f84c None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:46.242302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00784829-f0ca-438c-a503-523b403a8c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:46.242948 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00784829-f0ca-438c-a503-523b403a8c2d None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:46.243229 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00784829-f0ca-438c-a503-523b403a8c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:46.243540 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00784829-f0ca-438c-a503-523b403a8c2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:46.250296 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00784829-f0ca-438c-a503-523b403a8c2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:46.251811 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00784829-f0ca-438c-a503-523b403a8c2d None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:46.263114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-00784829-f0ca-438c-a503-523b403a8c2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:28:46.263114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:46.263114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:46.263114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:46.263114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:46.263114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:46.263114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:46.263114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:46.263114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:46.263114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:46.263114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:46.263114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:46.263114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:28:46.263114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:28:46.263114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:28:46.264241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:28:46.264241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:46.264241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:46.264241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:46.264241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:46.264241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:46.264241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:46.264241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:46.264241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:46.264241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:46.264241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:46.264241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:46.264241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:46.264241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:46.264241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:46.264241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:46.264241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:46.265546 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:28:46.265546 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:28:46.265546 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:28:46.265546 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:28:46.265546 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:28:46.265546 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:28:46.265546 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:28:46.265546 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:28:46.265546 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 626/1244] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:28:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:46.270729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9ed76-1709-4252-9f22-4c262859a906 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:46.372791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9ed76-1709-4252-9f22-4c262859a906 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:46.408327 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aabff7-a75c-48e0-a3d8-ea0537f83142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:46.409152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aabff7-a75c-48e0-a3d8-ea0537f83142 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:46.409440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aabff7-a75c-48e0-a3d8-ea0537f83142 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:46.409720 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aabff7-a75c-48e0-a3d8-ea0537f83142 None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:46.410486 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aabff7-a75c-48e0-a3d8-ea0537f83142 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:46.410791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aabff7-a75c-48e0-a3d8-ea0537f83142 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:46.412278 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aabff7-a75c-48e0-a3d8-ea0537f83142 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:46.424966 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 619/1245] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:28:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:46.431397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00784829-f0ca-438c-a503-523b403a8c2d None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:46.531494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00784829-f0ca-438c-a503-523b403a8c2d None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:46.565781 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c05028-7d4b-48c4-9a84-504136005427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:46.566412 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c05028-7d4b-48c4-9a84-504136005427 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:46.566697 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c05028-7d4b-48c4-9a84-504136005427 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:46.566975 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c05028-7d4b-48c4-9a84-504136005427 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:46.567810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c05028-7d4b-48c4-9a84-504136005427 None admin] RBAC: Adding query filter params (role.id=ff0af8236fc84d82bf84c8d2d11c11ca, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=aa971da983ea48c3b6d4c68a5d454bde) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:46.568122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c05028-7d4b-48c4-9a84-504136005427 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:46.569605 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c05028-7d4b-48c4-9a84-504136005427 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:46.575320 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 627/1246] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:28:46 2022] GET /identity/v3/role_assignments?user.id=aa971da983ea48c3b6d4c68a5d454bde&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=ff0af8236fc84d82bf84c8d2d11c11ca => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:48.679023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232598b-ba83-44b1-aac7-a92c044b8d80 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:48.679629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232598b-ba83-44b1-aac7-a92c044b8d80 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:48.679629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232598b-ba83-44b1-aac7-a92c044b8d80 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:48.681014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 620/1247] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:28:48.686228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae396d14-cdf0-4cf9-a089-57363da03746 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:48.686684 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae396d14-cdf0-4cf9-a089-57363da03746 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:48.686776 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae396d14-cdf0-4cf9-a089-57363da03746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:48.693158 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:48.705141 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-ae396d14-cdf0-4cf9-a089-57363da03746 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:28:48.706315 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ae396d14-cdf0-4cf9-a089-57363da03746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:28:48.773323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 628/1248] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:28:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:28:48.796914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232598b-ba83-44b1-aac7-a92c044b8d80 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:48.815992 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:48.901117 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232598b-ba83-44b1-aac7-a92c044b8d80 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:48.935802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200713c-9185-46f5-bb4a-d64bca2ccb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:48.936437 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200713c-9185-46f5-bb4a-d64bca2ccb26 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:48.936719 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200713c-9185-46f5-bb4a-d64bca2ccb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:48.936990 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200713c-9185-46f5-bb4a-d64bca2ccb26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:48.947007 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200713c-9185-46f5-bb4a-d64bca2ccb26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:28:48.952005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-8200713c-9185-46f5-bb4a-d64bca2ccb26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:28:48.952005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:48.952005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:48.952005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:48.952005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:48.952005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:48.952005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:48.952005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:48.952005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:48.952005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:48.952005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:48.952005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:48.952005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:28:48.952005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:28:48.952005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:28:48.952005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:28:48.953147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:28:48.953147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:28:48.953147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:28:48.953147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:28:48.953147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:48.953147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:48.953147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:48.953147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:48.953147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:48.953147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:48.953147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:48.953147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:48.953147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:48.953147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:48.953147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:48.953147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:48.954488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:48.954488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:48.954488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:48.954488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:48.954488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:28:48.954488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:28:48.954488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:28:48.954488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:28:48.954488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:28:48.954488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:28:48.954488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:28:48.954488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:28:48.954488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 621/1249] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:28:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:48.960257 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae396d14-cdf0-4cf9-a089-57363da03746 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:49.059151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae396d14-cdf0-4cf9-a089-57363da03746 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:49.090240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:49.094086 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8d7e6-0253-401f-b1b4-85c0d9b5f69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:49.094711 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8d7e6-0253-401f-b1b4-85c0d9b5f69a None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:49.094995 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8d7e6-0253-401f-b1b4-85c0d9b5f69a None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:49.095930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8d7e6-0253-401f-b1b4-85c0d9b5f69a None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:49.096663 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8d7e6-0253-401f-b1b4-85c0d9b5f69a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:49.096975 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8d7e6-0253-401f-b1b4-85c0d9b5f69a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:49.098382 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8d7e6-0253-401f-b1b4-85c0d9b5f69a None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:49.106498 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 629/1250] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:28:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:49.112393 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200713c-9185-46f5-bb4a-d64bca2ccb26 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:49.189149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:49.212363 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200713c-9185-46f5-bb4a-d64bca2ccb26 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:49.248004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4654b-5354-4e3c-9b96-bdc009ccb8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:49.248638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4654b-5354-4e3c-9b96-bdc009ccb8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:49.248915 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4654b-5354-4e3c-9b96-bdc009ccb8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:49.249184 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4654b-5354-4e3c-9b96-bdc009ccb8e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:49.259023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4654b-5354-4e3c-9b96-bdc009ccb8e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:49.260597 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4654b-5354-4e3c-9b96-bdc009ccb8e4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:49.275206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-17c4654b-5354-4e3c-9b96-bdc009ccb8e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:49.275206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:49.275206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:49.275206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:49.275206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:49.275206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:49.275206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:49.275206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:49.275206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:49.275206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:49.275206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:49.275206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:49.275206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:28:49.275206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:28:49.275206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:28:49.276283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:28:49.276283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:49.276283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:49.276283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:49.276283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:49.276283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:49.276283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:49.276283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:49.276283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:49.276283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:49.276283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:49.276283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:49.276283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:49.276283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:49.276283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:49.276283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:49.276283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:49.277566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:28:49.277566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:28:49.277566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:49.277566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:28:49.277566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 622/1251] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:49.282265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8d7e6-0253-401f-b1b4-85c0d9b5f69a None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:49.381210 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8d7e6-0253-401f-b1b4-85c0d9b5f69a None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:49.416522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586461ab-7a9f-4cd7-a4dc-cb5f5d3c258f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:49.417201 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586461ab-7a9f-4cd7-a4dc-cb5f5d3c258f None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:49.417487 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586461ab-7a9f-4cd7-a4dc-cb5f5d3c258f None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:49.417767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586461ab-7a9f-4cd7-a4dc-cb5f5d3c258f None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:49.418472 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586461ab-7a9f-4cd7-a4dc-cb5f5d3c258f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:49.418782 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586461ab-7a9f-4cd7-a4dc-cb5f5d3c258f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:49.420504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586461ab-7a9f-4cd7-a4dc-cb5f5d3c258f None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:49.432892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 630/1252] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:49.438600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4654b-5354-4e3c-9b96-bdc009ccb8e4 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:49.544410 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4654b-5354-4e3c-9b96-bdc009ccb8e4 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:49.571234 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:49.578890 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b50a8-a3f1-4f70-914e-75849229a1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:49.579691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b50a8-a3f1-4f70-914e-75849229a1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:49.580682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b50a8-a3f1-4f70-914e-75849229a1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:49.581097 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b50a8-a3f1-4f70-914e-75849229a1b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:49.588603 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b50a8-a3f1-4f70-914e-75849229a1b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:49.590048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b50a8-a3f1-4f70-914e-75849229a1b8 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:49.601131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-710b50a8-a3f1-4f70-914e-75849229a1b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:28:49.601131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:49.601131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:49.601131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:49.601131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:49.601131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:49.601131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:49.601131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:49.601131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:49.601131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:49.601131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:49.601131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:49.601131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:28:49.601131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:28:49.601131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:28:49.601131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:28:49.602282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:49.602282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:49.602282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:28:49.602282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:28:49.602282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:28:49.602282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:28:49.602282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:49.602282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:49.602282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:49.602282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:49.602282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:49.602282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:49.602282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:49.602282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:49.602282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:49.602282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:49.602282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:49.602282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:49.603576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:49.603576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:49.603576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:28:49.603576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:28:49.603576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:28:49.603576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:28:49.603576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:28:49.603576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:28:49.603576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:28:49.603576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:28:49.603576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 623/1253] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:28:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:49.608139 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586461ab-7a9f-4cd7-a4dc-cb5f5d3c258f None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:49.665119 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:49.708346 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586461ab-7a9f-4cd7-a4dc-cb5f5d3c258f None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:49.741600 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415ab14-23b3-459c-89f2-b3f47aa57ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:49.742205 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415ab14-23b3-459c-89f2-b3f47aa57ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:49.742496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415ab14-23b3-459c-89f2-b3f47aa57ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:49.742772 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415ab14-23b3-459c-89f2-b3f47aa57ee6 None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:49.743600 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415ab14-23b3-459c-89f2-b3f47aa57ee6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:49.743912 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415ab14-23b3-459c-89f2-b3f47aa57ee6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:49.745617 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415ab14-23b3-459c-89f2-b3f47aa57ee6 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:49.764156 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 631/1254] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Jul 27 18:28:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:49.770148 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b50a8-a3f1-4f70-914e-75849229a1b8 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:49.870276 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b50a8-a3f1-4f70-914e-75849229a1b8 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:49.905732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49439605-56e0-4fee-8db5-727ced563cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:49.906346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49439605-56e0-4fee-8db5-727ced563cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:49.906625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49439605-56e0-4fee-8db5-727ced563cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:49.906894 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49439605-56e0-4fee-8db5-727ced563cf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:49.969347 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:49.982190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49439605-56e0-4fee-8db5-727ced563cf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:49.983701 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49439605-56e0-4fee-8db5-727ced563cf0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:50.084235 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 624/1255] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:28:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:28:50.090209 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415ab14-23b3-459c-89f2-b3f47aa57ee6 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:50.189545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415ab14-23b3-459c-89f2-b3f47aa57ee6 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:50.203339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:50.224855 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6437fb2-cf5d-4382-a8a8-3f996adf40f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:50.225428 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6437fb2-cf5d-4382-a8a8-3f996adf40f8 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:50.225713 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6437fb2-cf5d-4382-a8a8-3f996adf40f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:50.225993 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6437fb2-cf5d-4382-a8a8-3f996adf40f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:50.235920 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6437fb2-cf5d-4382-a8a8-3f996adf40f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:50.240195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6437fb2-cf5d-4382-a8a8-3f996adf40f8 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:50.251958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-f6437fb2-cf5d-4382-a8a8-3f996adf40f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:50.251958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:50.251958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:50.251958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:50.251958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:50.251958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:50.251958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:50.251958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:50.251958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:50.251958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:50.251958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:50.251958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:50.251958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:28:50.251958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:28:50.251958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:28:50.253531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:28:50.253531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:50.253531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:50.253531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:50.253531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:50.253531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:50.253531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:50.253531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:50.253531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:50.253531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:50.253531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:50.253531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:50.253531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:50.253531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:50.253531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:50.253531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:50.253531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:50.254818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:28:50.254818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:28:50.254818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:50.254818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:28:50.254818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 632/1256] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:50.259573 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49439605-56e0-4fee-8db5-727ced563cf0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:50.347722 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:50.359598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49439605-56e0-4fee-8db5-727ced563cf0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:50.399427 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fd7da-0685-4ce9-b233-727d620e1cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:50.400059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fd7da-0685-4ce9-b233-727d620e1cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:50.400362 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fd7da-0685-4ce9-b233-727d620e1cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:50.400621 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fd7da-0685-4ce9-b233-727d620e1cf0 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:50.401424 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fd7da-0685-4ce9-b233-727d620e1cf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:50.401729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fd7da-0685-4ce9-b233-727d620e1cf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:50.403118 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fd7da-0685-4ce9-b233-727d620e1cf0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:50.415662 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 625/1257] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:50.421461 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6437fb2-cf5d-4382-a8a8-3f996adf40f8 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:50.524214 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6437fb2-cf5d-4382-a8a8-3f996adf40f8 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:50.558478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873267d-9376-4a72-b848-562aae3d6c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:50.559123 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873267d-9376-4a72-b848-562aae3d6c2a None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:50.559442 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873267d-9376-4a72-b848-562aae3d6c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:50.559722 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873267d-9376-4a72-b848-562aae3d6c2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:50.567370 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873267d-9376-4a72-b848-562aae3d6c2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:50.568825 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873267d-9376-4a72-b848-562aae3d6c2a None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:50.580379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-f873267d-9376-4a72-b848-562aae3d6c2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:28:50.580379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:50.580379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:50.580379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:50.580379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:50.580379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:50.580379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:50.580379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:50.580379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:50.580379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:50.580379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:50.580379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:50.580379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:28:50.580379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:28:50.580379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:28:50.582174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:28:50.582174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:50.582174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:50.582174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:50.582174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:50.582174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:50.582174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:50.582174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:50.582174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:50.582174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:50.582174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:50.582174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:50.582174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:50.582174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:50.582174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:50.582174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:50.582174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:50.583202 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:28:50.583202 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:28:50.583202 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:28:50.583202 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:28:50.583202 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:28:50.583202 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:28:50.583202 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:28:50.583202 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:28:50.583202 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 633/1258] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:28:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:50.588345 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fd7da-0685-4ce9-b233-727d620e1cf0 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:50.688739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fd7da-0685-4ce9-b233-727d620e1cf0 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:50.723048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ab307-c076-4d1a-8bb9-d5119c0837ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:50.723693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ab307-c076-4d1a-8bb9-d5119c0837ea None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:50.723975 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ab307-c076-4d1a-8bb9-d5119c0837ea None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:50.724246 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ab307-c076-4d1a-8bb9-d5119c0837ea None admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:50.724994 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ab307-c076-4d1a-8bb9-d5119c0837ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:50.725296 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ab307-c076-4d1a-8bb9-d5119c0837ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:50.726729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ab307-c076-4d1a-8bb9-d5119c0837ea None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:50.738607 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 626/1259] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:28:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:50.745241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873267d-9376-4a72-b848-562aae3d6c2a None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:50.771644 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:50.846277 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873267d-9376-4a72-b848-562aae3d6c2a None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:50.880614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286710d-c818-4540-8427-105d5cb015f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:50.881234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286710d-c818-4540-8427-105d5cb015f0 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:50.881521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286710d-c818-4540-8427-105d5cb015f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:50.881800 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286710d-c818-4540-8427-105d5cb015f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:50.882591 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286710d-c818-4540-8427-105d5cb015f0 None admin] RBAC: Adding query filter params (role.id=4ae8d11d74f14bcc80117d897ba2f5b6, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=aa971da983ea48c3b6d4c68a5d454bde) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:50.882908 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286710d-c818-4540-8427-105d5cb015f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:50.884393 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286710d-c818-4540-8427-105d5cb015f0 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:50.890132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 634/1260] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:28:50 2022] GET /identity/v3/role_assignments?user.id=aa971da983ea48c3b6d4c68a5d454bde&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=4ae8d11d74f14bcc80117d897ba2f5b6 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:52.893701 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddeca1-cef1-4e0e-90b5-32c32402f451 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:52.894367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddeca1-cef1-4e0e-90b5-32c32402f451 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:52.894490 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddeca1-cef1-4e0e-90b5-32c32402f451 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:52.895935 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 627/1261] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:28:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:28:52.901210 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b38e0-9eb8-4f42-9fa7-b9e9c734c387 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:52.901611 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b38e0-9eb8-4f42-9fa7-b9e9c734c387 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:52.906459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b38e0-9eb8-4f42-9fa7-b9e9c734c387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:52.921018 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-973b38e0-9eb8-4f42-9fa7-b9e9c734c387 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:28:52.922217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-973b38e0-9eb8-4f42-9fa7-b9e9c734c387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:28:52.998595 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 635/1262] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:28:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:28:53.021681 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddeca1-cef1-4e0e-90b5-32c32402f451 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:53.032802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:53.124020 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddeca1-cef1-4e0e-90b5-32c32402f451 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:53.157962 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fac23f-33aa-476e-ae8d-6569b01e92ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:53.158523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fac23f-33aa-476e-ae8d-6569b01e92ee None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:53.159391 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fac23f-33aa-476e-ae8d-6569b01e92ee None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:53.159694 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fac23f-33aa-476e-ae8d-6569b01e92ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:53.169758 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fac23f-33aa-476e-ae8d-6569b01e92ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:28:53.175192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-36fac23f-33aa-476e-ae8d-6569b01e92ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:28:53.175192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:53.175192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:53.175192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:53.175192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:53.175192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:53.175192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:53.175192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:53.175192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:53.175192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:53.175192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:53.175192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:53.175192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:28:53.175192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:28:53.175192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:28:53.175192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:28:53.176479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:28:53.176479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:28:53.176479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:28:53.176479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:28:53.176479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:53.176479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:53.176479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:53.176479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:53.176479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:53.176479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:53.176479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:53.176479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:53.176479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:53.176479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:53.176479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:53.176479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:53.177343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:53.177343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:53.177343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:53.177343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:53.177343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:28:53.177343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:28:53.177343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:28:53.177343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:28:53.177343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:28:53.177343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:28:53.177343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:28:53.177343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:28:53.177343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 628/1263] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:28:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:28:53.182614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b38e0-9eb8-4f42-9fa7-b9e9c734c387 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:53.201017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:53.300680 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b38e0-9eb8-4f42-9fa7-b9e9c734c387 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:53.337007 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afeafd6-d04d-4be9-9e18-e60c75ae8a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:53.337635 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afeafd6-d04d-4be9-9e18-e60c75ae8a6a None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:53.337914 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afeafd6-d04d-4be9-9e18-e60c75ae8a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:53.338235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afeafd6-d04d-4be9-9e18-e60c75ae8a6a None admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:53.338972 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afeafd6-d04d-4be9-9e18-e60c75ae8a6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:53.339461 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afeafd6-d04d-4be9-9e18-e60c75ae8a6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:53.341053 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afeafd6-d04d-4be9-9e18-e60c75ae8a6a None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:53.349957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 636/1264] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:28:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:53.356021 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fac23f-33aa-476e-ae8d-6569b01e92ee None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:53.430416 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:53.463971 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fac23f-33aa-476e-ae8d-6569b01e92ee None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:53.497969 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fad1cf-2912-4b4c-b5dc-82a02ea547b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:53.498518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fad1cf-2912-4b4c-b5dc-82a02ea547b7 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:53.499236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fad1cf-2912-4b4c-b5dc-82a02ea547b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:53.499236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fad1cf-2912-4b4c-b5dc-82a02ea547b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:53.510262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fad1cf-2912-4b4c-b5dc-82a02ea547b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:53.511765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fad1cf-2912-4b4c-b5dc-82a02ea547b7 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:53.526103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-b4fad1cf-2912-4b4c-b5dc-82a02ea547b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:53.526103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:53.526103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:53.526103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:53.526103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:53.526103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:53.526103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:53.526103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:53.526103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:53.526103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:53.526103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:53.526103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:53.526103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:28:53.526103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:28:53.526103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:28:53.527163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:28:53.527163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:53.527163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:53.527163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:53.527163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:53.527163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:53.527163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:53.527163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:53.527163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:53.527163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:53.527163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:53.527163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:53.527163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:53.527163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:53.527163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:53.527163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:53.527163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:53.528378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:28:53.528378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:28:53.528378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:53.528378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:28:53.528378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 629/1265] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:53.533457 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afeafd6-d04d-4be9-9e18-e60c75ae8a6a None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:53.635448 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:53.656346 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afeafd6-d04d-4be9-9e18-e60c75ae8a6a None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:53.691254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f79936-cea1-43b6-8d77-3ef13fb8bb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:53.691840 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f79936-cea1-43b6-8d77-3ef13fb8bb4a None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:53.692129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f79936-cea1-43b6-8d77-3ef13fb8bb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:53.692405 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f79936-cea1-43b6-8d77-3ef13fb8bb4a None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:53.693159 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f79936-cea1-43b6-8d77-3ef13fb8bb4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:53.693465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f79936-cea1-43b6-8d77-3ef13fb8bb4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:53.694875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f79936-cea1-43b6-8d77-3ef13fb8bb4a None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:53.707101 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 637/1266] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:28:53.712758 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fad1cf-2912-4b4c-b5dc-82a02ea547b7 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:53.825096 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fad1cf-2912-4b4c-b5dc-82a02ea547b7 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:53.846490 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:53.860804 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb21aeb-d4ba-4272-b9d8-5030dc7baeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:53.861734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb21aeb-d4ba-4272-b9d8-5030dc7baeeb None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:53.862231 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb21aeb-d4ba-4272-b9d8-5030dc7baeeb None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:53.862738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb21aeb-d4ba-4272-b9d8-5030dc7baeeb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:53.875329 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb21aeb-d4ba-4272-b9d8-5030dc7baeeb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:53.877004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb21aeb-d4ba-4272-b9d8-5030dc7baeeb None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:53.889233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-9bb21aeb-d4ba-4272-b9d8-5030dc7baeeb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:28:53.889233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:53.889233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:53.889233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:53.889233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:53.889233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:53.889233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:53.889233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:53.889233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:53.889233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:53.889233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:53.889233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:53.889233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:28:53.889233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:28:53.889233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:28:53.889233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:28:53.890240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:53.890240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:53.890240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:28:53.890240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:28:53.890240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:28:53.890240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:28:53.890240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:53.890240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:53.890240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:53.890240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:53.890240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:53.890240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:53.890240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:53.890240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:53.890240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:53.890240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:53.890240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:53.890240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:53.891246 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:53.891246 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:53.891246 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:28:53.891246 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:28:53.891246 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:28:53.891246 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:28:53.891246 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:28:53.891246 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:28:53.891246 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:28:53.891246 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:28:53.891246 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 630/1267] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:28:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:53.898523 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f79936-cea1-43b6-8d77-3ef13fb8bb4a None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:54.001780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f79936-cea1-43b6-8d77-3ef13fb8bb4a None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:54.035494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44471247-583a-4478-9e45-11b790714097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:54.036107 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44471247-583a-4478-9e45-11b790714097 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:54.036393 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44471247-583a-4478-9e45-11b790714097 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:54.036669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44471247-583a-4478-9e45-11b790714097 None admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:54.037462 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44471247-583a-4478-9e45-11b790714097 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:54.037774 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44471247-583a-4478-9e45-11b790714097 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:54.039207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44471247-583a-4478-9e45-11b790714097 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:54.048568 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:54.057452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 638/1268] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Jul 27 18:28:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:54.063306 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb21aeb-d4ba-4272-b9d8-5030dc7baeeb None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:54.167339 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb21aeb-d4ba-4272-b9d8-5030dc7baeeb None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:54.200453 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dd7d1-568d-4c90-b9a3-c1ec269b4924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:54.201083 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dd7d1-568d-4c90-b9a3-c1ec269b4924 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:54.201365 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dd7d1-568d-4c90-b9a3-c1ec269b4924 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:54.201642 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dd7d1-568d-4c90-b9a3-c1ec269b4924 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:54.212590 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40dd7d1-568d-4c90-b9a3-c1ec269b4924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:54.214043 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40dd7d1-568d-4c90-b9a3-c1ec269b4924 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:54.228693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-a40dd7d1-568d-4c90-b9a3-c1ec269b4924 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:54.228693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:54.228693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:54.228693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:54.228693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:54.228693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:54.228693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:54.228693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:54.228693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:54.228693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:54.228693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:54.228693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:54.228693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:28:54.228693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:28:54.228693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:28:54.229778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:28:54.229778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:54.229778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:54.229778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:54.229778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:54.229778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:54.229778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:54.229778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:54.229778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:54.229778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:54.229778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:54.229778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:54.229778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:54.229778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:54.229778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:54.229778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:54.229778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:54.230955 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:28:54.230955 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:28:54.230955 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:54.230955 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:28:54.230955 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 631/1269] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:28:54.235840 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44471247-583a-4478-9e45-11b790714097 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:54.333223 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44471247-583a-4478-9e45-11b790714097 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:54.367039 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141d7e0-33f3-483c-88ec-d98e8db1492d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:54.367688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141d7e0-33f3-483c-88ec-d98e8db1492d None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:54.367971 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141d7e0-33f3-483c-88ec-d98e8db1492d None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:54.368249 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141d7e0-33f3-483c-88ec-d98e8db1492d None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:54.368942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141d7e0-33f3-483c-88ec-d98e8db1492d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:54.369244 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141d7e0-33f3-483c-88ec-d98e8db1492d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:54.370885 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141d7e0-33f3-483c-88ec-d98e8db1492d None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:54.382515 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 639/1270] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:54.388342 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dd7d1-568d-4c90-b9a3-c1ec269b4924 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:54.423759 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:54.492430 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dd7d1-568d-4c90-b9a3-c1ec269b4924 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:54.527447 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f781d0-c5f1-46e0-a641-604dd527724e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:54.528096 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f781d0-c5f1-46e0-a641-604dd527724e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:54.528381 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f781d0-c5f1-46e0-a641-604dd527724e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:54.528686 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f781d0-c5f1-46e0-a641-604dd527724e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:54.535973 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f781d0-c5f1-46e0-a641-604dd527724e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:54.537437 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f781d0-c5f1-46e0-a641-604dd527724e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:54.550471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-b8f781d0-c5f1-46e0-a641-604dd527724e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:28:54.550471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:54.550471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:54.550471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:54.550471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:54.550471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:54.550471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:54.550471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:54.550471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:54.550471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:54.550471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:54.550471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:54.550471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:28:54.550471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:28:54.550471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:28:54.551566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:28:54.551566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:54.551566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:54.551566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:54.551566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:54.551566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:54.551566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:54.551566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:54.551566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:54.551566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:54.551566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:54.551566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:54.551566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:54.551566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:54.551566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:54.551566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:54.551566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:54.552607 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:28:54.552607 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:28:54.552607 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:28:54.552607 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:28:54.552607 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:28:54.552607 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:28:54.552607 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:28:54.552607 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:28:54.552607 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 632/1271] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:28:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:54.557598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141d7e0-33f3-483c-88ec-d98e8db1492d None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:54.616409 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:54.658193 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141d7e0-33f3-483c-88ec-d98e8db1492d None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:54.702162 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0ecf0-6e0f-4840-af1e-8baedf492dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:54.702789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0ecf0-6e0f-4840-af1e-8baedf492dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:54.703076 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0ecf0-6e0f-4840-af1e-8baedf492dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:54.703699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0ecf0-6e0f-4840-af1e-8baedf492dc8 None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:54.704297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0ecf0-6e0f-4840-af1e-8baedf492dc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:54.704609 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0ecf0-6e0f-4840-af1e-8baedf492dc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:54.706792 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0ecf0-6e0f-4840-af1e-8baedf492dc8 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:54.719322 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 640/1272] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:28:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:54.726165 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f781d0-c5f1-46e0-a641-604dd527724e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:54.818606 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:54.827504 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f781d0-c5f1-46e0-a641-604dd527724e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:54.861725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f09cd-6861-417e-81b6-b7215d884535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:54.862973 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f09cd-6861-417e-81b6-b7215d884535 None admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:54.863288 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f09cd-6861-417e-81b6-b7215d884535 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:54.863562 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f09cd-6861-417e-81b6-b7215d884535 None admin] PATH_INFO: `/v3/projects/2880a34079d742c38bfdace2c04564c7/users/aa971da983ea48c3b6d4c68a5d454bde/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:54.865532 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f09cd-6861-417e-81b6-b7215d884535 None admin] RBAC: Authorizing `identity:create_grant(project_id=2880a34079d742c38bfdace2c04564c7, user_id=aa971da983ea48c3b6d4c68a5d454bde, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:54.867018 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f09cd-6861-417e-81b6-b7215d884535 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:54.951506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 633/1273] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 18:28:54 2022] PUT /identity/v3/projects/2880a34079d742c38bfdace2c04564c7/users/aa971da983ea48c3b6d4c68a5d454bde/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:28:57.007942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c8d69-3b9b-454d-9468-a91613c12043 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:57.008490 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c8d69-3b9b-454d-9468-a91613c12043 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:57.008490 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c8d69-3b9b-454d-9468-a91613c12043 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:57.009937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 641/1274] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:28:57.015058 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072a284-846c-435c-9ff9-3db44d61ec9d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:57.015557 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072a284-846c-435c-9ff9-3db44d61ec9d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:57.015655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072a284-846c-435c-9ff9-3db44d61ec9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:57.034976 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c072a284-846c-435c-9ff9-3db44d61ec9d None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:28:57.036227 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c072a284-846c-435c-9ff9-3db44d61ec9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:28:57.103682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 634/1275] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:28:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:28:57.127064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c8d69-3b9b-454d-9468-a91613c12043 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:57.230132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c8d69-3b9b-454d-9468-a91613c12043 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:57.248071 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:57.266608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5be8a-7852-448e-bbb4-76f5ae7146c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:57.266608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5be8a-7852-448e-bbb4-76f5ae7146c6 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:57.266608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5be8a-7852-448e-bbb4-76f5ae7146c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:57.266608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5be8a-7852-448e-bbb4-76f5ae7146c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:57.276232 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5be8a-7852-448e-bbb4-76f5ae7146c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:28:57.281063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-6cc5be8a-7852-448e-bbb4-76f5ae7146c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:28:57.281063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:57.281063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:57.281063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:57.281063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:57.281063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:57.281063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:57.281063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:57.281063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:57.281063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:57.281063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:57.281063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:57.281063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:28:57.281063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:28:57.281063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:28:57.281063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:28:57.282217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:28:57.282217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:28:57.282217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:28:57.282217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:28:57.282217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:57.282217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:57.282217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:57.282217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:57.282217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:57.282217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:57.282217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:57.282217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:57.282217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:57.282217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:57.282217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:57.282217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:57.283294 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:57.283294 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:57.283294 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:57.283294 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:57.283294 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:28:57.283294 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:28:57.283294 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:28:57.283294 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:28:57.283294 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:28:57.283294 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:28:57.283294 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:28:57.283294 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:28:57.283294 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 642/1276] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 18:28:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:28:57.298193 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072a284-846c-435c-9ff9-3db44d61ec9d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:57.380309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:57.405733 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072a284-846c-435c-9ff9-3db44d61ec9d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:57.440311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e768fe-a176-4532-8844-b450cd4d9810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:57.441099 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e768fe-a176-4532-8844-b450cd4d9810 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:57.441381 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e768fe-a176-4532-8844-b450cd4d9810 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:57.441652 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e768fe-a176-4532-8844-b450cd4d9810 None admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:57.442366 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e768fe-a176-4532-8844-b450cd4d9810 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:57.442669 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e768fe-a176-4532-8844-b450cd4d9810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:57.444080 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e768fe-a176-4532-8844-b450cd4d9810 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:57.452397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 635/1277] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 18:28:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:57.458768 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5be8a-7852-448e-bbb4-76f5ae7146c6 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:57.568269 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5be8a-7852-448e-bbb4-76f5ae7146c6 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:57.603714 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baecf5b-878a-495b-8b78-a22da01dea29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:57.604360 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baecf5b-878a-495b-8b78-a22da01dea29 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:57.604645 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baecf5b-878a-495b-8b78-a22da01dea29 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:57.604926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baecf5b-878a-495b-8b78-a22da01dea29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:57.616306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baecf5b-878a-495b-8b78-a22da01dea29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:57.618114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baecf5b-878a-495b-8b78-a22da01dea29 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:57.642450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-8baecf5b-878a-495b-8b78-a22da01dea29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:57.642450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:57.642450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:57.642450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:57.642450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:57.642450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:57.642450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:57.642450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:57.642450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:57.642450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:57.642450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:57.642450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:57.642450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:28:57.642450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:28:57.642450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:28:57.643704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:28:57.643704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:57.643704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:57.643704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:57.643704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:57.643704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:57.643704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:57.643704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:57.643704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:57.643704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:57.643704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:57.643704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:57.643704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:57.643704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:57.643704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:57.643704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:57.643704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:57.645429 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:28:57.645429 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:28:57.645429 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:57.645429 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:28:57.645429 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 643/1278] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:57.650398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e768fe-a176-4532-8844-b450cd4d9810 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:57.755486 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e768fe-a176-4532-8844-b450cd4d9810 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:57.789223 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6062e7-3375-4936-80ec-a86c8a647c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:57.789845 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6062e7-3375-4936-80ec-a86c8a647c14 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:57.790129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6062e7-3375-4936-80ec-a86c8a647c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:57.790410 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6062e7-3375-4936-80ec-a86c8a647c14 None admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:57.791100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6062e7-3375-4936-80ec-a86c8a647c14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:57.791495 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6062e7-3375-4936-80ec-a86c8a647c14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:57.792833 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6062e7-3375-4936-80ec-a86c8a647c14 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:57.804665 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 636/1279] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:57.810390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baecf5b-878a-495b-8b78-a22da01dea29 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:57.841965 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:57.909553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baecf5b-878a-495b-8b78-a22da01dea29 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:57.943816 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba82f3-b324-4547-804e-a1883a6d3bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:57.945742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba82f3-b324-4547-804e-a1883a6d3bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:57.946027 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba82f3-b324-4547-804e-a1883a6d3bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:57.946307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba82f3-b324-4547-804e-a1883a6d3bf0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:57.953399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba82f3-b324-4547-804e-a1883a6d3bf0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:57.954864 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba82f3-b324-4547-804e-a1883a6d3bf0 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:57.970743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-7dba82f3-b324-4547-804e-a1883a6d3bf0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:28:57.970743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:57.970743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:57.970743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:57.970743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:57.970743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:57.970743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:57.970743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:57.970743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:57.970743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:57.970743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:57.970743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:57.970743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:28:57.970743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:28:57.970743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:28:57.970743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:28:57.972000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:57.972000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:57.972000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:28:57.972000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:28:57.972000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:28:57.972000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:28:57.972000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:57.972000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:57.972000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:57.972000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:57.972000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:57.972000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:57.972000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:57.972000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:57.972000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:57.972000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:57.972000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:57.972000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:57.973489 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:57.973489 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:57.973489 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:28:57.973489 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:28:57.973489 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:28:57.973489 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:28:57.973489 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:28:57.973489 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:28:57.973489 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:28:57.973489 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:28:57.973489 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 644/1280] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:28:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:57.977940 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6062e7-3375-4936-80ec-a86c8a647c14 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:57.981800 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:58.078962 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6062e7-3375-4936-80ec-a86c8a647c14 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:58.112257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bd5ce-8eaf-402f-892b-7602e6f4c627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:58.113436 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bd5ce-8eaf-402f-892b-7602e6f4c627 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:58.113719 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bd5ce-8eaf-402f-892b-7602e6f4c627 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:58.113996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bd5ce-8eaf-402f-892b-7602e6f4c627 None admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:58.114785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2bd5ce-8eaf-402f-892b-7602e6f4c627 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:58.115094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2bd5ce-8eaf-402f-892b-7602e6f4c627 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:58.116564 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2bd5ce-8eaf-402f-892b-7602e6f4c627 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:58.134506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 637/1281] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Jul 27 18:28:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:58.140376 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba82f3-b324-4547-804e-a1883a6d3bf0 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:58.230601 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:58.240211 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba82f3-b324-4547-804e-a1883a6d3bf0 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:58.273375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f614c-a6de-4167-9b81-048dc7633f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:58.273987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f614c-a6de-4167-9b81-048dc7633f07 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:58.274268 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f614c-a6de-4167-9b81-048dc7633f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:58.274541 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f614c-a6de-4167-9b81-048dc7633f07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:58.341201 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f614c-a6de-4167-9b81-048dc7633f07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:58.342578 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f614c-a6de-4167-9b81-048dc7633f07 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:58.432102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:58.442242 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 645/1282] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 18:28:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:28:58.448398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bd5ce-8eaf-402f-892b-7602e6f4c627 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:58.510392 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:58.548228 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bd5ce-8eaf-402f-892b-7602e6f4c627 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:58.582591 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2477a20-2aa4-4367-b66c-e630c9613e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:58.583234 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2477a20-2aa4-4367-b66c-e630c9613e1e None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:58.583589 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2477a20-2aa4-4367-b66c-e630c9613e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:58.583867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2477a20-2aa4-4367-b66c-e630c9613e1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:58.594398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2477a20-2aa4-4367-b66c-e630c9613e1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:58.596107 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2477a20-2aa4-4367-b66c-e630c9613e1e None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:58.611664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-f2477a20-2aa4-4367-b66c-e630c9613e1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:58.611664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:58.611664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:58.611664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:58.611664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:58.611664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:58.611664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:58.611664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:58.611664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:58.611664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:58.611664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:58.611664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:58.611664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:28:58.611664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:28:58.611664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:28:58.613264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:28:58.613264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:58.613264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:58.613264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:58.613264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:58.613264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:58.613264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:58.613264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:58.613264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:58.613264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:58.613264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:58.613264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:58.613264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:58.613264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:58.613264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:58.613264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:58.613264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:58.614573 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:28:58.614573 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:28:58.614573 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:28:58.614573 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:28:58.614573 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 638/1283] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:58.620736 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f614c-a6de-4167-9b81-048dc7633f07 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:58.718276 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f614c-a6de-4167-9b81-048dc7633f07 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:58.752805 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d764a4-41bf-4695-b31e-b8637fc8754a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:58.753453 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d764a4-41bf-4695-b31e-b8637fc8754a None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:58.753748 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d764a4-41bf-4695-b31e-b8637fc8754a None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:58.754028 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d764a4-41bf-4695-b31e-b8637fc8754a None admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:58.754728 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d764a4-41bf-4695-b31e-b8637fc8754a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:58.755037 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d764a4-41bf-4695-b31e-b8637fc8754a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:58.756458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d764a4-41bf-4695-b31e-b8637fc8754a None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:58.767829 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 646/1284] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 18:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:58.774230 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2477a20-2aa4-4367-b66c-e630c9613e1e None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:58.887653 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2477a20-2aa4-4367-b66c-e630c9613e1e None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:58.902657 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:58.923442 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb0e38-c92e-465a-baf3-61224b0111a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:58.924075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb0e38-c92e-465a-baf3-61224b0111a9 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:58.924355 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb0e38-c92e-465a-baf3-61224b0111a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:58.924629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb0e38-c92e-465a-baf3-61224b0111a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:58.931427 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb0e38-c92e-465a-baf3-61224b0111a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:58.932916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb0e38-c92e-465a-baf3-61224b0111a9 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:58.944901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application [None req-87cb0e38-c92e-465a-baf3-61224b0111a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:28:58.944901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:28:58.944901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:28:58.944901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:28:58.944901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:28:58.944901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:28:58.944901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:28:58.944901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:28:58.944901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:28:58.944901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:28:58.944901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:28:58.944901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:28:58.944901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:28:58.944901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:28:58.944901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:28:58.945891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:28:58.945891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:28:58.945891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:28:58.945891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:28:58.945891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:28:58.945891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:28:58.945891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:28:58.945891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:28:58.945891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application with Lock( Jul 27 18:28:58.945891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:28:58.945891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:28:58.945891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:28:58.945891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:28:58.945891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:28:58.945891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:28:58.945891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:28:58.945891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:28:58.946916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:28:58.946916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:28:58.946916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:28:58.946916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:28:58.946916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:28:58.946916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:28:58.946916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:28:58.946916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: ERROR keystone.server.flask.application Jul 27 18:28:58.946916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 639/1285] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 18:28:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:28:58.952007 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d764a4-41bf-4695-b31e-b8637fc8754a None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:59.024239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:59.083671 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d764a4-41bf-4695-b31e-b8637fc8754a None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:59.123140 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200964cb-77e1-41af-b309-973b1fa11b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:59.123790 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200964cb-77e1-41af-b309-973b1fa11b03 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:59.124078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200964cb-77e1-41af-b309-973b1fa11b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:59.124357 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200964cb-77e1-41af-b309-973b1fa11b03 None admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:59.125114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200964cb-77e1-41af-b309-973b1fa11b03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:59.125418 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200964cb-77e1-41af-b309-973b1fa11b03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:59.126867 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200964cb-77e1-41af-b309-973b1fa11b03 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:59.140173 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 647/1286] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 18:28:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:28:59.146689 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb0e38-c92e-465a-baf3-61224b0111a9 None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:59.250018 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb0e38-c92e-465a-baf3-61224b0111a9 None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:59.286160 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aeee98-e03c-4390-98f8-dd7c168126b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:59.286772 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aeee98-e03c-4390-98f8-dd7c168126b4 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:59.287057 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aeee98-e03c-4390-98f8-dd7c168126b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:59.287362 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aeee98-e03c-4390-98f8-dd7c168126b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:59.288149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aeee98-e03c-4390-98f8-dd7c168126b4 None admin] RBAC: Adding query filter params (role.id=4ae8d11d74f14bcc80117d897ba2f5b6, scope.project.id=2880a34079d742c38bfdace2c04564c7, user.id=aa971da983ea48c3b6d4c68a5d454bde) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:28:59.288462 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aeee98-e03c-4390-98f8-dd7c168126b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:59.289904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aeee98-e03c-4390-98f8-dd7c168126b4 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:59.295701 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 640/1287] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 18:28:59 2022] GET /identity/v3/role_assignments?user.id=aa971da983ea48c3b6d4c68a5d454bde&scope.project.id=2880a34079d742c38bfdace2c04564c7&role.id=4ae8d11d74f14bcc80117d897ba2f5b6 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:29:01.371160 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063359e-823f-443f-bbb0-282af9f1709a None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:01.371917 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063359e-823f-443f-bbb0-282af9f1709a None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:01.371917 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063359e-823f-443f-bbb0-282af9f1709a None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:01.374727 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 648/1288] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:29:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:29:01.380532 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d6fca-0079-43cc-bf1e-8c8f65ffbe7d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:01.381188 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d6fca-0079-43cc-bf1e-8c8f65ffbe7d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:01.381188 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d6fca-0079-43cc-bf1e-8c8f65ffbe7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:01.400157 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-364d6fca-0079-43cc-bf1e-8c8f65ffbe7d None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:29:01.401371 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-364d6fca-0079-43cc-bf1e-8c8f65ffbe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:01.432864 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:29:01.469528 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 641/1289] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:29:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:29:01.493261 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063359e-823f-443f-bbb0-282af9f1709a None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:01.599345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063359e-823f-443f-bbb0-282af9f1709a None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:01.610067 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:29:01.634041 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac133def-e314-451c-a0df-8eefec9cd36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:01.634681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac133def-e314-451c-a0df-8eefec9cd36b None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:01.635006 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac133def-e314-451c-a0df-8eefec9cd36b None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:01.635318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac133def-e314-451c-a0df-8eefec9cd36b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:01.635953 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac133def-e314-451c-a0df-8eefec9cd36b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:01.637366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac133def-e314-451c-a0df-8eefec9cd36b None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:01.647013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-ac133def-e314-451c-a0df-8eefec9cd36b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:29:01.647013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:29:01.647013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:29:01.647013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:29:01.647013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:29:01.647013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:29:01.647013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:29:01.647013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:29:01.647013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:29:01.647013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:29:01.647013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:29:01.647013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:29:01.647013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:29:01.647013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:29:01.647013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:29:01.647013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:29:01.647013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:29:01.653831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:29:01.653831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:29:01.653831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:29:01.653831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:29:01.653831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:29:01.653831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:29:01.653831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:29:01.653831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:29:01.653831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:29:01.653831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:29:01.653831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:29:01.653831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:29:01.653831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:29:01.653831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:29:01.653831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:29:01.653831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:29:01.655020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:29:01.655020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:29:01.655020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:29:01.655020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:29:01.655020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:29:01.655020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:29:01.655020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:29:01.655020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:29:01.655020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:29:01.655020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:29:01.655020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:29:01.655020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:29:01.655020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:29:01.655020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:29:01.655020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 649/1290] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 18:29:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:29:01.656202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d6fca-0079-43cc-bf1e-8c8f65ffbe7d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:01.756920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d6fca-0079-43cc-bf1e-8c8f65ffbe7d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:01.790424 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185e93b-00c2-4a5e-a8b0-25ffb35e57a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:01.791034 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185e93b-00c2-4a5e-a8b0-25ffb35e57a2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:01.791335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185e93b-00c2-4a5e-a8b0-25ffb35e57a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:01.791608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185e93b-00c2-4a5e-a8b0-25ffb35e57a2 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:01.792281 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185e93b-00c2-4a5e-a8b0-25ffb35e57a2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:29:01.792582 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185e93b-00c2-4a5e-a8b0-25ffb35e57a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:01.793990 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185e93b-00c2-4a5e-a8b0-25ffb35e57a2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:01.798755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 642/1291] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Jul 27 18:29:01 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:29:01.805290 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac133def-e314-451c-a0df-8eefec9cd36b None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:01.906469 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac133def-e314-451c-a0df-8eefec9cd36b None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:01.939376 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a8216-9778-4234-8cc1-e4afa2f875ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:01.939985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a8216-9778-4234-8cc1-e4afa2f875ed None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:01.940265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a8216-9778-4234-8cc1-e4afa2f875ed None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:01.941209 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a8216-9778-4234-8cc1-e4afa2f875ed None admin] PATH_INFO: `/v3/services` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:01.941918 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a8216-9778-4234-8cc1-e4afa2f875ed None admin] RBAC: Adding query filter params (type=placement) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:29:01.942222 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a8216-9778-4234-8cc1-e4afa2f875ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:01.943610 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a8216-9778-4234-8cc1-e4afa2f875ed None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:01.948048 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 650/1292] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Jul 27 18:29:01 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:29:04.030230 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f199310-64e0-4aab-a339-25e8d25212f2 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:04.030841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f199310-64e0-4aab-a339-25e8d25212f2 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:04.030841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f199310-64e0-4aab-a339-25e8d25212f2 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:04.032234 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 643/1293] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:29:04.037470 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce2b46-34eb-4ed1-8f1c-7f3b1f0a81ae None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:04.037876 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce2b46-34eb-4ed1-8f1c-7f3b1f0a81ae None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:04.038024 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce2b46-34eb-4ed1-8f1c-7f3b1f0a81ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:04.056811 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-d6ce2b46-34eb-4ed1-8f1c-7f3b1f0a81ae None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:29:04.060260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-d6ce2b46-34eb-4ed1-8f1c-7f3b1f0a81ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:04.088691 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:29:04.126788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 651/1294] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:29:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:29:04.149557 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f199310-64e0-4aab-a339-25e8d25212f2 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:04.181321 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:29:04.250710 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f199310-64e0-4aab-a339-25e8d25212f2 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:04.292170 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795545b-0a08-417f-8244-d0c0628d73e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:04.292170 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795545b-0a08-417f-8244-d0c0628d73e6 None admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:04.292170 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795545b-0a08-417f-8244-d0c0628d73e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:04.292170 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795545b-0a08-417f-8244-d0c0628d73e6 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:04.292659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795545b-0a08-417f-8244-d0c0628d73e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:04.292659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795545b-0a08-417f-8244-d0c0628d73e6 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:04.380386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 644/1295] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 18:29:04 2022] POST /identity/v3/services => generated 246 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:29:06.400022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cb221-2d49-46a7-ae96-552f19ba26ff None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:06.400654 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cb221-2d49-46a7-ae96-552f19ba26ff None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:06.400654 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cb221-2d49-46a7-ae96-552f19ba26ff None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:06.401930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 652/1296] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:29:06.408128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7ad11-0f9f-4162-b8b3-672b4cabd11b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:06.408647 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7ad11-0f9f-4162-b8b3-672b4cabd11b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:06.408989 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7ad11-0f9f-4162-b8b3-672b4cabd11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:06.428487 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a6a7ad11-0f9f-4162-b8b3-672b4cabd11b None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:29:06.429778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a6a7ad11-0f9f-4162-b8b3-672b4cabd11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:06.506901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 645/1297] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:29:06 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:29:06.529129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cb221-2d49-46a7-ae96-552f19ba26ff None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:06.638537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cb221-2d49-46a7-ae96-552f19ba26ff None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:06.672800 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18a1fb-42b0-4859-b62a-419ff32842ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:06.673364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18a1fb-42b0-4859-b62a-419ff32842ad None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:06.673644 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18a1fb-42b0-4859-b62a-419ff32842ad None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:06.673918 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18a1fb-42b0-4859-b62a-419ff32842ad None admin] PATH_INFO: `/v3/services/placement` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:06.674546 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18a1fb-42b0-4859-b62a-419ff32842ad None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:06.676160 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18a1fb-42b0-4859-b62a-419ff32842ad None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:06.685307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-7d18a1fb-42b0-4859-b62a-419ff32842ad None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:29:06.685307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:29:06.685307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:29:06.685307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:29:06.685307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:29:06.685307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:29:06.685307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:29:06.685307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:29:06.685307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:29:06.685307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:29:06.685307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:29:06.685307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:29:06.685307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:29:06.685307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:29:06.685307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:29:06.685307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:29:06.685307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:29:06.692288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:29:06.692288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:29:06.692288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:29:06.692288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:29:06.692288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:29:06.692288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:29:06.692288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:29:06.692288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:29:06.692288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:29:06.692288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:29:06.692288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:29:06.692288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:29:06.692288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:29:06.692288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:29:06.692288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:29:06.692288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:29:06.693402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:29:06.693402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:29:06.693402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:29:06.693402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:29:06.693402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:29:06.693402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:29:06.693402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:29:06.693402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:29:06.693402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:29:06.693402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:29:06.693402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:29:06.693402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:29:06.693402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:29:06.693402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:29:06.693402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 653/1298] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 18:29:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:29:06.694438 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7ad11-0f9f-4162-b8b3-672b4cabd11b None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:06.713158 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:29:06.796048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7ad11-0f9f-4162-b8b3-672b4cabd11b None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:06.835421 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08799b97-210c-4c8a-9add-655b43b62d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:06.837240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08799b97-210c-4c8a-9add-655b43b62d1d None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:06.837240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08799b97-210c-4c8a-9add-655b43b62d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:06.837240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08799b97-210c-4c8a-9add-655b43b62d1d None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:06.837537 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08799b97-210c-4c8a-9add-655b43b62d1d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:29:06.837628 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08799b97-210c-4c8a-9add-655b43b62d1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:06.838973 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08799b97-210c-4c8a-9add-655b43b62d1d None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:06.848911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 646/1299] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Jul 27 18:29:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:29:06.855536 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18a1fb-42b0-4859-b62a-419ff32842ad None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:06.891009 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:29:06.969656 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18a1fb-42b0-4859-b62a-419ff32842ad None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:07.007987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ba1e3-9d6f-4804-b543-1d2e35390a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:07.008618 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ba1e3-9d6f-4804-b543-1d2e35390a94 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:07.008896 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ba1e3-9d6f-4804-b543-1d2e35390a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:07.009167 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ba1e3-9d6f-4804-b543-1d2e35390a94 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:07.009937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ba1e3-9d6f-4804-b543-1d2e35390a94 None admin] RBAC: Adding query filter params (interface=public, service_id=f5676613798f4628b8a213d243b2b37c, region_id=RegionOne) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:29:07.010245 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ba1e3-9d6f-4804-b543-1d2e35390a94 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:07.011699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ba1e3-9d6f-4804-b543-1d2e35390a94 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:07.018164 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 654/1300] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 18:29:06 2022] GET /identity/v3/endpoints?service_id=f5676613798f4628b8a213d243b2b37c&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:29:07.025070 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08799b97-210c-4c8a-9add-655b43b62d1d None admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:07.114016 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:29:07.133413 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08799b97-210c-4c8a-9add-655b43b62d1d None admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:07.170716 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc033df-0c77-461a-8dd1-ca5bc0e82fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:07.171413 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc033df-0c77-461a-8dd1-ca5bc0e82fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:07.171702 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc033df-0c77-461a-8dd1-ca5bc0e82fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:07.172029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc033df-0c77-461a-8dd1-ca5bc0e82fe2 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:07.172691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc033df-0c77-461a-8dd1-ca5bc0e82fe2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:07.174066 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc033df-0c77-461a-8dd1-ca5bc0e82fe2 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:07.181029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 647/1301] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 18:29:07 2022] GET /identity/v3/services => generated 2191 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:29:09.219725 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4e60d-1c8e-462a-9e24-ceea1f327de5 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:09.220281 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4e60d-1c8e-462a-9e24-ceea1f327de5 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:09.220281 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4e60d-1c8e-462a-9e24-ceea1f327de5 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:09.221747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 655/1302] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:29:09.226913 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b58124-5820-4724-88b1-4ade7498f2c9 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:09.227398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b58124-5820-4724-88b1-4ade7498f2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:09.227498 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b58124-5820-4724-88b1-4ade7498f2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:09.246123 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-86b58124-5820-4724-88b1-4ade7498f2c9 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:29:09.247386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-86b58124-5820-4724-88b1-4ade7498f2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:09.313866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 648/1303] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:29:09 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:29:09.336804 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4e60d-1c8e-462a-9e24-ceea1f327de5 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:09.432039 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:29:09.438966 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4e60d-1c8e-462a-9e24-ceea1f327de5 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:09.473534 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6fd71-8b14-4303-acef-0ea7a4687d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:09.474095 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6fd71-8b14-4303-acef-0ea7a4687d38 None admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:09.474374 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6fd71-8b14-4303-acef-0ea7a4687d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:09.474644 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6fd71-8b14-4303-acef-0ea7a4687d38 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:09.475289 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6fd71-8b14-4303-acef-0ea7a4687d38 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:09.476650 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6fd71-8b14-4303-acef-0ea7a4687d38 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:09.485587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application [None req-d9c6fd71-8b14-4303-acef-0ea7a4687d38 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:29:09.485587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:29:09.485587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:29:09.485587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:29:09.485587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:29:09.485587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:29:09.485587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:29:09.485587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:29:09.485587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:29:09.485587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:29:09.485587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:29:09.485587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:29:09.485587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:29:09.485587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:29:09.485587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:29:09.485587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:29:09.485587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:29:09.486863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:29:09.486863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:29:09.486863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:29:09.486863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:29:09.486863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:29:09.486863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:29:09.486863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:29:09.486863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:29:09.486863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:29:09.486863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:29:09.486863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:29:09.486863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:29:09.486863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:29:09.486863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:29:09.486863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:29:09.486863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:29:09.490545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:29:09.490545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application with Lock( Jul 27 18:29:09.490545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:29:09.490545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:29:09.490545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:29:09.490545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:29:09.490545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:29:09.490545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:29:09.490545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:29:09.490545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:29:09.490545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:29:09.490545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:29:09.490545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:29:09.490545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: ERROR keystone.server.flask.application Jul 27 18:29:09.490545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 656/1304] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 18:29:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:29:09.494472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b58124-5820-4724-88b1-4ade7498f2c9 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:09.572866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:29:09.595338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b58124-5820-4724-88b1-4ade7498f2c9 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:09.630260 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41afff5-1631-43a2-93b3-8819526805c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:09.630869 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41afff5-1631-43a2-93b3-8819526805c0 None admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:09.631150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41afff5-1631-43a2-93b3-8819526805c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:09.631450 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41afff5-1631-43a2-93b3-8819526805c0 None admin] PATH_INFO: `/v3/services` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:09.632127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41afff5-1631-43a2-93b3-8819526805c0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:29:09.632432 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41afff5-1631-43a2-93b3-8819526805c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:09.633798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41afff5-1631-43a2-93b3-8819526805c0 None admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:09.638860 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 649/1305] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Jul 27 18:29:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:29:09.644779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6fd71-8b14-4303-acef-0ea7a4687d38 None admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:09.757962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6fd71-8b14-4303-acef-0ea7a4687d38 None admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:09.792083 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df381c-84d9-44b8-aef4-c74d18110ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:09.792796 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df381c-84d9-44b8-aef4-c74d18110ec3 None admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:09.793125 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df381c-84d9-44b8-aef4-c74d18110ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:09.798056 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df381c-84d9-44b8-aef4-c74d18110ec3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:09.798056 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df381c-84d9-44b8-aef4-c74d18110ec3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:09.798056 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df381c-84d9-44b8-aef4-c74d18110ec3 None admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:09.892665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 657/1306] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:29:09 2022] POST /identity/v3/endpoints => generated 331 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:29:19.669040 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=30 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:29:19.887824 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:26.075982 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a35b3-b2b9-4e2b-b975-38ff48ffb70b None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:26.076473 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a35b3-b2b9-4e2b-b975-38ff48ffb70b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:26.076586 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a35b3-b2b9-4e2b-b975-38ff48ffb70b None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:26.083983 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b336d-2112-4396-bebc-d97fa535bbb6 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:26.084404 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b336d-2112-4396-bebc-d97fa535bbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:26.084491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b336d-2112-4396-bebc-d97fa535bbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:26.089259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 650/1307] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:36:26 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:36:26.199605 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-2f7b336d-2112-4396-bebc-d97fa535bbb6 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:36:26.201045 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2f7b336d-2112-4396-bebc-d97fa535bbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:26.314473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 658/1308] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:36:26.373977 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110ad40-66cd-489d-87e3-e139934e7e91 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:26.376267 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110ad40-66cd-489d-87e3-e139934e7e91 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:26.376267 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110ad40-66cd-489d-87e3-e139934e7e91 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:26.377209 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 651/1309] 10.222.0.65 () {54 vars in 965 bytes} [Wed Jul 27 18:36:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:36:26.383591 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524bd3e-d5e5-45e4-bfc0-b59739164864 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:26.383882 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524bd3e-d5e5-45e4-bfc0-b59739164864 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:26.384161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524bd3e-d5e5-45e4-bfc0-b59739164864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:26.482345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-c524bd3e-d5e5-45e4-bfc0-b59739164864 None None] MFA Rules not processed for user `ffee4a13d4fd4f86bd1c79b4535a0c55`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:36:26.483665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c524bd3e-d5e5-45e4-bfc0-b59739164864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:26.521813 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:26.589680 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 659/1310] 10.222.0.65 () {58 vars in 1062 bytes} [Wed Jul 27 18:36:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:36:26.599662 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110ad40-66cd-489d-87e3-e139934e7e91 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:36:26.601415 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0110ad40-66cd-489d-87e3-e139934e7e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:26.723856 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110ad40-66cd-489d-87e3-e139934e7e91 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:36:26.803196 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c6d34-0896-4de3-8836-ccf2e596130f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:36:26.803856 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c6d34-0896-4de3-8836-ccf2e596130f service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:26.804141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c6d34-0896-4de3-8836-ccf2e596130f service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:26.804422 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c6d34-0896-4de3-8836-ccf2e596130f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:26.806086 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ad6c6d34-0896-4de3-8836-ccf2e596130f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:26.866631 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:26.924385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c6d34-0896-4de3-8836-ccf2e596130f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:36:26.925847 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c6d34-0896-4de3-8836-ccf2e596130f service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:36:26.947902 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 652/1311] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:36:29.310840 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18828357-c50e-425b-8cf8-99d8e1af7556 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:29.311329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18828357-c50e-425b-8cf8-99d8e1af7556 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:29.311502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18828357-c50e-425b-8cf8-99d8e1af7556 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:29.313537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 660/1312] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:36:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:36:29.318911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35da806-e7bd-44b4-a00a-69871f051c61 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:29.319466 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35da806-e7bd-44b4-a00a-69871f051c61 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:29.319466 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35da806-e7bd-44b4-a00a-69871f051c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:29.424251 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b35da806-e7bd-44b4-a00a-69871f051c61 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:36:29.425470 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b35da806-e7bd-44b4-a00a-69871f051c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:29.541793 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 653/1313] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:36:29.582810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18828357-c50e-425b-8cf8-99d8e1af7556 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:36:29.584408 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-18828357-c50e-425b-8cf8-99d8e1af7556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:29.722413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18828357-c50e-425b-8cf8-99d8e1af7556 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:36:29.801781 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:29.804338 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9382919-c3d1-47b1-82c2-58532782bf0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:36:29.804962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9382919-c3d1-47b1-82c2-58532782bf0e service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:29.805246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9382919-c3d1-47b1-82c2-58532782bf0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:29.805522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9382919-c3d1-47b1-82c2-58532782bf0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:29.807164 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e9382919-c3d1-47b1-82c2-58532782bf0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:29.922018 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9382919-c3d1-47b1-82c2-58532782bf0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:36:29.923415 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9382919-c3d1-47b1-82c2-58532782bf0e service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:36:29.942172 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 661/1314] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:36:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:36:32.566769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec3895-b6eb-4947-ba7a-2e99d29522c9 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:32.567322 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec3895-b6eb-4947-ba7a-2e99d29522c9 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:32.567419 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec3895-b6eb-4947-ba7a-2e99d29522c9 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:32.568739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 654/1315] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:36:32.573961 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d451c-ef95-4fc1-9954-8dfe50d4bc67 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:32.574366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d451c-ef95-4fc1-9954-8dfe50d4bc67 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:32.574521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d451c-ef95-4fc1-9954-8dfe50d4bc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:32.640941 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-8b2d451c-ef95-4fc1-9954-8dfe50d4bc67 None None] MFA Rules not processed for user `034095ad77554819b83324ec8dd53a22`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:36:32.642174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-8b2d451c-ef95-4fc1-9954-8dfe50d4bc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:32.694607 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:32.740360 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 662/1316] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:36:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:36:32.781497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec3895-b6eb-4947-ba7a-2e99d29522c9 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:36:32.783245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-feec3895-b6eb-4947-ba7a-2e99d29522c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:32.793113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:32.886285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec3895-b6eb-4947-ba7a-2e99d29522c9 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:36:32.958764 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb7fe4-9c41-4662-ad23-6c85aeb39c95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:36:32.959412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb7fe4-9c41-4662-ad23-6c85aeb39c95 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:32.959693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb7fe4-9c41-4662-ad23-6c85aeb39c95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:32.959965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb7fe4-9c41-4662-ad23-6c85aeb39c95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:32.961610 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b9fb7fe4-9c41-4662-ad23-6c85aeb39c95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:33.024409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:33.072086 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb7fe4-9c41-4662-ad23-6c85aeb39c95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:36:33.073557 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb7fe4-9c41-4662-ad23-6c85aeb39c95 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:36:33.094551 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 655/1317] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:36:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:36:36.047879 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bf9e1-d349-46a6-9eb5-ee1366f81b66 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:36.048457 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bf9e1-d349-46a6-9eb5-ee1366f81b66 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:36.048457 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bf9e1-d349-46a6-9eb5-ee1366f81b66 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:36.049827 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 663/1318] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:36:36.054903 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24b82d-a47e-4d67-b5a3-85764ff5d6b4 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:36.055337 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24b82d-a47e-4d67-b5a3-85764ff5d6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:36.055512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24b82d-a47e-4d67-b5a3-85764ff5d6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:36.121740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-4b24b82d-a47e-4d67-b5a3-85764ff5d6b4 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:36:36.122968 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4b24b82d-a47e-4d67-b5a3-85764ff5d6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:36.220764 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 656/1319] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:36:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:36:36.259782 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bf9e1-d349-46a6-9eb5-ee1366f81b66 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:36:36.261355 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-7f1bf9e1-d349-46a6-9eb5-ee1366f81b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:36.367396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bf9e1-d349-46a6-9eb5-ee1366f81b66 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:36:36.444166 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12d730-3b09-4cc1-b41a-feb07435d7c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:36:36.444785 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12d730-3b09-4cc1-b41a-feb07435d7c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:36.445120 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12d730-3b09-4cc1-b41a-feb07435d7c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:36.445342 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12d730-3b09-4cc1-b41a-feb07435d7c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:36.446988 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-aa12d730-3b09-4cc1-b41a-feb07435d7c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:36.454681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:36.557233 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12d730-3b09-4cc1-b41a-feb07435d7c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:36:36.558712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12d730-3b09-4cc1-b41a-feb07435d7c2 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:36:36.577646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 664/1320] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:36:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:36:39.667729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b503759-a329-44f1-bc28-dba91ad2c149 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:39.668290 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b503759-a329-44f1-bc28-dba91ad2c149 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:39.668290 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b503759-a329-44f1-bc28-dba91ad2c149 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:39.669674 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 657/1321] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:36:39.675776 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3e5d0-8505-41df-9d86-4b0945591666 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:39.676194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3e5d0-8505-41df-9d86-4b0945591666 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:39.676317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3e5d0-8505-41df-9d86-4b0945591666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:39.744935 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-4ba3e5d0-8505-41df-9d86-4b0945591666 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:36:39.746225 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4ba3e5d0-8505-41df-9d86-4b0945591666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:39.805052 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:39.849908 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 665/1322] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:36:39.887316 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b503759-a329-44f1-bc28-dba91ad2c149 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:36:39.888823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2b503759-a329-44f1-bc28-dba91ad2c149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:39.912299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:40.009029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b503759-a329-44f1-bc28-dba91ad2c149 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:36:40.089858 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceef4b5-1cdb-4f58-ad2c-aad7fd21435d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:36:40.090486 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceef4b5-1cdb-4f58-ad2c-aad7fd21435d service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:40.090770 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceef4b5-1cdb-4f58-ad2c-aad7fd21435d service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:40.091581 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceef4b5-1cdb-4f58-ad2c-aad7fd21435d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:40.092685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-dceef4b5-1cdb-4f58-ad2c-aad7fd21435d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:40.172225 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:40.210837 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceef4b5-1cdb-4f58-ad2c-aad7fd21435d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:36:40.212327 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceef4b5-1cdb-4f58-ad2c-aad7fd21435d service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:36:40.231824 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 658/1323] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:36:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:36:42.329710 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043bd56-54f7-415a-bdf3-ecb383d06a9f None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:42.330253 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043bd56-54f7-415a-bdf3-ecb383d06a9f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:42.330253 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043bd56-54f7-415a-bdf3-ecb383d06a9f None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:42.331669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 666/1324] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:36:42.336883 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a17e6d-0081-497a-a9f1-1fc7dcc87482 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:42.337311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a17e6d-0081-497a-a9f1-1fc7dcc87482 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:42.337440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a17e6d-0081-497a-a9f1-1fc7dcc87482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:42.415185 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c1a17e6d-0081-497a-a9f1-1fc7dcc87482 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:36:42.424778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c1a17e6d-0081-497a-a9f1-1fc7dcc87482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:42.582437 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 659/1325] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:36:42.587067 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f2e9e-fdf9-4e78-b718-867da5788646 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:42.587454 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f2e9e-fdf9-4e78-b718-867da5788646 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:42.587857 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f2e9e-fdf9-4e78-b718-867da5788646 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:42.589485 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 667/1326] 10.222.0.65 () {54 vars in 965 bytes} [Wed Jul 27 18:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:36:42.596187 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe8417-2edd-4cae-b583-1b605878935e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:42.596564 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe8417-2edd-4cae-b583-1b605878935e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:42.596915 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe8417-2edd-4cae-b583-1b605878935e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:42.629074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:42.677635 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c5fe8417-2edd-4cae-b583-1b605878935e None None] MFA Rules not processed for user `ffee4a13d4fd4f86bd1c79b4535a0c55`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:36:42.679994 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c5fe8417-2edd-4cae-b583-1b605878935e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:42.762444 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 660/1327] 10.222.0.65 () {58 vars in 1062 bytes} [Wed Jul 27 18:36:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:36:42.771822 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f2e9e-fdf9-4e78-b718-867da5788646 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:36:42.773353 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e10f2e9e-fdf9-4e78-b718-867da5788646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:42.883097 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f2e9e-fdf9-4e78-b718-867da5788646 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:36:42.962590 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3f990-4fec-495b-91fa-5d5fdde79b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:36:42.963209 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3f990-4fec-495b-91fa-5d5fdde79b18 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:42.963524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3f990-4fec-495b-91fa-5d5fdde79b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:42.963801 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3f990-4fec-495b-91fa-5d5fdde79b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:42.965456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a4d3f990-4fec-495b-91fa-5d5fdde79b18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:42.982810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:43.082732 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3f990-4fec-495b-91fa-5d5fdde79b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:36:43.084376 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3f990-4fec-495b-91fa-5d5fdde79b18 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:36:43.104107 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 668/1328] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:36:45.440396 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432748b-89a4-4cb3-8d61-18cbded9fe76 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:45.440962 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432748b-89a4-4cb3-8d61-18cbded9fe76 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:45.440962 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432748b-89a4-4cb3-8d61-18cbded9fe76 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:45.442349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 661/1329] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:36:45.447622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04225f5-e371-43fc-8eaf-a1c3b4377f45 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:45.448092 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04225f5-e371-43fc-8eaf-a1c3b4377f45 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:45.448203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04225f5-e371-43fc-8eaf-a1c3b4377f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:45.517618 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-f04225f5-e371-43fc-8eaf-a1c3b4377f45 None None] MFA Rules not processed for user `034095ad77554819b83324ec8dd53a22`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:36:45.518760 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-f04225f5-e371-43fc-8eaf-a1c3b4377f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:45.595431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:45.636823 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 669/1330] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:36:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:36:45.676337 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432748b-89a4-4cb3-8d61-18cbded9fe76 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:36:45.677889 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b432748b-89a4-4cb3-8d61-18cbded9fe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:45.807188 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432748b-89a4-4cb3-8d61-18cbded9fe76 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:36:45.830809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:45.886104 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664178b-2acd-4322-a56a-ec4cf9c48f76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:36:45.886718 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664178b-2acd-4322-a56a-ec4cf9c48f76 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:45.886995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664178b-2acd-4322-a56a-ec4cf9c48f76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:45.887280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664178b-2acd-4322-a56a-ec4cf9c48f76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:45.888910 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b664178b-2acd-4322-a56a-ec4cf9c48f76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:46.016593 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664178b-2acd-4322-a56a-ec4cf9c48f76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:36:46.018060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664178b-2acd-4322-a56a-ec4cf9c48f76 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:36:46.038279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 662/1331] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:36:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:36:48.610411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d085fb-3fae-4bda-ac96-babf71f44aaf None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:48.610994 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d085fb-3fae-4bda-ac96-babf71f44aaf None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:48.610994 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d085fb-3fae-4bda-ac96-babf71f44aaf None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:48.612373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 670/1332] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:36:48.617442 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bfa55-99e4-451b-9431-729b65b0ef79 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:48.617856 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bfa55-99e4-451b-9431-729b65b0ef79 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:48.617996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bfa55-99e4-451b-9431-729b65b0ef79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:48.681295 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:48.683953 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b24bfa55-99e4-451b-9431-729b65b0ef79 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:36:48.685160 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b24bfa55-99e4-451b-9431-729b65b0ef79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:48.787184 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 663/1333] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:36:48.823012 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d085fb-3fae-4bda-ac96-babf71f44aaf None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:36:48.824634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-34d085fb-3fae-4bda-ac96-babf71f44aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:48.928852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d085fb-3fae-4bda-ac96-babf71f44aaf None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:36:49.003016 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f9e5f-f6c9-4293-a593-000343958d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:36:49.003807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f9e5f-f6c9-4293-a593-000343958d8b service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:49.004086 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f9e5f-f6c9-4293-a593-000343958d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:49.004358 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f9e5f-f6c9-4293-a593-000343958d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:49.005988 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-693f9e5f-f6c9-4293-a593-000343958d8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:49.035395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:49.237608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f9e5f-f6c9-4293-a593-000343958d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:36:49.239060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f9e5f-f6c9-4293-a593-000343958d8b service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:36:49.257509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 671/1334] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:36:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:36:51.344322 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf610c51-40e9-4b12-b937-81543fda1781 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:51.344891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf610c51-40e9-4b12-b937-81543fda1781 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:51.344891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf610c51-40e9-4b12-b937-81543fda1781 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:51.346310 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 664/1335] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:36:51.352094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc6f75-89d6-4de7-b152-cf62d1f6398c None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:51.352553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc6f75-89d6-4de7-b152-cf62d1f6398c None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:51.352649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc6f75-89d6-4de7-b152-cf62d1f6398c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:51.427103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-31fc6f75-89d6-4de7-b152-cf62d1f6398c None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:36:51.428433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-31fc6f75-89d6-4de7-b152-cf62d1f6398c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:51.504170 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:51.526151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 672/1336] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:36:51.566673 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf610c51-40e9-4b12-b937-81543fda1781 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:36:51.568325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-bf610c51-40e9-4b12-b937-81543fda1781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:51.675383 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf610c51-40e9-4b12-b937-81543fda1781 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:36:51.708480 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:51.754558 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf5f88-aca8-4d6e-9084-d84eb5585f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:36:51.755175 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf5f88-aca8-4d6e-9084-d84eb5585f99 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:51.755484 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf5f88-aca8-4d6e-9084-d84eb5585f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:51.755757 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf5f88-aca8-4d6e-9084-d84eb5585f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:51.757377 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7abf5f88-aca8-4d6e-9084-d84eb5585f99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:51.867755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf5f88-aca8-4d6e-9084-d84eb5585f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:36:51.869226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf5f88-aca8-4d6e-9084-d84eb5585f99 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:36:51.887788 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 665/1337] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:36:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:36:54.664915 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81782a7d-5b0a-4238-9004-6d319aa11afc None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:54.665472 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81782a7d-5b0a-4238-9004-6d319aa11afc None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:54.665472 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81782a7d-5b0a-4238-9004-6d319aa11afc None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:54.666850 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 673/1338] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:36:54.672656 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2916f6-44fc-42c5-bcea-d0544c4ed33f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:54.673062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2916f6-44fc-42c5-bcea-d0544c4ed33f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:54.673221 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2916f6-44fc-42c5-bcea-d0544c4ed33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:54.742146 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-7f2916f6-44fc-42c5-bcea-d0544c4ed33f None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:36:54.743415 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7f2916f6-44fc-42c5-bcea-d0544c4ed33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:54.752400 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:54.847330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 666/1339] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:36:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:36:54.884187 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81782a7d-5b0a-4238-9004-6d319aa11afc None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:36:54.885719 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-81782a7d-5b0a-4238-9004-6d319aa11afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:54.987922 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81782a7d-5b0a-4238-9004-6d319aa11afc None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:36:55.061691 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f595151-e863-4605-bfb9-1c96ae180fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:36:55.062317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f595151-e863-4605-bfb9-1c96ae180fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:55.062599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f595151-e863-4605-bfb9-1c96ae180fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:55.062869 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f595151-e863-4605-bfb9-1c96ae180fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:55.064591 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2f595151-e863-4605-bfb9-1c96ae180fc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:55.099876 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:55.173432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f595151-e863-4605-bfb9-1c96ae180fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:36:55.174863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f595151-e863-4605-bfb9-1c96ae180fc6 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:36:55.192952 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 674/1340] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:36:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:36:59.460622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8020a82-3b86-4eb3-92e9-f169dbbc4449 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:59.461151 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8020a82-3b86-4eb3-92e9-f169dbbc4449 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:59.461151 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8020a82-3b86-4eb3-92e9-f169dbbc4449 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:59.463045 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 667/1341] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:36:59.468359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dbb27-8d52-4f9b-b238-d36315627b96 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:59.468973 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dbb27-8d52-4f9b-b238-d36315627b96 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:59.468973 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dbb27-8d52-4f9b-b238-d36315627b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:59.541903 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-8a6dbb27-8d52-4f9b-b238-d36315627b96 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:36:59.543252 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-8a6dbb27-8d52-4f9b-b238-d36315627b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:59.645263 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:59.657313 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 675/1342] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:36:59.696989 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8020a82-3b86-4eb3-92e9-f169dbbc4449 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:36:59.698549 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b8020a82-3b86-4eb3-92e9-f169dbbc4449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:36:59.808991 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8020a82-3b86-4eb3-92e9-f169dbbc4449 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:36:59.849647 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:36:59.887427 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bb67d-aa3c-40fa-b398-62174ec08628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:36:59.888056 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bb67d-aa3c-40fa-b398-62174ec08628 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:36:59.888344 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bb67d-aa3c-40fa-b398-62174ec08628 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:36:59.888623 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bb67d-aa3c-40fa-b398-62174ec08628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:36:59.891169 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e87bb67d-aa3c-40fa-b398-62174ec08628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:00.005782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87bb67d-aa3c-40fa-b398-62174ec08628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:37:00.007236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87bb67d-aa3c-40fa-b398-62174ec08628 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:37:00.027132 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 668/1343] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:37:03.206440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d4343-d270-4c68-934b-9fc2b1ec1225 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:03.206982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d4343-d270-4c68-934b-9fc2b1ec1225 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:03.206982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d4343-d270-4c68-934b-9fc2b1ec1225 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:03.208511 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 676/1344] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:37:03.213900 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc9660-2170-4b31-9124-51fb9e28e6c0 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:03.214358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc9660-2170-4b31-9124-51fb9e28e6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:03.214599 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc9660-2170-4b31-9124-51fb9e28e6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:03.284155 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-84dc9660-2170-4b31-9124-51fb9e28e6c0 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:03.285277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-84dc9660-2170-4b31-9124-51fb9e28e6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:03.304256 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:03.386677 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 669/1345] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:37:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:37:03.425187 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d4343-d270-4c68-934b-9fc2b1ec1225 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:37:03.426782 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a67d4343-d270-4c68-934b-9fc2b1ec1225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:03.536670 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d4343-d270-4c68-934b-9fc2b1ec1225 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:37:03.623525 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53febbe6-a502-495c-8735-4b0d7bf6ae8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:37:03.624218 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53febbe6-a502-495c-8735-4b0d7bf6ae8d service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:03.624498 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53febbe6-a502-495c-8735-4b0d7bf6ae8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:03.624769 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53febbe6-a502-495c-8735-4b0d7bf6ae8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:03.626540 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-53febbe6-a502-495c-8735-4b0d7bf6ae8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:03.676270 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:03.746414 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53febbe6-a502-495c-8735-4b0d7bf6ae8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:37:03.747882 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53febbe6-a502-495c-8735-4b0d7bf6ae8d service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:37:03.766788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 677/1346] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:37:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:37:08.032520 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0983f-13f7-4976-a6c2-30f9941dac67 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:08.033051 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0983f-13f7-4976-a6c2-30f9941dac67 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:08.033051 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0983f-13f7-4976-a6c2-30f9941dac67 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:08.034468 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 670/1347] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:37:08.040136 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda08dd7-4b0b-49ca-88db-5e006d634a6f None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:08.040639 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda08dd7-4b0b-49ca-88db-5e006d634a6f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:08.040737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda08dd7-4b0b-49ca-88db-5e006d634a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:08.114425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-dda08dd7-4b0b-49ca-88db-5e006d634a6f None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:08.115693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-dda08dd7-4b0b-49ca-88db-5e006d634a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:08.218762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:08.222206 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 678/1348] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:37:08.260778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0983f-13f7-4976-a6c2-30f9941dac67 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:37:08.262358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-50b0983f-13f7-4976-a6c2-30f9941dac67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:08.378094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0983f-13f7-4976-a6c2-30f9941dac67 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:37:08.434225 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:08.463409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079eec6-1b34-49c8-bac8-6b52e8c81b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:37:08.464041 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079eec6-1b34-49c8-bac8-6b52e8c81b99 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:08.464325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079eec6-1b34-49c8-bac8-6b52e8c81b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:08.464605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079eec6-1b34-49c8-bac8-6b52e8c81b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:08.466301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9079eec6-1b34-49c8-bac8-6b52e8c81b99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:08.586682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079eec6-1b34-49c8-bac8-6b52e8c81b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:37:08.588182 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079eec6-1b34-49c8-bac8-6b52e8c81b99 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:37:08.609003 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 671/1349] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:37:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:37:13.815601 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683cadb-ce55-4f34-a397-1c08217fd9e9 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:13.816833 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683cadb-ce55-4f34-a397-1c08217fd9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:13.817283 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683cadb-ce55-4f34-a397-1c08217fd9e9 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:13.819048 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 679/1350] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 18:37:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:37:13.825574 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f991b6a-7c32-44f6-9d31-309d1e4a6a2f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:13.826408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f991b6a-7c32-44f6-9d31-309d1e4a6a2f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:13.827049 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f991b6a-7c32-44f6-9d31-309d1e4a6a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:13.975555 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5f991b6a-7c32-44f6-9d31-309d1e4a6a2f None None] MFA Rules not processed for user `aa971da983ea48c3b6d4c68a5d454bde`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:13.977117 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5f991b6a-7c32-44f6-9d31-309d1e4a6a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:14.000161 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:14.105200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 672/1351] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 18:37:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:37:18.313525 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef0a00-8ca7-477f-aa8d-afd7af1d9952 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:18.314372 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef0a00-8ca7-477f-aa8d-afd7af1d9952 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:18.314877 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef0a00-8ca7-477f-aa8d-afd7af1d9952 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:18.316796 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 680/1352] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 18:37:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:37:18.322118 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761eb7c-baf1-4035-9ba1-3f806c3c3cae None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:18.322946 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761eb7c-baf1-4035-9ba1-3f806c3c3cae None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:18.323478 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761eb7c-baf1-4035-9ba1-3f806c3c3cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:18.409555 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c761eb7c-baf1-4035-9ba1-3f806c3c3cae None None] MFA Rules not processed for user `aa971da983ea48c3b6d4c68a5d454bde`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:18.411140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c761eb7c-baf1-4035-9ba1-3f806c3c3cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:18.491292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:18.543584 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 673/1353] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 18:37:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:37:19.858984 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a264e-dc26-4b13-8900-c968c799f686 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:19.859549 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a264e-dc26-4b13-8900-c968c799f686 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:19.859549 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a264e-dc26-4b13-8900-c968c799f686 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:19.860808 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 681/1354] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 18:37:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:37:19.866194 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5658f-5909-4500-bb74-c438329048b8 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:19.866688 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5658f-5909-4500-bb74-c438329048b8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:19.866911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5658f-5909-4500-bb74-c438329048b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:19.946615 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-8eb5658f-5909-4500-bb74-c438329048b8 None None] MFA Rules not processed for user `aa971da983ea48c3b6d4c68a5d454bde`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:19.947872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8eb5658f-5909-4500-bb74-c438329048b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:20.060101 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 674/1355] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 18:37:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:37:23.556287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f1eab-861d-46e8-97aa-6c7b5c4802ac None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:23.561826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f1eab-861d-46e8-97aa-6c7b5c4802ac None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:23.563321 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f1eab-861d-46e8-97aa-6c7b5c4802ac None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:23.567053 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 682/1356] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:37:23 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:37:23.571647 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a7b3d-7deb-48c8-b825-8a73a56122e4 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:23.572457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a7b3d-7deb-48c8-b825-8a73a56122e4 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:23.572791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a7b3d-7deb-48c8-b825-8a73a56122e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:23.626074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:23.667373 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-735a7b3d-7deb-48c8-b825-8a73a56122e4 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:23.668613 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-735a7b3d-7deb-48c8-b825-8a73a56122e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:23.788026 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 675/1357] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:37:23.846406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fe890-42fd-4bcb-a837-15f5315c65ae None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:23.847329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fe890-42fd-4bcb-a837-15f5315c65ae None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:23.847816 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fe890-42fd-4bcb-a837-15f5315c65ae None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:23.849850 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 683/1358] 10.222.0.65 () {54 vars in 962 bytes} [Wed Jul 27 18:37:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:37:23.860401 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b1ed5-0e78-46f1-b9d8-15b7f23fd024 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:23.860958 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b1ed5-0e78-46f1-b9d8-15b7f23fd024 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:23.861402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b1ed5-0e78-46f1-b9d8-15b7f23fd024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:23.963572 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-089b1ed5-0e78-46f1-b9d8-15b7f23fd024 None None] MFA Rules not processed for user `be769d4dd016466f9174e7d5e47a2a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:23.965056 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-089b1ed5-0e78-46f1-b9d8-15b7f23fd024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:24.020877 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:24.094563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 676/1359] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Jul 27 18:37:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:37:24.102418 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fe890-42fd-4bcb-a837-15f5315c65ae None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:37:24.104383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-027fe890-42fd-4bcb-a837-15f5315c65ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:24.275750 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fe890-42fd-4bcb-a837-15f5315c65ae None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:37:24.363873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:24.400158 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4741bee-8b2e-4333-88a8-ba6ca106617b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:37:24.401077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4741bee-8b2e-4333-88a8-ba6ca106617b service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:24.401574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4741bee-8b2e-4333-88a8-ba6ca106617b service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:24.402012 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4741bee-8b2e-4333-88a8-ba6ca106617b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:24.403864 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b4741bee-8b2e-4333-88a8-ba6ca106617b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:24.512078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4741bee-8b2e-4333-88a8-ba6ca106617b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:37:24.514457 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4741bee-8b2e-4333-88a8-ba6ca106617b service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:37:24.534031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 684/1360] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:37:26.837254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34caaf5-c05a-4569-a499-3b2569890799 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:26.837844 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34caaf5-c05a-4569-a499-3b2569890799 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:26.837844 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34caaf5-c05a-4569-a499-3b2569890799 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:26.839467 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 677/1361] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:37:26.844975 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504350bc-dbb7-4ec4-aacd-35fa780752bb None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:26.845453 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504350bc-dbb7-4ec4-aacd-35fa780752bb None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:26.845742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504350bc-dbb7-4ec4-aacd-35fa780752bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:26.919580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-504350bc-dbb7-4ec4-aacd-35fa780752bb None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:26.921140 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-504350bc-dbb7-4ec4-aacd-35fa780752bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:26.960163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:27.022373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 685/1362] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:37:27.069089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34caaf5-c05a-4569-a499-3b2569890799 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:37:27.070605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d34caaf5-c05a-4569-a499-3b2569890799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:27.262876 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34caaf5-c05a-4569-a499-3b2569890799 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:37:27.274832 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:27.402938 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef2292-222b-4dd0-98b9-551e32846272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:37:27.402938 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef2292-222b-4dd0-98b9-551e32846272 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:27.402938 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef2292-222b-4dd0-98b9-551e32846272 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:27.403841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef2292-222b-4dd0-98b9-551e32846272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:27.405111 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cfef2292-222b-4dd0-98b9-551e32846272 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:27.515616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef2292-222b-4dd0-98b9-551e32846272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:37:27.517251 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef2292-222b-4dd0-98b9-551e32846272 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:37:27.536543 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 678/1363] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:37:30.081768 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddcf63-1c23-4bf7-94ac-1a9398d6d29f None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:30.082306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddcf63-1c23-4bf7-94ac-1a9398d6d29f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:30.082306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddcf63-1c23-4bf7-94ac-1a9398d6d29f None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:30.083715 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 686/1364] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:37:30.088928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b804e9-a260-4d1e-bd7d-af02b011907c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:30.089377 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b804e9-a260-4d1e-bd7d-af02b011907c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:30.089563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b804e9-a260-4d1e-bd7d-af02b011907c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:30.108627 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:30.168626 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a4b804e9-a260-4d1e-bd7d-af02b011907c None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:30.169844 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a4b804e9-a260-4d1e-bd7d-af02b011907c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:30.279194 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 679/1365] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:37:30.326820 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25babf59-5112-4f95-a3e7-91e4c156dcbe None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:30.332685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25babf59-5112-4f95-a3e7-91e4c156dcbe None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:30.332685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25babf59-5112-4f95-a3e7-91e4c156dcbe None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:30.332685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 687/1366] 10.222.0.65 () {54 vars in 962 bytes} [Wed Jul 27 18:37:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:37:30.339818 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a702c4-bddc-4839-8601-fd2f79154c79 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:30.340113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a702c4-bddc-4839-8601-fd2f79154c79 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:30.340392 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a702c4-bddc-4839-8601-fd2f79154c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:30.427084 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-18a702c4-bddc-4839-8601-fd2f79154c79 None None] MFA Rules not processed for user `be769d4dd016466f9174e7d5e47a2a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:30.428338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-18a702c4-bddc-4839-8601-fd2f79154c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:30.469192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:30.572968 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 680/1367] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Jul 27 18:37:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:37:30.581234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25babf59-5112-4f95-a3e7-91e4c156dcbe None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:37:30.582994 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-25babf59-5112-4f95-a3e7-91e4c156dcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:30.743633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25babf59-5112-4f95-a3e7-91e4c156dcbe None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:37:30.766539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:30.866417 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee7f1e-19e9-466a-978e-26dc525125b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:37:30.867044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee7f1e-19e9-466a-978e-26dc525125b4 service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:30.867365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee7f1e-19e9-466a-978e-26dc525125b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:30.867961 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee7f1e-19e9-466a-978e-26dc525125b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:30.869290 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-12ee7f1e-19e9-466a-978e-26dc525125b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:30.971826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee7f1e-19e9-466a-978e-26dc525125b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:37:30.973732 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee7f1e-19e9-466a-978e-26dc525125b4 service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:37:30.999566 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 688/1368] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:37:31.921492 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49517159-2743-495d-9dc0-c0f74389aa10 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:31.921985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49517159-2743-495d-9dc0-c0f74389aa10 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:31.922081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49517159-2743-495d-9dc0-c0f74389aa10 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:31.927321 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 681/1369] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:37:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:37:31.929290 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b56bc-263c-439e-ae75-c076c693abd2 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:31.929748 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b56bc-263c-439e-ae75-c076c693abd2 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:31.929845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b56bc-263c-439e-ae75-c076c693abd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:31.967983 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:32.006178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-a30b56bc-263c-439e-ae75-c076c693abd2 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:32.007444 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a30b56bc-263c-439e-ae75-c076c693abd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:32.119303 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 689/1370] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:37:32.477786 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08457857-7862-4a9c-b2ca-087e1cb7ca86 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:32.478075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08457857-7862-4a9c-b2ca-087e1cb7ca86 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:32.478354 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08457857-7862-4a9c-b2ca-087e1cb7ca86 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:32.479996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 682/1371] 10.222.0.65 () {54 vars in 964 bytes} [Wed Jul 27 18:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:37:32.485770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e39005-e732-4e71-9051-0e4c36ac62b1 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:32.486069 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e39005-e732-4e71-9051-0e4c36ac62b1 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:32.486351 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e39005-e732-4e71-9051-0e4c36ac62b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:32.576539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-57e39005-e732-4e71-9051-0e4c36ac62b1 None None] MFA Rules not processed for user `e5579f23592846abb3273cc5f5658ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:32.577769 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-57e39005-e732-4e71-9051-0e4c36ac62b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:32.629150 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:32.658969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 690/1372] 10.222.0.65 () {58 vars in 1061 bytes} [Wed Jul 27 18:37:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:37:32.667230 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08457857-7862-4a9c-b2ca-087e1cb7ca86 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:37:32.668967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-08457857-7862-4a9c-b2ca-087e1cb7ca86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:32.786776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08457857-7862-4a9c-b2ca-087e1cb7ca86 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:37:32.829685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:32.868235 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50be65d-e4da-433c-8f10-7787fe78f17d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:37:32.868957 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50be65d-e4da-433c-8f10-7787fe78f17d service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:32.869312 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50be65d-e4da-433c-8f10-7787fe78f17d service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:32.869659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50be65d-e4da-433c-8f10-7787fe78f17d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:32.871409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c50be65d-e4da-433c-8f10-7787fe78f17d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:32.991881 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50be65d-e4da-433c-8f10-7787fe78f17d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:37:32.995456 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50be65d-e4da-433c-8f10-7787fe78f17d service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:37:33.015183 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 683/1373] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:37:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:37:33.358262 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4adb9-ab2e-446a-987e-190b7692fc29 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:33.358262 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4adb9-ab2e-446a-987e-190b7692fc29 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:33.358262 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4adb9-ab2e-446a-987e-190b7692fc29 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:33.364263 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 691/1374] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:37:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:37:33.366653 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecfaac-c7a9-4a84-9c6e-1ff74480638e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:33.367064 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecfaac-c7a9-4a84-9c6e-1ff74480638e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:33.367512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecfaac-c7a9-4a84-9c6e-1ff74480638e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:33.456209 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-dbecfaac-c7a9-4a84-9c6e-1ff74480638e None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:33.457537 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-dbecfaac-c7a9-4a84-9c6e-1ff74480638e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:33.480737 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:33.565808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 684/1375] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:37:33.610471 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4adb9-ab2e-446a-987e-190b7692fc29 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:37:33.612067 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-9fc4adb9-ab2e-446a-987e-190b7692fc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:33.764368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4adb9-ab2e-446a-987e-190b7692fc29 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:37:33.818184 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:33.883136 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fc3e7-dc21-4d1b-bb51-849544854bd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:37:33.883789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fc3e7-dc21-4d1b-bb51-849544854bd3 service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:33.884076 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fc3e7-dc21-4d1b-bb51-849544854bd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:33.884668 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fc3e7-dc21-4d1b-bb51-849544854bd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:33.886311 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4d7fc3e7-dc21-4d1b-bb51-849544854bd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:33.978190 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fc3e7-dc21-4d1b-bb51-849544854bd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:37:33.979886 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fc3e7-dc21-4d1b-bb51-849544854bd3 service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:37:33.998750 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 692/1376] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:37:36.183739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0657d8d-32cd-4cc0-9bda-ee38cc494dcb None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:36.184257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0657d8d-32cd-4cc0-9bda-ee38cc494dcb None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:36.184257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0657d8d-32cd-4cc0-9bda-ee38cc494dcb None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:36.186415 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 685/1377] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:37:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:37:36.191839 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123a2a4-f74e-4ccb-ab4e-d0c3bdc7250e None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:36.192261 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123a2a4-f74e-4ccb-ab4e-d0c3bdc7250e None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:36.192666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123a2a4-f74e-4ccb-ab4e-d0c3bdc7250e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:36.266948 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-8123a2a4-f74e-4ccb-ab4e-d0c3bdc7250e None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:36.268212 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-8123a2a4-f74e-4ccb-ab4e-d0c3bdc7250e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:36.275580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:36.383115 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 693/1378] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:37:36.432023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0657d8d-32cd-4cc0-9bda-ee38cc494dcb None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:37:36.433563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d0657d8d-32cd-4cc0-9bda-ee38cc494dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:36.594280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0657d8d-32cd-4cc0-9bda-ee38cc494dcb None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:37:36.598035 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:36.728972 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c0434-d758-49cb-b624-3fe1ef9b9054 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:37:36.729388 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c0434-d758-49cb-b624-3fe1ef9b9054 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:36.732074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c0434-d758-49cb-b624-3fe1ef9b9054 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:36.732074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c0434-d758-49cb-b624-3fe1ef9b9054 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:36.736417 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6a0c0434-d758-49cb-b624-3fe1ef9b9054 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:36.859666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c0434-d758-49cb-b624-3fe1ef9b9054 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:37:36.861211 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c0434-d758-49cb-b624-3fe1ef9b9054 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:37:36.886347 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 686/1379] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:37:39.123373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c90261-abdc-483b-aa66-b6aa60690b0b None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:39.123924 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c90261-abdc-483b-aa66-b6aa60690b0b None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:39.123924 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c90261-abdc-483b-aa66-b6aa60690b0b None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:39.125461 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 694/1380] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:37:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:37:39.130655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d139dfa-1252-4ce4-b49f-0fe451d5dabb None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:39.131129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d139dfa-1252-4ce4-b49f-0fe451d5dabb None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:39.131428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d139dfa-1252-4ce4-b49f-0fe451d5dabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:39.144635 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:39.220219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-4d139dfa-1252-4ce4-b49f-0fe451d5dabb None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:39.221574 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4d139dfa-1252-4ce4-b49f-0fe451d5dabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:39.326737 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 687/1381] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:37:39.373439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c90261-abdc-483b-aa66-b6aa60690b0b None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:37:39.375180 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-89c90261-abdc-483b-aa66-b6aa60690b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:39.527100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:39.542076 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c90261-abdc-483b-aa66-b6aa60690b0b None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:37:39.686420 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bedb11-b4d3-4f41-a907-7f283df6091e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:37:39.687064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bedb11-b4d3-4f41-a907-7f283df6091e service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:39.687497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bedb11-b4d3-4f41-a907-7f283df6091e service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:39.687662 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bedb11-b4d3-4f41-a907-7f283df6091e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:39.689326 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-98bedb11-b4d3-4f41-a907-7f283df6091e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:39.796603 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bedb11-b4d3-4f41-a907-7f283df6091e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:37:39.798356 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bedb11-b4d3-4f41-a907-7f283df6091e service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:37:39.810479 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:39.820095 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 695/1382] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:37:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:37:42.079653 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e6172-5939-40de-bda4-bb3849d23ad7 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:42.080346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e6172-5939-40de-bda4-bb3849d23ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:42.080636 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e6172-5939-40de-bda4-bb3849d23ad7 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:42.083087 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 688/1383] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:37:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:37:42.088362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9198c-ed05-4bfe-8f0a-272813b5cc15 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:42.088860 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9198c-ed05-4bfe-8f0a-272813b5cc15 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:42.088958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9198c-ed05-4bfe-8f0a-272813b5cc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:42.185928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-b2d9198c-ed05-4bfe-8f0a-272813b5cc15 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:42.187097 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b2d9198c-ed05-4bfe-8f0a-272813b5cc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:42.295844 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 696/1384] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:37:42.347553 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e6172-5939-40de-bda4-bb3849d23ad7 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:37:42.349182 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6a4e6172-5939-40de-bda4-bb3849d23ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:42.451346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:42.517300 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e6172-5939-40de-bda4-bb3849d23ad7 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:37:42.644525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eea302-f8aa-4786-a973-953f643d6e4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:37:42.645155 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eea302-f8aa-4786-a973-953f643d6e4c service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:42.645440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eea302-f8aa-4786-a973-953f643d6e4c service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:42.645715 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eea302-f8aa-4786-a973-953f643d6e4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:42.647392 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-73eea302-f8aa-4786-a973-953f643d6e4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:42.700783 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:42.747639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eea302-f8aa-4786-a973-953f643d6e4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:37:42.749212 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eea302-f8aa-4786-a973-953f643d6e4c service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:37:42.767534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 689/1385] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:37:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:37:45.134469 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ee186-b6d3-45fb-aa22-191137a350e1 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:45.135178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ee186-b6d3-45fb-aa22-191137a350e1 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:45.135178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ee186-b6d3-45fb-aa22-191137a350e1 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:45.136508 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 697/1386] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:37:45.145102 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf0abd-eb99-4abf-a4ac-473b272ee0e7 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:45.145775 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf0abd-eb99-4abf-a4ac-473b272ee0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:45.145775 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf0abd-eb99-4abf-a4ac-473b272ee0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:45.252668 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-acaf0abd-eb99-4abf-a4ac-473b272ee0e7 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:45.253965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-acaf0abd-eb99-4abf-a4ac-473b272ee0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:45.375152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 690/1387] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:37:45.421653 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ee186-b6d3-45fb-aa22-191137a350e1 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:37:45.423233 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-628ee186-b6d3-45fb-aa22-191137a350e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:45.509670 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:45.595778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ee186-b6d3-45fb-aa22-191137a350e1 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:37:45.726475 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13252f40-edf4-45ef-aeed-bd9b008086e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:37:45.727384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13252f40-edf4-45ef-aeed-bd9b008086e3 service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:45.727686 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13252f40-edf4-45ef-aeed-bd9b008086e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:45.727979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13252f40-edf4-45ef-aeed-bd9b008086e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:45.729686 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-13252f40-edf4-45ef-aeed-bd9b008086e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:45.771383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:45.834889 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13252f40-edf4-45ef-aeed-bd9b008086e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:37:45.837093 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13252f40-edf4-45ef-aeed-bd9b008086e3 service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:37:45.862669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 698/1388] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:37:48.237213 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3517ed-afa6-4923-b397-330f7b75e284 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:48.237770 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3517ed-afa6-4923-b397-330f7b75e284 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:48.237770 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3517ed-afa6-4923-b397-330f7b75e284 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:48.239085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 691/1389] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:37:48.244353 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4e440-0d70-4523-92b8-fc407288e740 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:48.244798 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4e440-0d70-4523-92b8-fc407288e740 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:48.244896 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4e440-0d70-4523-92b8-fc407288e740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:48.313683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-33e4e440-0d70-4523-92b8-fc407288e740 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:48.314676 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-33e4e440-0d70-4523-92b8-fc407288e740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:48.426439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 699/1390] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:37:48.471768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3517ed-afa6-4923-b397-330f7b75e284 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:37:48.473287 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cf3517ed-afa6-4923-b397-330f7b75e284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:48.506598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:48.631365 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3517ed-afa6-4923-b397-330f7b75e284 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:37:48.738780 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:48.749742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bce8a8-3a32-4956-88c2-a4c8bd6fd09b None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:48.752758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bce8a8-3a32-4956-88c2-a4c8bd6fd09b None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:48.752758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bce8a8-3a32-4956-88c2-a4c8bd6fd09b None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:48.752987 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b2d66-a445-4fd8-acdc-49db805a0132 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:37:48.752987 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b2d66-a445-4fd8-acdc-49db805a0132 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:48.753184 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 700/1391] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:37:48.753266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b2d66-a445-4fd8-acdc-49db805a0132 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:48.753266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b2d66-a445-4fd8-acdc-49db805a0132 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:48.753707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-bc5b2d66-a445-4fd8-acdc-49db805a0132 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:48.756705 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ba84c-d36c-4662-b44d-0f620d693ad3 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:48.757121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ba84c-d36c-4662-b44d-0f620d693ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:48.757519 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ba84c-d36c-4662-b44d-0f620d693ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:48.773486 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:48.828512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-0b0ba84c-d36c-4662-b44d-0f620d693ad3 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:48.829744 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-0b0ba84c-d36c-4662-b44d-0f620d693ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:48.848757 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b2d66-a445-4fd8-acdc-49db805a0132 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:37:48.849795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b2d66-a445-4fd8-acdc-49db805a0132 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:37:48.869156 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 692/1392] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:37:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:37:48.935812 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 701/1393] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:37:48.992342 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9517e-8966-40a9-9260-ed7204db2b28 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:48.992637 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9517e-8966-40a9-9260-ed7204db2b28 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:48.992917 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9517e-8966-40a9-9260-ed7204db2b28 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:48.994289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 693/1394] 10.222.0.65 () {54 vars in 966 bytes} [Wed Jul 27 18:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:37:49.000310 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2290bd-a2ab-4e28-8b86-66eec014c917 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:49.000607 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2290bd-a2ab-4e28-8b86-66eec014c917 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:49.000892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2290bd-a2ab-4e28-8b86-66eec014c917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:49.079079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-1b2290bd-a2ab-4e28-8b86-66eec014c917 None None] MFA Rules not processed for user `d49a34cd99ab47bb92af6ed2f82fefde`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:49.080238 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-1b2290bd-a2ab-4e28-8b86-66eec014c917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:49.114766 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:49.167974 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 702/1395] 10.222.0.65 () {58 vars in 1063 bytes} [Wed Jul 27 18:37:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:37:49.175877 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9517e-8966-40a9-9260-ed7204db2b28 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:37:49.177394 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d0e9517e-8966-40a9-9260-ed7204db2b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:49.294526 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9517e-8966-40a9-9260-ed7204db2b28 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:37:49.308648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:49.373823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736002bc-4d37-4d56-9eeb-8078392e0c18 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49a34cd99ab47bb92af6ed2f82fefde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:37:49.374361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736002bc-4d37-4d56-9eeb-8078392e0c18 service glance] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:49.374637 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736002bc-4d37-4d56-9eeb-8078392e0c18 service glance] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:49.374910 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736002bc-4d37-4d56-9eeb-8078392e0c18 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:49.376623 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-736002bc-4d37-4d56-9eeb-8078392e0c18 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:49.498679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736002bc-4d37-4d56-9eeb-8078392e0c18 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:37:49.500183 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736002bc-4d37-4d56-9eeb-8078392e0c18 service glance] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:37:49.520188 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 694/1396] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:37:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:37:50.410448 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba800fe-77a4-43ae-8884-a2552a5fe1a0 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:50.411122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba800fe-77a4-43ae-8884-a2552a5fe1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:50.411122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba800fe-77a4-43ae-8884-a2552a5fe1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:50.481033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-aba800fe-77a4-43ae-8884-a2552a5fe1a0 None None] MFA Rules not processed for user `5b4c4184e87b4dc5a4047310cd0122ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:50.482152 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-aba800fe-77a4-43ae-8884-a2552a5fe1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:50.578793 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 703/1397] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 18:37:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:37:50.626216 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28af7d0-9a6c-413c-9540-ddea31315046 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:50.626728 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28af7d0-9a6c-413c-9540-ddea31315046 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:50.626928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28af7d0-9a6c-413c-9540-ddea31315046 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:50.628414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 695/1398] 10.222.0.65 () {54 vars in 943 bytes} [Wed Jul 27 18:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:37:50.634871 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3a8fe-615c-441e-ae3e-503d0c0906e5 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:50.635343 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3a8fe-615c-441e-ae3e-503d0c0906e5 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:50.635626 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3a8fe-615c-441e-ae3e-503d0c0906e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:50.696091 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:50.717168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-2aa3a8fe-615c-441e-ae3e-503d0c0906e5 None None] MFA Rules not processed for user `7832398e97af4e539e10d1eef49f6d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:50.718376 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2aa3a8fe-615c-441e-ae3e-503d0c0906e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:50.829751 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 704/1399] 10.222.0.65 () {58 vars in 1040 bytes} [Wed Jul 27 18:37:50 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:37:50.838700 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28af7d0-9a6c-413c-9540-ddea31315046 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:37:50.840287 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d28af7d0-9a6c-413c-9540-ddea31315046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:50.886862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:50.980758 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28af7d0-9a6c-413c-9540-ddea31315046 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:37:51.091964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc37fad-c75a-4e33-9aa7-1f3be3890bbb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7832398e97af4e539e10d1eef49f6d6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:37:51.092600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc37fad-c75a-4e33-9aa7-1f3be3890bbb service swift] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:51.092877 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc37fad-c75a-4e33-9aa7-1f3be3890bbb service swift] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:51.093224 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc37fad-c75a-4e33-9aa7-1f3be3890bbb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:51.094859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0bc37fad-c75a-4e33-9aa7-1f3be3890bbb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:51.132992 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:51.158597 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925724f1-0bc9-4707-ae14-13e24d4f442c None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:51.159042 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925724f1-0bc9-4707-ae14-13e24d4f442c None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:51.159503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925724f1-0bc9-4707-ae14-13e24d4f442c None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:51.161013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 705/1400] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:37:51.166748 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577559d-aae4-48ae-8d7d-93ec7d8d6b14 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:51.167570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577559d-aae4-48ae-8d7d-93ec7d8d6b14 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:51.167807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577559d-aae4-48ae-8d7d-93ec7d8d6b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:51.204008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc37fad-c75a-4e33-9aa7-1f3be3890bbb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:37:51.205749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc37fad-c75a-4e33-9aa7-1f3be3890bbb service swift] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:37:51.214797 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 696/1401] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 18:37:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:37:51.249208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-7577559d-aae4-48ae-8d7d-93ec7d8d6b14 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:51.250526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-7577559d-aae4-48ae-8d7d-93ec7d8d6b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:51.309624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:51.352826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 706/1402] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:37:51.400732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc37fad-c75a-4e33-9aa7-1f3be3890bbb service swift] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:37:51.402013 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0bc37fad-c75a-4e33-9aa7-1f3be3890bbb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:51.498135 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc37fad-c75a-4e33-9aa7-1f3be3890bbb service swift] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:37:51.587627 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:51.631493 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a8179-ad4e-459b-89d1-94fa32a901c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:37:51.632139 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a8179-ad4e-459b-89d1-94fa32a901c4 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:51.632392 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a8179-ad4e-459b-89d1-94fa32a901c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:51.632688 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a8179-ad4e-459b-89d1-94fa32a901c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:51.634299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4d1a8179-ad4e-459b-89d1-94fa32a901c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:51.742963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a8179-ad4e-459b-89d1-94fa32a901c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:37:51.744756 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a8179-ad4e-459b-89d1-94fa32a901c4 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:37:51.768248 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 697/1403] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:37:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:37:54.092139 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514bdf0-984f-433e-972a-2006cb8578ce None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:54.092828 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514bdf0-984f-433e-972a-2006cb8578ce None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:54.092828 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514bdf0-984f-433e-972a-2006cb8578ce None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:54.094362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 707/1404] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:37:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:37:54.099793 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1ac6c-3a1b-4127-9971-bf37f8175dc3 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:54.100268 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1ac6c-3a1b-4127-9971-bf37f8175dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:54.100375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1ac6c-3a1b-4127-9971-bf37f8175dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:54.185286 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-d7e1ac6c-3a1b-4127-9971-bf37f8175dc3 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:54.186458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d7e1ac6c-3a1b-4127-9971-bf37f8175dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:54.233081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:54.304261 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 698/1405] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:37:54.350867 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514bdf0-984f-433e-972a-2006cb8578ce None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:37:54.354043 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5514bdf0-984f-433e-972a-2006cb8578ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:54.525308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514bdf0-984f-433e-972a-2006cb8578ce None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:37:54.576576 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:54.661598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffc31d-0982-4309-abd7-df3862f0934f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:37:54.662397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffc31d-0982-4309-abd7-df3862f0934f service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:54.662679 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffc31d-0982-4309-abd7-df3862f0934f service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:54.662953 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffc31d-0982-4309-abd7-df3862f0934f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:54.664802 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-11ffc31d-0982-4309-abd7-df3862f0934f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:54.770611 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffc31d-0982-4309-abd7-df3862f0934f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:37:54.772556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffc31d-0982-4309-abd7-df3862f0934f service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:37:54.795521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 708/1406] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:37:57.035641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d85821-7825-4ffa-a483-760396ed33cb None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:57.036217 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d85821-7825-4ffa-a483-760396ed33cb None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:57.036217 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d85821-7825-4ffa-a483-760396ed33cb None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:57.037580 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 699/1407] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:37:57.042835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f337b7-116a-4c3e-8e46-262ae0169dd5 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:57.044080 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f337b7-116a-4c3e-8e46-262ae0169dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:57.044080 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f337b7-116a-4c3e-8e46-262ae0169dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:57.110686 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:57.118325 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-69f337b7-116a-4c3e-8e46-262ae0169dd5 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:37:57.119618 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-69f337b7-116a-4c3e-8e46-262ae0169dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:57.234948 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 709/1408] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:37:57.280322 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d85821-7825-4ffa-a483-760396ed33cb None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:37:57.281926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a0d85821-7825-4ffa-a483-760396ed33cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:57.465758 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d85821-7825-4ffa-a483-760396ed33cb None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:37:57.485039 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:57.599836 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b667f-2e21-4e2d-9ea6-49bbfed68dd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:37:57.600463 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b667f-2e21-4e2d-9ea6-49bbfed68dd7 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:57.600739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b667f-2e21-4e2d-9ea6-49bbfed68dd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:57.601064 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b667f-2e21-4e2d-9ea6-49bbfed68dd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:57.602956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d88b667f-2e21-4e2d-9ea6-49bbfed68dd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:57.731554 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b667f-2e21-4e2d-9ea6-49bbfed68dd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:37:57.733185 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b667f-2e21-4e2d-9ea6-49bbfed68dd7 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:37:57.753249 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 700/1409] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:37:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:38:07.231978 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=44 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:07.750822 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=90 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:15.497440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b6df7-ff68-4d36-b813-b529999c66c3 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:15.497903 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b6df7-ff68-4d36-b813-b529999c66c3 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:15.498003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b6df7-ff68-4d36-b813-b529999c66c3 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:15.499419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 710/1410] 10.222.0.65 () {54 vars in 918 bytes} [Wed Jul 27 18:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:38:15.506576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440cf8a-7df4-47d9-845f-f72ca21dc3bd None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:15.507073 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440cf8a-7df4-47d9-845f-f72ca21dc3bd None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:15.507182 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440cf8a-7df4-47d9-845f-f72ca21dc3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:15.706180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-3440cf8a-7df4-47d9-845f-f72ca21dc3bd None None] MFA Rules not processed for user `aa971da983ea48c3b6d4c68a5d454bde`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:38:15.707452 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-3440cf8a-7df4-47d9-845f-f72ca21dc3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:15.813950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 701/1411] 10.222.0.65 () {58 vars in 1015 bytes} [Wed Jul 27 18:38:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:38:15.829992 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff489604-19a2-480e-a8bc-fc69d0865182 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:15.830279 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff489604-19a2-480e-a8bc-fc69d0865182 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:15.830589 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff489604-19a2-480e-a8bc-fc69d0865182 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:15.831996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 711/1412] 10.222.0.65 () {54 vars in 918 bytes} [Wed Jul 27 18:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:38:15.836994 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35d399-9ca9-48a1-9581-0064fc753200 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:15.837286 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35d399-9ca9-48a1-9581-0064fc753200 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:15.837563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35d399-9ca9-48a1-9581-0064fc753200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:15.912962 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:15.915522 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-2e35d399-9ca9-48a1-9581-0064fc753200 None None] MFA Rules not processed for user `be769d4dd016466f9174e7d5e47a2a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:38:15.916739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2e35d399-9ca9-48a1-9581-0064fc753200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:16.033766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 702/1413] 10.222.0.65 () {58 vars in 1015 bytes} [Wed Jul 27 18:38:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:38:18.540294 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f01b2a-9df9-482f-bd11-0d7e9b529045 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:18.540836 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f01b2a-9df9-482f-bd11-0d7e9b529045 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:18.540836 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f01b2a-9df9-482f-bd11-0d7e9b529045 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:18.542183 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:38:18.548288 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bc083-beb8-40be-ae21-89d96abba4f8 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:18.548867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bc083-beb8-40be-ae21-89d96abba4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:18.548867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bc083-beb8-40be-ae21-89d96abba4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:18.615528 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-1f0bc083-beb8-40be-ae21-89d96abba4f8 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:38:18.616754 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1f0bc083-beb8-40be-ae21-89d96abba4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:18.672164 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:18.715732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:38:18.758433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f01b2a-9df9-482f-bd11-0d7e9b529045 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:38:18.759990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-d5f01b2a-9df9-482f-bd11-0d7e9b529045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:18.907656 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f01b2a-9df9-482f-bd11-0d7e9b529045 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:38:18.980262 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:19.020113 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16323fc-fbbc-4802-b88c-b0df06027c4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:38:19.020725 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16323fc-fbbc-4802-b88c-b0df06027c4f service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:19.021004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16323fc-fbbc-4802-b88c-b0df06027c4f service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:19.021280 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16323fc-fbbc-4802-b88c-b0df06027c4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:19.022884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-d16323fc-fbbc-4802-b88c-b0df06027c4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:19.111658 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16323fc-fbbc-4802-b88c-b0df06027c4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:38:19.113246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16323fc-fbbc-4802-b88c-b0df06027c4f service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:38:19.130875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 713/1416] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:38:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:38:20.053987 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284b1b0-81ef-4c5b-8a36-19a82edf9464 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:20.054563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284b1b0-81ef-4c5b-8a36-19a82edf9464 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:20.054674 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284b1b0-81ef-4c5b-8a36-19a82edf9464 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:20.056026 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:38:20.061309 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469511f5-333b-457b-9194-d7503c1e3bbe None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:20.061838 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469511f5-333b-457b-9194-d7503c1e3bbe None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:20.061838 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469511f5-333b-457b-9194-d7503c1e3bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:20.139070 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-469511f5-333b-457b-9194-d7503c1e3bbe None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:38:20.140332 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-469511f5-333b-457b-9194-d7503c1e3bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:20.167892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:20.239388 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:38:20.390386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284b1b0-81ef-4c5b-8a36-19a82edf9464 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:38:20.391927 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b284b1b0-81ef-4c5b-8a36-19a82edf9464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:20.538599 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284b1b0-81ef-4c5b-8a36-19a82edf9464 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:38:20.581205 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:20.652665 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdc8bd-9606-43dd-8273-933cdcbaf02c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:38:20.653275 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdc8bd-9606-43dd-8273-933cdcbaf02c service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:20.653556 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdc8bd-9606-43dd-8273-933cdcbaf02c service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:20.653829 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdc8bd-9606-43dd-8273-933cdcbaf02c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:20.655472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-67fdc8bd-9606-43dd-8273-933cdcbaf02c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:20.746462 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdc8bd-9606-43dd-8273-933cdcbaf02c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:38:20.748106 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdc8bd-9606-43dd-8273-933cdcbaf02c service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:38:20.766767 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 705/1419] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:38:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:38:21.664713 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bb37f-d5b8-4c6c-bc65-8901766c132a None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:21.665276 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bb37f-d5b8-4c6c-bc65-8901766c132a None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:21.665276 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bb37f-d5b8-4c6c-bc65-8901766c132a None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:21.666677 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:38:21.672451 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5f17e-cbaf-49fb-97e9-81b9f71ec8a8 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:21.672874 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5f17e-cbaf-49fb-97e9-81b9f71ec8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:21.673008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5f17e-cbaf-49fb-97e9-81b9f71ec8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:21.730972 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:21.755615 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-7da5f17e-cbaf-49fb-97e9-81b9f71ec8a8 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:38:21.757129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7da5f17e-cbaf-49fb-97e9-81b9f71ec8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:21.857699 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:38:22.013047 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bb37f-d5b8-4c6c-bc65-8901766c132a None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:38:22.014587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e28bb37f-d5b8-4c6c-bc65-8901766c132a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:22.162556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bb37f-d5b8-4c6c-bc65-8901766c132a None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:38:22.176523 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:22.278887 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03f645-8100-4f77-a090-804ea813cef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:38:22.279456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03f645-8100-4f77-a090-804ea813cef3 service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:22.279751 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03f645-8100-4f77-a090-804ea813cef3 service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:22.280026 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03f645-8100-4f77-a090-804ea813cef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:22.281669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ec03f645-8100-4f77-a090-804ea813cef3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:22.374250 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03f645-8100-4f77-a090-804ea813cef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:38:22.375894 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03f645-8100-4f77-a090-804ea813cef3 service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:38:22.395338 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 716/1422] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:38:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:38:23.280301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66e032-52e1-4095-948a-1d39925d6b43 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:23.280901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66e032-52e1-4095-948a-1d39925d6b43 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:23.280901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66e032-52e1-4095-948a-1d39925d6b43 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:23.282260 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:38:23.287950 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521779a-15c9-4c46-8d0e-d34d94455be2 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:23.288522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521779a-15c9-4c46-8d0e-d34d94455be2 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:23.288522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521779a-15c9-4c46-8d0e-d34d94455be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:23.310327 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:23.375073 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-5521779a-15c9-4c46-8d0e-d34d94455be2 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:38:23.376350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5521779a-15c9-4c46-8d0e-d34d94455be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:23.477689 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:38:23.653899 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66e032-52e1-4095-948a-1d39925d6b43 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:38:23.655448 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ff66e032-52e1-4095-948a-1d39925d6b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:23.766528 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:23.804224 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66e032-52e1-4095-948a-1d39925d6b43 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:38:23.932904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e0c25-3496-4977-8b43-ea0ad0823f3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:38:23.934101 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e0c25-3496-4977-8b43-ea0ad0823f3a service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:23.935033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e0c25-3496-4977-8b43-ea0ad0823f3a service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:23.935033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e0c25-3496-4977-8b43-ea0ad0823f3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:23.936711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b18e0c25-3496-4977-8b43-ea0ad0823f3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:24.019999 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:24.034418 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e0c25-3496-4977-8b43-ea0ad0823f3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:38:24.036199 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e0c25-3496-4977-8b43-ea0ad0823f3a service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:38:24.054825 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 708/1425] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:38:24.927149 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378c0e8-e665-41a3-b0f1-567d56a16e50 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:24.927714 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378c0e8-e665-41a3-b0f1-567d56a16e50 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:24.927831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378c0e8-e665-41a3-b0f1-567d56a16e50 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:24.929137 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:38:24.934174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9036dd1-4697-491f-a399-199ce7fdba31 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:24.934600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9036dd1-4697-491f-a399-199ce7fdba31 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:24.934810 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9036dd1-4697-491f-a399-199ce7fdba31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:25.013628 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-d9036dd1-4697-491f-a399-199ce7fdba31 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:38:25.015113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d9036dd1-4697-491f-a399-199ce7fdba31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:25.111729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:38:25.262304 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378c0e8-e665-41a3-b0f1-567d56a16e50 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:38:25.264155 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e378c0e8-e665-41a3-b0f1-567d56a16e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:25.361423 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:25.427024 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378c0e8-e665-41a3-b0f1-567d56a16e50 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:38:25.545522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ffbef-8ffe-4153-adf9-317102ebac6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:38:25.546072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ffbef-8ffe-4153-adf9-317102ebac6d service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:25.546354 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ffbef-8ffe-4153-adf9-317102ebac6d service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:25.546630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ffbef-8ffe-4153-adf9-317102ebac6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:25.548837 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-993ffbef-8ffe-4153-adf9-317102ebac6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:25.610544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:25.653570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ffbef-8ffe-4153-adf9-317102ebac6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:38:25.655174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ffbef-8ffe-4153-adf9-317102ebac6d service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:38:25.673534 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 719/1428] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:38:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:38:26.557303 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f3a5e-9c3a-40f0-99e8-453d55711eac None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:26.557817 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f3a5e-9c3a-40f0-99e8-453d55711eac None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:26.557922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f3a5e-9c3a-40f0-99e8-453d55711eac None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:26.560545 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:38:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:38:26.567492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d736972-f5ad-4128-8541-c9960da37118 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:26.568013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d736972-f5ad-4128-8541-c9960da37118 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:26.568013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d736972-f5ad-4128-8541-c9960da37118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:26.646149 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-9d736972-f5ad-4128-8541-c9960da37118 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:38:26.647401 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-9d736972-f5ad-4128-8541-c9960da37118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:26.744660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:38:26.898182 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f3a5e-9c3a-40f0-99e8-453d55711eac None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:38:26.899734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e39f3a5e-9c3a-40f0-99e8-453d55711eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:26.948751 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:27.045660 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f3a5e-9c3a-40f0-99e8-453d55711eac None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:38:27.156468 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac364fdf-ef31-4caf-9a97-f2ea58bf42b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:38:27.157083 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac364fdf-ef31-4caf-9a97-f2ea58bf42b4 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:27.157358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac364fdf-ef31-4caf-9a97-f2ea58bf42b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:27.157626 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac364fdf-ef31-4caf-9a97-f2ea58bf42b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:27.159227 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ac364fdf-ef31-4caf-9a97-f2ea58bf42b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:27.166136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:27.250838 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac364fdf-ef31-4caf-9a97-f2ea58bf42b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:38:27.252482 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac364fdf-ef31-4caf-9a97-f2ea58bf42b4 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:38:27.270940 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 711/1431] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:38:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:38:28.161710 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a531622-5b3b-46ab-a1d1-855bc1625a30 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:28.162287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a531622-5b3b-46ab-a1d1-855bc1625a30 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:28.162287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a531622-5b3b-46ab-a1d1-855bc1625a30 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:28.163684 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:38:28.169443 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f88c7-06af-4f6d-91cd-95a3d5c44d78 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:28.169881 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f88c7-06af-4f6d-91cd-95a3d5c44d78 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:28.170015 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f88c7-06af-4f6d-91cd-95a3d5c44d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:28.256432 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-ee8f88c7-06af-4f6d-91cd-95a3d5c44d78 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:38:28.257609 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ee8f88c7-06af-4f6d-91cd-95a3d5c44d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:28.327466 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:28.358016 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:38:28.512812 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a531622-5b3b-46ab-a1d1-855bc1625a30 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:38:28.514314 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-3a531622-5b3b-46ab-a1d1-855bc1625a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:28.532629 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:28.670128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a531622-5b3b-46ab-a1d1-855bc1625a30 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:38:28.757182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:28.784092 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80716e-1dd6-4e7b-868b-31a7aa3f3357 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:38:28.784639 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80716e-1dd6-4e7b-868b-31a7aa3f3357 service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:28.784923 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80716e-1dd6-4e7b-868b-31a7aa3f3357 service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:28.785275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80716e-1dd6-4e7b-868b-31a7aa3f3357 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:28.786907 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-fa80716e-1dd6-4e7b-868b-31a7aa3f3357 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:28.877545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80716e-1dd6-4e7b-868b-31a7aa3f3357 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:38:28.879155 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80716e-1dd6-4e7b-868b-31a7aa3f3357 service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:38:28.899179 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 722/1434] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:38:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:38:29.768153 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80580ede-89b4-478a-8211-4fd24d4e3700 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:29.768663 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80580ede-89b4-478a-8211-4fd24d4e3700 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:29.768793 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80580ede-89b4-478a-8211-4fd24d4e3700 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:29.770053 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:38:29.775023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95878c62-c95c-41e9-a484-c25d0c5b8378 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:29.775500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95878c62-c95c-41e9-a484-c25d0c5b8378 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:29.775609 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95878c62-c95c-41e9-a484-c25d0c5b8378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:29.853488 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-95878c62-c95c-41e9-a484-c25d0c5b8378 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:38:29.854628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-95878c62-c95c-41e9-a484-c25d0c5b8378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:29.896134 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:29.951682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:38:30.102457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80580ede-89b4-478a-8211-4fd24d4e3700 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:38:30.104083 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-80580ede-89b4-478a-8211-4fd24d4e3700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:30.253176 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80580ede-89b4-478a-8211-4fd24d4e3700 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:38:30.310820 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:30.375229 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4d3e9-c68d-49d4-bd2e-d7975684de6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:38:30.375721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4d3e9-c68d-49d4-bd2e-d7975684de6d service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:30.376008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4d3e9-c68d-49d4-bd2e-d7975684de6d service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:30.376355 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4d3e9-c68d-49d4-bd2e-d7975684de6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:30.378044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-afb4d3e9-c68d-49d4-bd2e-d7975684de6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:30.476506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4d3e9-c68d-49d4-bd2e-d7975684de6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:38:30.478124 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4d3e9-c68d-49d4-bd2e-d7975684de6d service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:38:30.498024 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 714/1437] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:38:31.359169 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88c5f7-ddee-46dd-8a84-965ebaf92dad None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:31.359705 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88c5f7-ddee-46dd-8a84-965ebaf92dad None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:31.359825 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88c5f7-ddee-46dd-8a84-965ebaf92dad None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:31.361171 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:38:31.366108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168fa47-474b-4733-9342-e0000e5c0940 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:31.366555 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168fa47-474b-4733-9342-e0000e5c0940 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:31.366666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168fa47-474b-4733-9342-e0000e5c0940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:31.450388 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5168fa47-474b-4733-9342-e0000e5c0940 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:38:31.451683 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5168fa47-474b-4733-9342-e0000e5c0940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:31.453816 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:31.555369 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:38:31.706830 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88c5f7-ddee-46dd-8a84-965ebaf92dad None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:38:31.708464 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-8a88c5f7-ddee-46dd-8a84-965ebaf92dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:31.856231 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88c5f7-ddee-46dd-8a84-965ebaf92dad None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:38:31.882616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:31.972008 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4e3e4-c63c-4b69-9d6f-24fb7b0b190d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:38:31.972559 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4e3e4-c63c-4b69-9d6f-24fb7b0b190d service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:31.972841 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4e3e4-c63c-4b69-9d6f-24fb7b0b190d service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:31.973115 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4e3e4-c63c-4b69-9d6f-24fb7b0b190d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:31.974734 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b7d4e3e4-c63c-4b69-9d6f-24fb7b0b190d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:32.064848 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4e3e4-c63c-4b69-9d6f-24fb7b0b190d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:38:32.066445 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4e3e4-c63c-4b69-9d6f-24fb7b0b190d service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:38:32.084910 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 725/1440] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:38:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:38:34.027769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c17db-f468-4210-859e-6b2e4164c46b None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:34.028372 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c17db-f468-4210-859e-6b2e4164c46b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:34.028372 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c17db-f468-4210-859e-6b2e4164c46b None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:34.030374 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:38:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:38:34.035866 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50962bfa-cb35-43cc-972e-02f0c2d96873 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:34.036353 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50962bfa-cb35-43cc-972e-02f0c2d96873 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:34.036502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50962bfa-cb35-43cc-972e-02f0c2d96873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:34.077613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:34.103686 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-50962bfa-cb35-43cc-972e-02f0c2d96873 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:38:34.105156 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-50962bfa-cb35-43cc-972e-02f0c2d96873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:34.203551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:38:34.243092 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c17db-f468-4210-859e-6b2e4164c46b None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:38:34.244697 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-340c17db-f468-4210-859e-6b2e4164c46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:34.350265 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c17db-f468-4210-859e-6b2e4164c46b None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:38:34.382312 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:34.424151 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c19ab0-78b3-4923-a5c5-5e84f829538c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:38:34.424772 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c19ab0-78b3-4923-a5c5-5e84f829538c service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:34.425053 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c19ab0-78b3-4923-a5c5-5e84f829538c service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:34.425326 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c19ab0-78b3-4923-a5c5-5e84f829538c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:34.426938 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a8c19ab0-78b3-4923-a5c5-5e84f829538c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:34.539311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c19ab0-78b3-4923-a5c5-5e84f829538c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:38:34.540696 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c19ab0-78b3-4923-a5c5-5e84f829538c service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:38:34.560442 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 717/1443] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:38:36.760486 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f53d50-e2f2-4827-b465-aef4345fa817 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:36.761679 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f53d50-e2f2-4827-b465-aef4345fa817 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:36.761679 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f53d50-e2f2-4827-b465-aef4345fa817 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:36.763168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:38:36.768543 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d34d5-3289-49b5-8ff8-048806a0949b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:36.768949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d34d5-3289-49b5-8ff8-048806a0949b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:36.769118 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d34d5-3289-49b5-8ff8-048806a0949b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:36.836658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-778d34d5-3289-49b5-8ff8-048806a0949b None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:38:36.837798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-778d34d5-3289-49b5-8ff8-048806a0949b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:36.851038 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:36.934990 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:38:36.974268 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f53d50-e2f2-4827-b465-aef4345fa817 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:38:36.976109 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-d4f53d50-e2f2-4827-b465-aef4345fa817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:37.079612 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f53d50-e2f2-4827-b465-aef4345fa817 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:38:37.091685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:37.153251 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3df0cc-c86a-46b3-81db-45fb366ea6fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:38:37.153874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3df0cc-c86a-46b3-81db-45fb366ea6fb service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:37.154157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3df0cc-c86a-46b3-81db-45fb366ea6fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:37.154427 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3df0cc-c86a-46b3-81db-45fb366ea6fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:37.156093 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-dd3df0cc-c86a-46b3-81db-45fb366ea6fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:37.266659 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3df0cc-c86a-46b3-81db-45fb366ea6fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:38:37.268134 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3df0cc-c86a-46b3-81db-45fb366ea6fb service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:38:37.286301 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 728/1446] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:38:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:38:39.662243 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa0468-fe9d-4d5f-88d1-3aa4b19a178d None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:39.662802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa0468-fe9d-4d5f-88d1-3aa4b19a178d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:39.662802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa0468-fe9d-4d5f-88d1-3aa4b19a178d None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:39.664193 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:38:39.669461 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f267f8-3ab9-4c94-ba44-f7434be0940c None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:39.669911 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f267f8-3ab9-4c94-ba44-f7434be0940c None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:39.670029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f267f8-3ab9-4c94-ba44-f7434be0940c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:39.720586 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:39.739511 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-49f267f8-3ab9-4c94-ba44-f7434be0940c None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:38:39.740747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-49f267f8-3ab9-4c94-ba44-f7434be0940c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:39.845027 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:38:39.884944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa0468-fe9d-4d5f-88d1-3aa4b19a178d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:38:39.887113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-28fa0468-fe9d-4d5f-88d1-3aa4b19a178d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:39.991580 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa0468-fe9d-4d5f-88d1-3aa4b19a178d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:38:40.032054 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:40.067541 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00026f-e2d3-429b-8ee3-944b6ca89d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:38:40.068163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00026f-e2d3-429b-8ee3-944b6ca89d18 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:40.068465 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00026f-e2d3-429b-8ee3-944b6ca89d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:40.068733 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00026f-e2d3-429b-8ee3-944b6ca89d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:40.070357 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7d00026f-e2d3-429b-8ee3-944b6ca89d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:40.185709 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00026f-e2d3-429b-8ee3-944b6ca89d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:38:40.187168 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00026f-e2d3-429b-8ee3-944b6ca89d18 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:38:40.205781 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 720/1449] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:38:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:38:42.388911 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64631158-560d-4336-a875-d9d4862d3acd None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:42.389453 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64631158-560d-4336-a875-d9d4862d3acd None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:42.389547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64631158-560d-4336-a875-d9d4862d3acd None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:42.390840 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:38:42.396356 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ad75d-495d-4a97-b783-7647b51bbd88 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:42.396788 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ad75d-495d-4a97-b783-7647b51bbd88 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:42.396920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ad75d-495d-4a97-b783-7647b51bbd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:42.464072 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-464ad75d-495d-4a97-b783-7647b51bbd88 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:38:42.465316 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-464ad75d-495d-4a97-b783-7647b51bbd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:42.486284 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:42.566287 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:38:42.605879 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64631158-560d-4336-a875-d9d4862d3acd None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:38:42.607457 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-64631158-560d-4336-a875-d9d4862d3acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:42.709926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64631158-560d-4336-a875-d9d4862d3acd None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:38:42.731437 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:42.786090 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d7e40-a748-4cd4-8f83-3da29f339e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:38:42.786710 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d7e40-a748-4cd4-8f83-3da29f339e30 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:42.786994 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d7e40-a748-4cd4-8f83-3da29f339e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:42.787291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d7e40-a748-4cd4-8f83-3da29f339e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:42.788929 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-7e9d7e40-a748-4cd4-8f83-3da29f339e30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:42.899731 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d7e40-a748-4cd4-8f83-3da29f339e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:38:42.901822 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d7e40-a748-4cd4-8f83-3da29f339e30 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:38:42.923424 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 731/1452] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:38:45.129995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7eac7-d44d-4ce6-a107-0a7a2c97f9a1 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:45.130571 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7eac7-d44d-4ce6-a107-0a7a2c97f9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:45.130571 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7eac7-d44d-4ce6-a107-0a7a2c97f9a1 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:45.131997 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:38:45.138066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe28c7-0fd5-46dc-91b8-5a44dd7ed1b1 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:45.138502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe28c7-0fd5-46dc-91b8-5a44dd7ed1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:45.138616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe28c7-0fd5-46dc-91b8-5a44dd7ed1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:45.202164 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:45.205135 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-c3fe28c7-0fd5-46dc-91b8-5a44dd7ed1b1 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:38:45.206359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c3fe28c7-0fd5-46dc-91b8-5a44dd7ed1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:45.303530 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:38:45.341656 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7eac7-d44d-4ce6-a107-0a7a2c97f9a1 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:38:45.343176 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-09a7eac7-d44d-4ce6-a107-0a7a2c97f9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:45.454088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7eac7-d44d-4ce6-a107-0a7a2c97f9a1 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:38:45.504965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:45.530895 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfab25-955a-43b7-b6cc-71721ece08a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:38:45.531545 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfab25-955a-43b7-b6cc-71721ece08a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:45.531829 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfab25-955a-43b7-b6cc-71721ece08a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:45.532105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfab25-955a-43b7-b6cc-71721ece08a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:45.533739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ddcfab25-955a-43b7-b6cc-71721ece08a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:45.645560 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfab25-955a-43b7-b6cc-71721ece08a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:38:45.646998 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfab25-955a-43b7-b6cc-71721ece08a6 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:38:45.666418 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 723/1455] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:38:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:38:47.767890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1050a-17a3-4aa6-8676-72ee8962b1f5 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:47.768475 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1050a-17a3-4aa6-8676-72ee8962b1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:47.768475 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1050a-17a3-4aa6-8676-72ee8962b1f5 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:47.769815 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:38:47.775513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf631cd-02f0-4a61-9f14-d0bec67bfe73 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:47.776023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf631cd-02f0-4a61-9f14-d0bec67bfe73 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:47.776183 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf631cd-02f0-4a61-9f14-d0bec67bfe73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:47.844585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-fbf631cd-02f0-4a61-9f14-d0bec67bfe73 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:38:47.845731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-fbf631cd-02f0-4a61-9f14-d0bec67bfe73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:47.877136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:47.946172 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:38:47.984995 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1050a-17a3-4aa6-8676-72ee8962b1f5 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:38:47.986535 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c9d1050a-17a3-4aa6-8676-72ee8962b1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:48.095642 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1050a-17a3-4aa6-8676-72ee8962b1f5 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:38:48.124974 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:48.170834 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397ef63-c4fc-46a6-af16-9dfbfad782d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:38:48.171448 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397ef63-c4fc-46a6-af16-9dfbfad782d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:48.171730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397ef63-c4fc-46a6-af16-9dfbfad782d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:48.172002 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397ef63-c4fc-46a6-af16-9dfbfad782d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:48.174000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e397ef63-c4fc-46a6-af16-9dfbfad782d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:48.283987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397ef63-c4fc-46a6-af16-9dfbfad782d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:38:48.285428 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397ef63-c4fc-46a6-af16-9dfbfad782d4 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:38:48.304526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 734/1458] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:38:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:38:50.392506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecff765-9cdd-44a2-a2a5-11ec4d121dc1 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:50.393058 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecff765-9cdd-44a2-a2a5-11ec4d121dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:50.393058 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecff765-9cdd-44a2-a2a5-11ec4d121dc1 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:50.394438 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:38:50.399875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b4ac4-852d-4e85-9d9b-2a826e86ac63 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:50.400371 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b4ac4-852d-4e85-9d9b-2a826e86ac63 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:50.400466 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b4ac4-852d-4e85-9d9b-2a826e86ac63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:50.474695 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-bb1b4ac4-852d-4e85-9d9b-2a826e86ac63 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:38:50.475951 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-bb1b4ac4-852d-4e85-9d9b-2a826e86ac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:50.485673 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:50.577195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:38:50.615879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecff765-9cdd-44a2-a2a5-11ec4d121dc1 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:38:50.617400 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5ecff765-9cdd-44a2-a2a5-11ec4d121dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:50.726839 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecff765-9cdd-44a2-a2a5-11ec4d121dc1 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:38:50.784956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:50.808072 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05b0e3-647b-4c3f-9a4b-a7ebb4ab6a3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:38:50.808705 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05b0e3-647b-4c3f-9a4b-a7ebb4ab6a3e service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:50.808989 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05b0e3-647b-4c3f-9a4b-a7ebb4ab6a3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:50.809265 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05b0e3-647b-4c3f-9a4b-a7ebb4ab6a3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:50.810993 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7d05b0e3-647b-4c3f-9a4b-a7ebb4ab6a3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:50.925440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05b0e3-647b-4c3f-9a4b-a7ebb4ab6a3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:38:50.926891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05b0e3-647b-4c3f-9a4b-a7ebb4ab6a3e service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:38:50.945784 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 726/1461] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:38:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:38:53.054169 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08f815-1582-4682-bc5c-26f7af12f28e None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:53.054741 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08f815-1582-4682-bc5c-26f7af12f28e None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:53.054741 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08f815-1582-4682-bc5c-26f7af12f28e None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:53.056189 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:38:53.062207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4f44f-2d9e-4cbc-8655-623bb0048b2e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:53.062652 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4f44f-2d9e-4cbc-8655-623bb0048b2e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:53.062774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4f44f-2d9e-4cbc-8655-623bb0048b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:53.130665 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-27e4f44f-2d9e-4cbc-8655-623bb0048b2e None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:38:53.131866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-27e4f44f-2d9e-4cbc-8655-623bb0048b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:53.171751 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:53.231179 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:38:53.268227 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08f815-1582-4682-bc5c-26f7af12f28e None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:38:53.269751 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-3b08f815-1582-4682-bc5c-26f7af12f28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:53.377487 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08f815-1582-4682-bc5c-26f7af12f28e None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:38:53.422933 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:53.454042 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00820f-2e23-43d0-8d71-5ed0edc59c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:38:53.454664 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00820f-2e23-43d0-8d71-5ed0edc59c07 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:53.454947 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00820f-2e23-43d0-8d71-5ed0edc59c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:53.455220 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00820f-2e23-43d0-8d71-5ed0edc59c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:53.456970 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-0c00820f-2e23-43d0-8d71-5ed0edc59c07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:53.567102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00820f-2e23-43d0-8d71-5ed0edc59c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:38:53.568614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00820f-2e23-43d0-8d71-5ed0edc59c07 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:38:53.588783 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 737/1464] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:38:55.643743 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217e9ad-82ff-4173-bfd3-8295237525a8 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:55.644347 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217e9ad-82ff-4173-bfd3-8295237525a8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:55.644347 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217e9ad-82ff-4173-bfd3-8295237525a8 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:55.645705 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:38:55.651195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5bc59-4208-445c-8dc4-8b42eeedecbf None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:55.651691 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5bc59-4208-445c-8dc4-8b42eeedecbf None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:55.651827 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5bc59-4208-445c-8dc4-8b42eeedecbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:55.720914 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-4af5bc59-4208-445c-8dc4-8b42eeedecbf None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:38:55.722166 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4af5bc59-4208-445c-8dc4-8b42eeedecbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:55.741852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:55.823969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:38:55.861956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217e9ad-82ff-4173-bfd3-8295237525a8 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:38:55.863510 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e217e9ad-82ff-4173-bfd3-8295237525a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:55.969245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217e9ad-82ff-4173-bfd3-8295237525a8 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:38:56.036526 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:56.043792 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c4a11-cb98-4017-8efa-7504eedacdef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:38:56.048398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c4a11-cb98-4017-8efa-7504eedacdef service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:56.048398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c4a11-cb98-4017-8efa-7504eedacdef service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:56.048398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c4a11-cb98-4017-8efa-7504eedacdef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:56.048398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b10c4a11-cb98-4017-8efa-7504eedacdef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:56.155697 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c4a11-cb98-4017-8efa-7504eedacdef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:38:56.157148 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c4a11-cb98-4017-8efa-7504eedacdef service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:38:56.176996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 729/1467] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:38:58.433594 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c817a4-572e-4291-8277-50baeb14825e None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:58.434202 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c817a4-572e-4291-8277-50baeb14825e None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:58.434202 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c817a4-572e-4291-8277-50baeb14825e None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:58.435558 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:38:58.440810 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46545a7c-e51d-4102-a855-006217c31943 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:58.441274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46545a7c-e51d-4102-a855-006217c31943 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:58.441379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46545a7c-e51d-4102-a855-006217c31943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:58.508233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-46545a7c-e51d-4102-a855-006217c31943 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:38:58.509393 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-46545a7c-e51d-4102-a855-006217c31943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:58.561119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:58.612106 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:38:58.648657 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c817a4-572e-4291-8277-50baeb14825e None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:38:58.650192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e3c817a4-572e-4291-8277-50baeb14825e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:58.756150 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c817a4-572e-4291-8277-50baeb14825e None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:38:58.803933 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:38:58.830857 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa225fc-6988-4def-bdc2-3936a56241a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:38:58.831507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa225fc-6988-4def-bdc2-3936a56241a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:38:58.831791 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa225fc-6988-4def-bdc2-3936a56241a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:38:58.832064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa225fc-6988-4def-bdc2-3936a56241a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:38:58.833688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-efa225fc-6988-4def-bdc2-3936a56241a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:38:58.943435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa225fc-6988-4def-bdc2-3936a56241a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:38:58.944971 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa225fc-6988-4def-bdc2-3936a56241a2 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:38:58.964591 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 740/1470] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:38:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:39:08.610282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=22 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:39:08.961644 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=66 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:39:19.472586 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e51c8a-4682-4e6d-93a3-5208767bd563 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:19.473191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e51c8a-4682-4e6d-93a3-5208767bd563 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:19.473191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e51c8a-4682-4e6d-93a3-5208767bd563 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:19.474796 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 731/1471] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:39:19.480978 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460520a-8ab1-4bf4-b045-1815b15a933a None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:19.481436 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460520a-8ab1-4bf4-b045-1815b15a933a None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:19.481544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460520a-8ab1-4bf4-b045-1815b15a933a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:19.550514 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-4460520a-8ab1-4bf4-b045-1815b15a933a None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:39:19.552077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4460520a-8ab1-4bf4-b045-1815b15a933a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:19.654591 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 741/1472] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:39:19.741470 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb47db8-440e-470b-a2b4-117f56e53f5e None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:19.741762 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb47db8-440e-470b-a2b4-117f56e53f5e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:19.742045 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb47db8-440e-470b-a2b4-117f56e53f5e None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:19.743472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 732/1473] 10.222.0.65 () {54 vars in 966 bytes} [Wed Jul 27 18:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:39:19.748541 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbf3a3-3aed-4c97-a7aa-c7bf931642f9 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:19.748829 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbf3a3-3aed-4c97-a7aa-c7bf931642f9 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:19.749110 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbf3a3-3aed-4c97-a7aa-c7bf931642f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:19.826474 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-25bbf3a3-3aed-4c97-a7aa-c7bf931642f9 None None] MFA Rules not processed for user `d49a34cd99ab47bb92af6ed2f82fefde`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:39:19.827735 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-25bbf3a3-3aed-4c97-a7aa-c7bf931642f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:19.849273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:39:19.905637 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 742/1474] 10.222.0.65 () {58 vars in 1063 bytes} [Wed Jul 27 18:39:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:39:19.913499 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb47db8-440e-470b-a2b4-117f56e53f5e None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:39:19.915555 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-3fb47db8-440e-470b-a2b4-117f56e53f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:20.022936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb47db8-440e-470b-a2b4-117f56e53f5e None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:39:20.104708 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b3ac8-39a7-45ad-ab81-a4cb165e0b64 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49a34cd99ab47bb92af6ed2f82fefde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:39:20.105329 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b3ac8-39a7-45ad-ab81-a4cb165e0b64 service glance] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:20.105610 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b3ac8-39a7-45ad-ab81-a4cb165e0b64 service glance] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:20.105879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b3ac8-39a7-45ad-ab81-a4cb165e0b64 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:20.107555 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d99b3ac8-39a7-45ad-ab81-a4cb165e0b64 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:20.162588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:39:20.218123 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b3ac8-39a7-45ad-ab81-a4cb165e0b64 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:39:20.219612 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b3ac8-39a7-45ad-ab81-a4cb165e0b64 service glance] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:39:20.239679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 733/1475] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:39:22.396687 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b4b30-b6c1-41a0-8138-9f0248a2556f None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:22.397253 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b4b30-b6c1-41a0-8138-9f0248a2556f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:22.397253 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b4b30-b6c1-41a0-8138-9f0248a2556f None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:22.398614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 743/1476] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:39:22.404568 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03581c3-7c6f-431d-ae4e-f80b06aad05a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:22.405069 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03581c3-7c6f-431d-ae4e-f80b06aad05a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:22.405175 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03581c3-7c6f-431d-ae4e-f80b06aad05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:22.472254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c03581c3-7c6f-431d-ae4e-f80b06aad05a None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:39:22.473751 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c03581c3-7c6f-431d-ae4e-f80b06aad05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:22.573140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 734/1477] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:39:22.596356 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b4b30-b6c1-41a0-8138-9f0248a2556f None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:39:22.597879 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ce8b4b30-b6c1-41a0-8138-9f0248a2556f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:22.732501 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b4b30-b6c1-41a0-8138-9f0248a2556f None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:39:22.784003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:39:22.836542 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef302e-38db-44b0-8a52-1256e453a1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:39:22.837748 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef302e-38db-44b0-8a52-1256e453a1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:22.838033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef302e-38db-44b0-8a52-1256e453a1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:22.838306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef302e-38db-44b0-8a52-1256e453a1f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:22.839012 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef302e-38db-44b0-8a52-1256e453a1f7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:39:22.840828 dv-cinder-799871-43-smb devstack@keystone.service[80429]: WARNING py.warnings [None req-31ef302e-38db-44b0-8a52-1256e453a1f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:39:22.840828 dv-cinder-799871-43-smb devstack@keystone.service[80429]: warnings.warn(msg) Jul 27 18:39:22.840828 dv-cinder-799871-43-smb devstack@keystone.service[80429]: Jul 27 18:39:22.846586 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef302e-38db-44b0-8a52-1256e453a1f7 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:39:22.862338 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 744/1478] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 18:39:22 2022] GET /identity/v3/projects => generated 2553 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:39:24.925512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4cc7a-f6de-4cb7-9e28-c85bbb621201 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:24.926046 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4cc7a-f6de-4cb7-9e28-c85bbb621201 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:24.926163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4cc7a-f6de-4cb7-9e28-c85bbb621201 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:24.927493 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 735/1479] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:39:24.934025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d77970-854f-4945-95dc-0184ce92a157 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:24.934025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d77970-854f-4945-95dc-0184ce92a157 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:24.934025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d77970-854f-4945-95dc-0184ce92a157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:25.001020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-28d77970-854f-4945-95dc-0184ce92a157 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:39:25.002249 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-28d77970-854f-4945-95dc-0184ce92a157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:25.111595 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 745/1480] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:39:25.156147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4cc7a-f6de-4cb7-9e28-c85bbb621201 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:39:25.157704 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-76a4cc7a-f6de-4cb7-9e28-c85bbb621201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:25.168290 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:39:25.313890 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4cc7a-f6de-4cb7-9e28-c85bbb621201 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:39:25.398788 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:39:25.435723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8710c2d-c439-4445-86c4-28ba05160fbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:39:25.436349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8710c2d-c439-4445-86c4-28ba05160fbb service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:25.436630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8710c2d-c439-4445-86c4-28ba05160fbb service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:25.436902 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8710c2d-c439-4445-86c4-28ba05160fbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:25.438554 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b8710c2d-c439-4445-86c4-28ba05160fbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:25.531625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8710c2d-c439-4445-86c4-28ba05160fbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:39:25.533244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8710c2d-c439-4445-86c4-28ba05160fbb service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:39:25.553642 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 736/1481] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:39:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:39:27.782607 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7f380-cfb3-4664-9be0-9f921a7e8b79 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:27.783215 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7f380-cfb3-4664-9be0-9f921a7e8b79 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:27.783215 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7f380-cfb3-4664-9be0-9f921a7e8b79 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:27.784533 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 746/1482] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:39:27.790355 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ed3f9-5681-4e4d-b92c-91aef8db1c5d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:27.790848 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ed3f9-5681-4e4d-b92c-91aef8db1c5d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:27.790967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ed3f9-5681-4e4d-b92c-91aef8db1c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:27.858470 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-d47ed3f9-5681-4e4d-b92c-91aef8db1c5d None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:39:27.859847 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d47ed3f9-5681-4e4d-b92c-91aef8db1c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:27.907812 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:39:27.958994 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 737/1483] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:39:27.997744 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7f380-cfb3-4664-9be0-9f921a7e8b79 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:39:27.999364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-0cb7f380-cfb3-4664-9be0-9f921a7e8b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:28.022800 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:39:28.114945 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7f380-cfb3-4664-9be0-9f921a7e8b79 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:39:28.190427 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7883ff-9c22-43e3-ade2-0201653d1f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:39:28.191055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7883ff-9c22-43e3-ade2-0201653d1f27 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:28.191368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7883ff-9c22-43e3-ade2-0201653d1f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:28.191643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7883ff-9c22-43e3-ade2-0201653d1f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:28.193275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-fa7883ff-9c22-43e3-ade2-0201653d1f27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:28.270221 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:39:28.308380 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7883ff-9c22-43e3-ade2-0201653d1f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:39:28.309952 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7883ff-9c22-43e3-ade2-0201653d1f27 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:39:28.328469 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 747/1484] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:39:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:39:30.443787 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fecf75-14e9-48d1-aa02-e539ba7c69a4 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:30.444471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fecf75-14e9-48d1-aa02-e539ba7c69a4 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:30.444471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fecf75-14e9-48d1-aa02-e539ba7c69a4 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:30.445717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 738/1485] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:39:30.451442 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9656c1-abcc-423b-ba6a-c9ba19b28789 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:30.451932 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9656c1-abcc-423b-ba6a-c9ba19b28789 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:30.452040 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9656c1-abcc-423b-ba6a-c9ba19b28789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:30.520126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-3d9656c1-abcc-423b-ba6a-c9ba19b28789 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:39:30.521261 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-3d9656c1-abcc-423b-ba6a-c9ba19b28789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:30.622213 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 748/1486] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:39:30.660331 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fecf75-14e9-48d1-aa02-e539ba7c69a4 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:39:30.661868 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-28fecf75-14e9-48d1-aa02-e539ba7c69a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:30.774971 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fecf75-14e9-48d1-aa02-e539ba7c69a4 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:39:30.847452 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:39:30.849768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad8769-097b-40e3-afd2-d064c8ff27bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:39:30.850389 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad8769-097b-40e3-afd2-d064c8ff27bc service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:30.850674 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad8769-097b-40e3-afd2-d064c8ff27bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:30.850951 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad8769-097b-40e3-afd2-d064c8ff27bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:30.853288 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d2ad8769-097b-40e3-afd2-d064c8ff27bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:30.965350 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad8769-097b-40e3-afd2-d064c8ff27bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:39:30.966805 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad8769-097b-40e3-afd2-d064c8ff27bc service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:39:30.986145 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 739/1487] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:39:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:39:33.116747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664c2e5-f31a-43b6-b6a0-a48d6420d9f4 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:33.117318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664c2e5-f31a-43b6-b6a0-a48d6420d9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:33.117318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664c2e5-f31a-43b6-b6a0-a48d6420d9f4 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:33.118741 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 749/1488] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:39:33.124084 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d282c1f-5e74-4d7f-b3be-f13c1edc0153 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:33.124556 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d282c1f-5e74-4d7f-b3be-f13c1edc0153 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:33.124672 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d282c1f-5e74-4d7f-b3be-f13c1edc0153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:33.203079 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-8d282c1f-5e74-4d7f-b3be-f13c1edc0153 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:39:33.204320 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8d282c1f-5e74-4d7f-b3be-f13c1edc0153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:33.256536 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:39:33.301184 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 740/1489] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:39:33.342730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664c2e5-f31a-43b6-b6a0-a48d6420d9f4 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:39:33.344315 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2664c2e5-f31a-43b6-b6a0-a48d6420d9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:33.386319 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:39:33.452009 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664c2e5-f31a-43b6-b6a0-a48d6420d9f4 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:39:33.526337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27533b0-59d9-4028-84f2-5bf56a1ac80c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:39:33.526964 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27533b0-59d9-4028-84f2-5bf56a1ac80c service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:33.527248 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27533b0-59d9-4028-84f2-5bf56a1ac80c service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:33.527550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27533b0-59d9-4028-84f2-5bf56a1ac80c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:33.529189 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b27533b0-59d9-4028-84f2-5bf56a1ac80c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:33.611187 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:39:33.640045 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27533b0-59d9-4028-84f2-5bf56a1ac80c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:39:33.641444 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27533b0-59d9-4028-84f2-5bf56a1ac80c service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:39:33.660389 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 750/1490] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:39:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:39:36.150094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79068fc0-3d89-4b32-822a-7132b8f2d34d None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:36.150664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79068fc0-3d89-4b32-822a-7132b8f2d34d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:36.150664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79068fc0-3d89-4b32-822a-7132b8f2d34d None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:36.152092 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 741/1491] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 18:39:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:39:36.157353 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef4888-d23c-4d69-8b1c-a608f10e01f4 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:36.157803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef4888-d23c-4d69-8b1c-a608f10e01f4 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:36.157937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef4888-d23c-4d69-8b1c-a608f10e01f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:36.226778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-66ef4888-d23c-4d69-8b1c-a608f10e01f4 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:39:36.228029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-66ef4888-d23c-4d69-8b1c-a608f10e01f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:36.327491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 751/1492] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 18:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:39:36.368289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79068fc0-3d89-4b32-822a-7132b8f2d34d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:39:36.369822 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-79068fc0-3d89-4b32-822a-7132b8f2d34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:36.477361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79068fc0-3d89-4b32-822a-7132b8f2d34d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:39:36.553675 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2f78c-900c-4e38-86e8-863fa6ef9634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:39:36.554300 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2f78c-900c-4e38-86e8-863fa6ef9634 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:36.554579 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2f78c-900c-4e38-86e8-863fa6ef9634 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:36.555403 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2f78c-900c-4e38-86e8-863fa6ef9634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:36.557254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-72f2f78c-900c-4e38-86e8-863fa6ef9634 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:36.566692 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:39:36.669677 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2f78c-900c-4e38-86e8-863fa6ef9634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:39:36.671179 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2f78c-900c-4e38-86e8-863fa6ef9634 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:39:36.689961 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 742/1493] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:39:46.325754 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=82 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:39:46.687602 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=50 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:41:14.323100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f2da7-0e89-4490-a669-08c008fdf94d None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:41:14.323723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f2da7-0e89-4490-a669-08c008fdf94d None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:41:14.323723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f2da7-0e89-4490-a669-08c008fdf94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:41:14.401210 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-134f2da7-0e89-4490-a669-08c008fdf94d None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:41:14.402453 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-134f2da7-0e89-4490-a669-08c008fdf94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:41:14.501351 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 752/1494] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:41:14.509477 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206999bf-da22-4fd8-b984-e29b8ef86ec4 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:41:14.510013 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206999bf-da22-4fd8-b984-e29b8ef86ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:41:14.510137 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206999bf-da22-4fd8-b984-e29b8ef86ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:41:14.589695 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-206999bf-da22-4fd8-b984-e29b8ef86ec4 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:41:14.590884 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-206999bf-da22-4fd8-b984-e29b8ef86ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:41:14.687383 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 743/1495] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:41:14.692270 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f2da7-0e89-4490-a669-08c008fdf94d None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:41:14.693486 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-134f2da7-0e89-4490-a669-08c008fdf94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:41:14.705585 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f2da7-0e89-4490-a669-08c008fdf94d None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:41:14.766241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:41:14.802492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be0166-d519-4ed3-b716-2bfb57fedf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:41:14.803113 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be0166-d519-4ed3-b716-2bfb57fedf9c admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:41:14.803990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be0166-d519-4ed3-b716-2bfb57fedf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:41:14.804325 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be0166-d519-4ed3-b716-2bfb57fedf9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:41:14.805031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be0166-d519-4ed3-b716-2bfb57fedf9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:41:14.805337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be0166-d519-4ed3-b716-2bfb57fedf9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:41:14.806371 dv-cinder-799871-43-smb devstack@keystone.service[80429]: WARNING py.warnings [None req-93be0166-d519-4ed3-b716-2bfb57fedf9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:41:14.806371 dv-cinder-799871-43-smb devstack@keystone.service[80429]: warnings.warn(msg) Jul 27 18:41:14.806371 dv-cinder-799871-43-smb devstack@keystone.service[80429]: Jul 27 18:41:14.807361 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be0166-d519-4ed3-b716-2bfb57fedf9c admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:41:14.819240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 753/1496] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:41:14.827824 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206999bf-da22-4fd8-b984-e29b8ef86ec4 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:41:14.837287 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206999bf-da22-4fd8-b984-e29b8ef86ec4 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:41:14.903197 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:41:14.939955 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fb9a8-a93b-4333-8daa-fce345e74da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:41:14.955292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fb9a8-a93b-4333-8daa-fce345e74da8 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:41:14.955292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fb9a8-a93b-4333-8daa-fce345e74da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:41:14.955292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fb9a8-a93b-4333-8daa-fce345e74da8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:41:14.955292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fb9a8-a93b-4333-8daa-fce345e74da8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:41:14.955292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: WARNING py.warnings [None req-ed5fb9a8-a93b-4333-8daa-fce345e74da8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:41:14.955292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: warnings.warn(msg) Jul 27 18:41:14.955292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: Jul 27 18:41:14.955934 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fb9a8-a93b-4333-8daa-fce345e74da8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:41:15.153339 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 744/1497] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:41:14 2022] POST /identity/v3/projects => generated 379 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:41:15.157360 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be0166-d519-4ed3-b716-2bfb57fedf9c admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:41:15.158906 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-93be0166-d519-4ed3-b716-2bfb57fedf9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:41:15.192726 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be0166-d519-4ed3-b716-2bfb57fedf9c admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:41:15.288807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621bd15-5876-413f-8b2f-784dd7be7f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:41:15.289429 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621bd15-5876-413f-8b2f-784dd7be7f49 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:41:15.289706 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621bd15-5876-413f-8b2f-784dd7be7f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:41:15.289979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621bd15-5876-413f-8b2f-784dd7be7f49 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:41:15.290647 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621bd15-5876-413f-8b2f-784dd7be7f49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:41:15.291686 dv-cinder-799871-43-smb devstack@keystone.service[80429]: WARNING py.warnings [None req-b621bd15-5876-413f-8b2f-784dd7be7f49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:41:15.291686 dv-cinder-799871-43-smb devstack@keystone.service[80429]: warnings.warn(msg) Jul 27 18:41:15.291686 dv-cinder-799871-43-smb devstack@keystone.service[80429]: Jul 27 18:41:15.292901 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621bd15-5876-413f-8b2f-784dd7be7f49 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:41:15.398401 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 754/1498] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:41:15 2022] POST /identity/v3/users => generated 290 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:41:15.402683 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fb9a8-a93b-4333-8daa-fce345e74da8 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:41:15.404356 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ed5fb9a8-a93b-4333-8daa-fce345e74da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:41:15.467466 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fb9a8-a93b-4333-8daa-fce345e74da8 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:41:15.554097 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:41:15.564786 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a114e76-4cc3-499e-859d-d141b6e890b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:41:15.565412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a114e76-4cc3-499e-859d-d141b6e890b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:41:15.565696 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a114e76-4cc3-499e-859d-d141b6e890b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:41:15.565973 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a114e76-4cc3-499e-859d-d141b6e890b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:41:15.566709 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a114e76-4cc3-499e-859d-d141b6e890b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:41:15.567759 dv-cinder-799871-43-smb devstack@keystone.service[80428]: WARNING py.warnings [None req-1a114e76-4cc3-499e-859d-d141b6e890b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:41:15.567759 dv-cinder-799871-43-smb devstack@keystone.service[80428]: warnings.warn(msg) Jul 27 18:41:15.567759 dv-cinder-799871-43-smb devstack@keystone.service[80428]: Jul 27 18:41:15.568654 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a114e76-4cc3-499e-859d-d141b6e890b0 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:41:15.581942 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 745/1499] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:41:15.586740 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621bd15-5876-413f-8b2f-784dd7be7f49 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:41:15.588323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b621bd15-5876-413f-8b2f-784dd7be7f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:41:15.600376 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621bd15-5876-413f-8b2f-784dd7be7f49 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:41:15.626424 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:41:15.701811 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148fe44-ad10-4e63-9a91-6efcb556bf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:41:15.702440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148fe44-ad10-4e63-9a91-6efcb556bf19 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:41:15.702726 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148fe44-ad10-4e63-9a91-6efcb556bf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:41:15.703005 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148fe44-ad10-4e63-9a91-6efcb556bf19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:41:15.703745 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148fe44-ad10-4e63-9a91-6efcb556bf19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:41:15.704801 dv-cinder-799871-43-smb devstack@keystone.service[80429]: WARNING py.warnings [None req-2148fe44-ad10-4e63-9a91-6efcb556bf19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:41:15.704801 dv-cinder-799871-43-smb devstack@keystone.service[80429]: warnings.warn(msg) Jul 27 18:41:15.704801 dv-cinder-799871-43-smb devstack@keystone.service[80429]: Jul 27 18:41:15.705730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148fe44-ad10-4e63-9a91-6efcb556bf19 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:41:15.720549 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 755/1500] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:41:15.724879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a114e76-4cc3-499e-859d-d141b6e890b0 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:41:15.726869 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1a114e76-4cc3-499e-859d-d141b6e890b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:41:15.762718 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a114e76-4cc3-499e-859d-d141b6e890b0 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:41:15.859787 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e05c9-28f6-4ed5-be7e-97eef04a1e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:41:15.860457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e05c9-28f6-4ed5-be7e-97eef04a1e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:41:15.860737 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e05c9-28f6-4ed5-be7e-97eef04a1e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:41:15.861026 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e05c9-28f6-4ed5-be7e-97eef04a1e2d admin admin] PATH_INFO: `/v3/projects/22f61c401c8a4538b3995c16f0d33c85/users/155ae1e8b96f4831b3d32a53861abd7e/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:41:15.883716 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e05c9-28f6-4ed5-be7e-97eef04a1e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f61c401c8a4538b3995c16f0d33c85, user_id=155ae1e8b96f4831b3d32a53861abd7e, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:41:15.884763 dv-cinder-799871-43-smb devstack@keystone.service[80428]: WARNING py.warnings [None req-c12e05c9-28f6-4ed5-be7e-97eef04a1e2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:41:15.884763 dv-cinder-799871-43-smb devstack@keystone.service[80428]: warnings.warn(msg) Jul 27 18:41:15.884763 dv-cinder-799871-43-smb devstack@keystone.service[80428]: Jul 27 18:41:15.886731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e05c9-28f6-4ed5-be7e-97eef04a1e2d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:41:15.977605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 746/1501] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:41:15 2022] PUT /identity/v3/projects/22f61c401c8a4538b3995c16f0d33c85/users/155ae1e8b96f4831b3d32a53861abd7e/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:41:15.989935 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d977f0d-c588-4ce1-8e47-172964c425c3 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:41:15.990226 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d977f0d-c588-4ce1-8e47-172964c425c3 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:41:15.990508 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d977f0d-c588-4ce1-8e47-172964c425c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:41:16.048420 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-6d977f0d-c588-4ce1-8e47-172964c425c3 None None] MFA Rules not processed for user `155ae1e8b96f4831b3d32a53861abd7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:41:16.049649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-6d977f0d-c588-4ce1-8e47-172964c425c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:41:16.127753 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 756/1502] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:41:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:41:16.141576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c3b1d-9649-4dfa-a18c-902711a260a0 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:41:16.141866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c3b1d-9649-4dfa-a18c-902711a260a0 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:41:16.142144 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c3b1d-9649-4dfa-a18c-902711a260a0 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:41:16.143515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 747/1503] 10.222.0.65 () {54 vars in 964 bytes} [Wed Jul 27 18:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:41:16.148377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9685714-b3e2-492a-8034-cab7e56f1031 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:41:16.148679 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9685714-b3e2-492a-8034-cab7e56f1031 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:41:16.148989 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9685714-b3e2-492a-8034-cab7e56f1031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:41:16.180683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:41:16.227009 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-a9685714-b3e2-492a-8034-cab7e56f1031 None None] MFA Rules not processed for user `e5579f23592846abb3273cc5f5658ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:41:16.228335 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a9685714-b3e2-492a-8034-cab7e56f1031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:41:16.304631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 757/1504] 10.222.0.65 () {58 vars in 1061 bytes} [Wed Jul 27 18:41:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:41:16.312724 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c3b1d-9649-4dfa-a18c-902711a260a0 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:41:16.314239 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0f8c3b1d-9649-4dfa-a18c-902711a260a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:41:16.366775 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:41:16.422065 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c3b1d-9649-4dfa-a18c-902711a260a0 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:41:16.500052 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7c58a-ecd1-43fc-b376-bb0518a7177f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:41:16.500588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7c58a-ecd1-43fc-b376-bb0518a7177f service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:41:16.500872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7c58a-ecd1-43fc-b376-bb0518a7177f service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:41:16.501147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7c58a-ecd1-43fc-b376-bb0518a7177f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:41:16.502776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-91f7c58a-ecd1-43fc-b376-bb0518a7177f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:41:16.607275 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7c58a-ecd1-43fc-b376-bb0518a7177f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:41:16.608749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7c58a-ecd1-43fc-b376-bb0518a7177f service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:41:16.612297 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:41:16.627222 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 748/1505] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:41:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:41:16.673113 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded2aea-d95a-4682-9c55-2a8893a62804 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:41:16.673562 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded2aea-d95a-4682-9c55-2a8893a62804 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:41:16.673680 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded2aea-d95a-4682-9c55-2a8893a62804 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:41:16.674943 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 758/1506] 10.222.0.65 () {52 vars in 830 bytes} [Wed Jul 27 18:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:41:16.678624 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7c58a-ecd1-43fc-b376-bb0518a7177f service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:41:16.679856 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-91f7c58a-ecd1-43fc-b376-bb0518a7177f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:41:16.780387 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7c58a-ecd1-43fc-b376-bb0518a7177f service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:41:16.876735 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c75860-dae7-4328-8766-78e6ead4baeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:41:16.877371 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c75860-dae7-4328-8766-78e6ead4baeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:41:16.877652 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c75860-dae7-4328-8766-78e6ead4baeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:41:16.877927 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c75860-dae7-4328-8766-78e6ead4baeb admin admin] PATH_INFO: `/v3/users/155ae1e8b96f4831b3d32a53861abd7e` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:41:16.890302 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c75860-dae7-4328-8766-78e6ead4baeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=155ae1e8b96f4831b3d32a53861abd7e)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:41:16.891357 dv-cinder-799871-43-smb devstack@keystone.service[80428]: WARNING py.warnings [None req-83c75860-dae7-4328-8766-78e6ead4baeb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:41:16.891357 dv-cinder-799871-43-smb devstack@keystone.service[80428]: warnings.warn(msg) Jul 27 18:41:16.891357 dv-cinder-799871-43-smb devstack@keystone.service[80428]: Jul 27 18:41:16.892583 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c75860-dae7-4328-8766-78e6ead4baeb admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:41:16.902929 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:41:17.176377 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-83c75860-dae7-4328-8766-78e6ead4baeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '155ae1e8b96f4831b3d32a53861abd7e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:41:17.177071 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-83c75860-dae7-4328-8766-78e6ead4baeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '155ae1e8b96f4831b3d32a53861abd7e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:41:17.250168 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-83c75860-dae7-4328-8766-78e6ead4baeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '155ae1e8b96f4831b3d32a53861abd7e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:41:17.269450 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-83c75860-dae7-4328-8766-78e6ead4baeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '155ae1e8b96f4831b3d32a53861abd7e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:41:17.269954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-83c75860-dae7-4328-8766-78e6ead4baeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '155ae1e8b96f4831b3d32a53861abd7e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:41:17.287979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 749/1507] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:41:16 2022] DELETE /identity/v3/users/155ae1e8b96f4831b3d32a53861abd7e => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:41:17.292681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895334a-4f4a-43cc-b9b2-39a882d0fa15 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:41:17.293122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895334a-4f4a-43cc-b9b2-39a882d0fa15 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:41:17.293403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895334a-4f4a-43cc-b9b2-39a882d0fa15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:41:17.351126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-7895334a-4f4a-43cc-b9b2-39a882d0fa15 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:41:17.352372 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-7895334a-4f4a-43cc-b9b2-39a882d0fa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:41:17.429874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:41:17.442454 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 759/1508] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:41:17.452717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c75860-dae7-4328-8766-78e6ead4baeb admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:41:17.453960 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-83c75860-dae7-4328-8766-78e6ead4baeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:41:17.581189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c75860-dae7-4328-8766-78e6ead4baeb admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:41:17.637318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:41:17.656684 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347e5cb-c45d-4a0b-84de-aea488702846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:41:17.657306 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347e5cb-c45d-4a0b-84de-aea488702846 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:41:17.657591 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347e5cb-c45d-4a0b-84de-aea488702846 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:41:17.657888 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347e5cb-c45d-4a0b-84de-aea488702846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:41:17.659622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7347e5cb-c45d-4a0b-84de-aea488702846 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:41:17.777949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347e5cb-c45d-4a0b-84de-aea488702846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:41:17.779385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347e5cb-c45d-4a0b-84de-aea488702846 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:41:17.798785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 750/1509] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:41:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:41:18.325013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895334a-4f4a-43cc-b9b2-39a882d0fa15 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:41:18.326578 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-7895334a-4f4a-43cc-b9b2-39a882d0fa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:41:18.338831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895334a-4f4a-43cc-b9b2-39a882d0fa15 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:41:18.439559 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf6cf7-914e-458b-8145-85c86d97c76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:41:18.440215 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf6cf7-914e-458b-8145-85c86d97c76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:41:18.440504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf6cf7-914e-458b-8145-85c86d97c76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:41:18.440781 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf6cf7-914e-458b-8145-85c86d97c76d admin admin] PATH_INFO: `/v3/projects/22f61c401c8a4538b3995c16f0d33c85` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:41:18.451686 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf6cf7-914e-458b-8145-85c86d97c76d admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f61c401c8a4538b3995c16f0d33c85)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:41:18.452724 dv-cinder-799871-43-smb devstack@keystone.service[80429]: WARNING py.warnings [None req-7ddf6cf7-914e-458b-8145-85c86d97c76d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:41:18.452724 dv-cinder-799871-43-smb devstack@keystone.service[80429]: warnings.warn(msg) Jul 27 18:41:18.452724 dv-cinder-799871-43-smb devstack@keystone.service[80429]: Jul 27 18:41:18.453938 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf6cf7-914e-458b-8145-85c86d97c76d admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:41:18.579730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-7ddf6cf7-914e-458b-8145-85c86d97c76d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f61c401c8a4538b3995c16f0d33c85', 'request_id': 'req-7ddf6cf7-914e-458b-8145-85c86d97c76d'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:41:18.585954 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-7ddf6cf7-914e-458b-8145-85c86d97c76d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f61c401c8a4538b3995c16f0d33c85', 'request_id': 'req-7ddf6cf7-914e-458b-8145-85c86d97c76d'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:41:18.661372 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-7ddf6cf7-914e-458b-8145-85c86d97c76d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f61c401c8a4538b3995c16f0d33c85', 'request_id': 'req-7ddf6cf7-914e-458b-8145-85c86d97c76d'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:41:18.692440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-7ddf6cf7-914e-458b-8145-85c86d97c76d admin admin] The token cache is being invalidate because project 22f61c401c8a4538b3995c16f0d33c85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:41:18.692729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-7ddf6cf7-914e-458b-8145-85c86d97c76d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:41:18.693157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-7ddf6cf7-914e-458b-8145-85c86d97c76d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:41:18.694613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 760/1510] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:41:18 2022] DELETE /identity/v3/projects/22f61c401c8a4538b3995c16f0d33c85 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:41:27.796524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=62 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:41:28.690342 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:43:09.824292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ddf4f-d57c-433d-bcf7-694272f58ab0 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:09.824867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ddf4f-d57c-433d-bcf7-694272f58ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:09.824867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ddf4f-d57c-433d-bcf7-694272f58ab0 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:09.826178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:43:09.831211 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0529cc-3c32-48c4-9f8d-281e27995b79 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:09.831709 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0529cc-3c32-48c4-9f8d-281e27995b79 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:09.831819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0529cc-3c32-48c4-9f8d-281e27995b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:09.917064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-ad0529cc-3c32-48c4-9f8d-281e27995b79 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:43:09.918362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ad0529cc-3c32-48c4-9f8d-281e27995b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:43:10.023823 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:43:10.182019 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ddf4f-d57c-433d-bcf7-694272f58ab0 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:43:10.184319 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-236ddf4f-d57c-433d-bcf7-694272f58ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:43:10.306761 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ddf4f-d57c-433d-bcf7-694272f58ab0 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:43:10.312389 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d29bd-060f-42dd-99b4-2442fea0855f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:43:10.313015 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d29bd-060f-42dd-99b4-2442fea0855f service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:10.313300 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d29bd-060f-42dd-99b4-2442fea0855f service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:10.313579 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d29bd-060f-42dd-99b4-2442fea0855f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:10.322234 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d29bd-060f-42dd-99b4-2442fea0855f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:43:10.323897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d29bd-060f-42dd-99b4-2442fea0855f service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:43:10.333428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 752/1513] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:43:11.180411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e136a62-fdee-472e-9b79-1aa05006b486 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:11.181159 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e136a62-fdee-472e-9b79-1aa05006b486 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:11.181159 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e136a62-fdee-472e-9b79-1aa05006b486 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:11.182437 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:43:11.192449 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac19d8-6a80-4347-bfa9-5de312342117 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:11.193001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac19d8-6a80-4347-bfa9-5de312342117 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:11.193001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac19d8-6a80-4347-bfa9-5de312342117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:11.213118 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-6eac19d8-6a80-4347-bfa9-5de312342117 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:43:11.214617 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6eac19d8-6a80-4347-bfa9-5de312342117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:43:11.223882 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:43:11.379011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e136a62-fdee-472e-9b79-1aa05006b486 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:43:11.393508 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e136a62-fdee-472e-9b79-1aa05006b486 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:43:11.399729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67841b8b-fbd4-44c2-9f4a-98af5df31254 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:43:11.400357 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67841b8b-fbd4-44c2-9f4a-98af5df31254 service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:11.400639 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67841b8b-fbd4-44c2-9f4a-98af5df31254 service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:11.400915 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67841b8b-fbd4-44c2-9f4a-98af5df31254 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:11.410233 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67841b8b-fbd4-44c2-9f4a-98af5df31254 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:43:11.411890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67841b8b-fbd4-44c2-9f4a-98af5df31254 service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:43:11.422661 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 763/1516] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:43:12.945069 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecea5c-4e8e-4bf7-b972-4914bd4b488d None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:12.945657 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecea5c-4e8e-4bf7-b972-4914bd4b488d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:12.945657 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecea5c-4e8e-4bf7-b972-4914bd4b488d None None] PATH_INFO: `/v3` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:12.946971 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 754/1517] 10.222.0.64 () {54 vars in 925 bytes} [Wed Jul 27 18:43:12 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:43:12.969859 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8393637-7b7c-4080-9a56-59b8b886a3e3 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:12.970331 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8393637-7b7c-4080-9a56-59b8b886a3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:12.970435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8393637-7b7c-4080-9a56-59b8b886a3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:13.030558 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-d8393637-7b7c-4080-9a56-59b8b886a3e3 None None] MFA Rules not processed for user `aa971da983ea48c3b6d4c68a5d454bde`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:43:13.031814 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-d8393637-7b7c-4080-9a56-59b8b886a3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:43:13.048862 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:43:13.104833 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 764/1518] 10.222.0.64 () {58 vars in 1015 bytes} [Wed Jul 27 18:43:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:43:17.237987 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eec7e9-f2ae-4b7c-885e-20cc484c5853 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:17.238794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eec7e9-f2ae-4b7c-885e-20cc484c5853 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:17.238794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eec7e9-f2ae-4b7c-885e-20cc484c5853 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:17.240835 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 755/1519] 10.222.0.65 () {54 vars in 961 bytes} [Wed Jul 27 18:43:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:43:17.246152 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be771669-a20d-4242-a69d-6847cb9d952a None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:17.246801 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be771669-a20d-4242-a69d-6847cb9d952a None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:17.246801 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be771669-a20d-4242-a69d-6847cb9d952a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:17.266903 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-be771669-a20d-4242-a69d-6847cb9d952a None None] MFA Rules not processed for user `aa971da983ea48c3b6d4c68a5d454bde`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:43:17.268157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-be771669-a20d-4242-a69d-6847cb9d952a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:43:17.277649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 765/1520] 10.222.0.65 () {58 vars in 1058 bytes} [Wed Jul 27 18:43:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:43:17.285322 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eec7e9-f2ae-4b7c-885e-20cc484c5853 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:43:17.299581 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eec7e9-f2ae-4b7c-885e-20cc484c5853 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:43:17.305091 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd597ad-b73b-4176-b8f3-75694c7d7a3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa971da983ea48c3b6d4c68a5d454bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:43:17.305699 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd597ad-b73b-4176-b8f3-75694c7d7a3e service placement] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:17.305981 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd597ad-b73b-4176-b8f3-75694c7d7a3e service placement] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:17.306297 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd597ad-b73b-4176-b8f3-75694c7d7a3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:17.314744 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd597ad-b73b-4176-b8f3-75694c7d7a3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:43:17.316367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd597ad-b73b-4176-b8f3-75694c7d7a3e service placement] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:43:17.326771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 756/1521] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:43:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:43:22.681696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bacb84-410c-4597-9d04-5f19fae5c6cc None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:22.682281 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bacb84-410c-4597-9d04-5f19fae5c6cc None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:22.682281 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bacb84-410c-4597-9d04-5f19fae5c6cc None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:22.683651 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:43:22.688684 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6e130-ff76-4bab-9c60-742bd028363a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:22.689131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6e130-ff76-4bab-9c60-742bd028363a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:22.689318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6e130-ff76-4bab-9c60-742bd028363a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:22.709178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0bf6e130-ff76-4bab-9c60-742bd028363a None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:43:22.710414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0bf6e130-ff76-4bab-9c60-742bd028363a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:43:22.719361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:43:22.876883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bacb84-410c-4597-9d04-5f19fae5c6cc None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:43:22.892892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bacb84-410c-4597-9d04-5f19fae5c6cc None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:43:22.899008 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80770335-eafc-4f56-9bde-d76bbd4cc9ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:43:22.899779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80770335-eafc-4f56-9bde-d76bbd4cc9ba service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:22.900065 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80770335-eafc-4f56-9bde-d76bbd4cc9ba service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:22.900342 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80770335-eafc-4f56-9bde-d76bbd4cc9ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:22.909447 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80770335-eafc-4f56-9bde-d76bbd4cc9ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:43:22.911065 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80770335-eafc-4f56-9bde-d76bbd4cc9ba service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:43:22.921879 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 767/1524] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:43:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:43:23.766453 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df96a37-fd37-4c5a-ac92-90a507065f39 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:23.767019 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df96a37-fd37-4c5a-ac92-90a507065f39 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:23.767111 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df96a37-fd37-4c5a-ac92-90a507065f39 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:23.768509 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:43:23.773676 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3662f-f780-4697-b5c7-dc48d4f4b01a None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:23.774216 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3662f-f780-4697-b5c7-dc48d4f4b01a None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:23.774316 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3662f-f780-4697-b5c7-dc48d4f4b01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:23.794558 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-c3f3662f-f780-4697-b5c7-dc48d4f4b01a None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:43:23.795819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c3f3662f-f780-4697-b5c7-dc48d4f4b01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:43:23.803887 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:43:23.958986 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df96a37-fd37-4c5a-ac92-90a507065f39 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:43:23.974661 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df96a37-fd37-4c5a-ac92-90a507065f39 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:43:23.981753 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc27bc3-e2b9-4ad1-ab0d-d637c75403b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:43:23.982380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc27bc3-e2b9-4ad1-ab0d-d637c75403b2 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:23.982664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc27bc3-e2b9-4ad1-ab0d-d637c75403b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:23.982944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc27bc3-e2b9-4ad1-ab0d-d637c75403b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:23.991534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc27bc3-e2b9-4ad1-ab0d-d637c75403b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:43:23.993203 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc27bc3-e2b9-4ad1-ab0d-d637c75403b2 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:43:24.002813 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 759/1527] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:43:27.929925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc091589-36f4-48c9-86fb-b624d721357f None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:27.931292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc091589-36f4-48c9-86fb-b624d721357f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:27.931292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc091589-36f4-48c9-86fb-b624d721357f None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:27.932714 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:43:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:43:27.938169 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a260c2a-6aeb-43f4-b92b-cdc3b82494f0 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:27.938630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a260c2a-6aeb-43f4-b92b-cdc3b82494f0 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:27.938741 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a260c2a-6aeb-43f4-b92b-cdc3b82494f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:27.958732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-4a260c2a-6aeb-43f4-b92b-cdc3b82494f0 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:43:27.959970 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4a260c2a-6aeb-43f4-b92b-cdc3b82494f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:43:27.968339 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:43:28.042175 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc091589-36f4-48c9-86fb-b624d721357f None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:43:28.043927 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-bc091589-36f4-48c9-86fb-b624d721357f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:43:28.126840 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc091589-36f4-48c9-86fb-b624d721357f None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:43:28.130477 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b242661-482e-45cd-96df-82efeb677c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:43:28.131098 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b242661-482e-45cd-96df-82efeb677c0a service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:28.131418 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b242661-482e-45cd-96df-82efeb677c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:28.131695 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b242661-482e-45cd-96df-82efeb677c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:28.141780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b242661-482e-45cd-96df-82efeb677c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:43:28.143237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b242661-482e-45cd-96df-82efeb677c0a service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:43:28.153410 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 770/1530] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:43:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:43:30.179306 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0b55b-1c31-48e8-a005-633d59518342 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:30.179905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0b55b-1c31-48e8-a005-633d59518342 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:30.179905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0b55b-1c31-48e8-a005-633d59518342 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:30.181802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 761/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:43:30.187007 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72f829-c401-44a0-a3ea-7ca661424f86 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:30.187471 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72f829-c401-44a0-a3ea-7ca661424f86 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:30.187615 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72f829-c401-44a0-a3ea-7ca661424f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:30.207873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-ce72f829-c401-44a0-a3ea-7ca661424f86 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:43:30.209087 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ce72f829-c401-44a0-a3ea-7ca661424f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:43:30.217528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 771/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:43:30.253865 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0b55b-1c31-48e8-a005-633d59518342 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:43:30.265422 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0b55b-1c31-48e8-a005-633d59518342 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:43:30.268914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4d49f-c4ab-4d3f-8c52-1e12a5d783e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:43:30.269520 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4d49f-c4ab-4d3f-8c52-1e12a5d783e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:30.269801 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4d49f-c4ab-4d3f-8c52-1e12a5d783e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:30.270074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4d49f-c4ab-4d3f-8c52-1e12a5d783e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:30.278995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4d49f-c4ab-4d3f-8c52-1e12a5d783e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:43:30.280462 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4d49f-c4ab-4d3f-8c52-1e12a5d783e9 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:43:30.289893 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 762/1533] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:43:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:43:33.848159 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882269f-48bc-4fe7-b94e-a98929b0e059 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:33.848802 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882269f-48bc-4fe7-b94e-a98929b0e059 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:33.848802 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882269f-48bc-4fe7-b94e-a98929b0e059 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:33.850236 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 772/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:43:33.855675 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004960df-ab4b-4aa6-881b-3cf3978f35fa None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:33.856148 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004960df-ab4b-4aa6-881b-3cf3978f35fa None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:33.856264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004960df-ab4b-4aa6-881b-3cf3978f35fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:33.876008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-004960df-ab4b-4aa6-881b-3cf3978f35fa None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:43:33.877209 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-004960df-ab4b-4aa6-881b-3cf3978f35fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:43:33.885725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 763/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:43:34.189094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882269f-48bc-4fe7-b94e-a98929b0e059 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:43:34.191949 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c882269f-48bc-4fe7-b94e-a98929b0e059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:43:34.261128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:43:34.274560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882269f-48bc-4fe7-b94e-a98929b0e059 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:43:34.278238 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d6682-6297-4191-a4f4-eeb6101ab464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:43:34.283584 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d6682-6297-4191-a4f4-eeb6101ab464 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:34.283584 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d6682-6297-4191-a4f4-eeb6101ab464 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:34.283584 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d6682-6297-4191-a4f4-eeb6101ab464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:34.288516 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d6682-6297-4191-a4f4-eeb6101ab464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:43:34.290607 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d6682-6297-4191-a4f4-eeb6101ab464 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:43:34.300146 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 773/1536] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:43:36.343804 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa1d78-c5ff-4faa-a5e8-a1a701a97c7e None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:36.344391 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa1d78-c5ff-4faa-a5e8-a1a701a97c7e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:36.344391 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa1d78-c5ff-4faa-a5e8-a1a701a97c7e None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:36.345726 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 764/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:43:36.351228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfa6a7-a536-4c38-99d8-21a6b20cfa7f None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:36.351712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfa6a7-a536-4c38-99d8-21a6b20cfa7f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:36.351835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfa6a7-a536-4c38-99d8-21a6b20cfa7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:36.377853 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-88bfa6a7-a536-4c38-99d8-21a6b20cfa7f None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:43:36.379013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-88bfa6a7-a536-4c38-99d8-21a6b20cfa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:43:36.387860 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 774/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:43:36.704496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa1d78-c5ff-4faa-a5e8-a1a701a97c7e None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:43:36.706229 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ecfa1d78-c5ff-4faa-a5e8-a1a701a97c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:43:36.722043 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa1d78-c5ff-4faa-a5e8-a1a701a97c7e None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:43:36.725880 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bcab6-db00-4897-bdcd-7598dd48976c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:43:36.726485 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bcab6-db00-4897-bdcd-7598dd48976c service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:43:36.726765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bcab6-db00-4897-bdcd-7598dd48976c service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:43:36.727825 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bcab6-db00-4897-bdcd-7598dd48976c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:43:36.737049 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bcab6-db00-4897-bdcd-7598dd48976c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:43:36.738478 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bcab6-db00-4897-bdcd-7598dd48976c service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:43:36.748213 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 765/1539] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:43:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:43:46.372584 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=11 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:43:46.744041 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:10.298261 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b22ce5-48f9-4c01-be76-7d7d88e89c0c None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:10.298903 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b22ce5-48f9-4c01-be76-7d7d88e89c0c None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:10.298903 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b22ce5-48f9-4c01-be76-7d7d88e89c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:10.335300 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-32b22ce5-48f9-4c01-be76-7d7d88e89c0c None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:10.335300 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-32b22ce5-48f9-4c01-be76-7d7d88e89c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:10.351998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 775/1540] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:10.361378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e95cf2-3142-4f7a-80b7-f7d57af6798c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:10.361978 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e95cf2-3142-4f7a-80b7-f7d57af6798c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:10.361978 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e95cf2-3142-4f7a-80b7-f7d57af6798c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:10.397597 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-33e95cf2-3142-4f7a-80b7-f7d57af6798c None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:10.399766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-33e95cf2-3142-4f7a-80b7-f7d57af6798c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:10.417732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 766/1541] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:45:10.423460 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b22ce5-48f9-4c01-be76-7d7d88e89c0c None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:10.441878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b22ce5-48f9-4c01-be76-7d7d88e89c0c None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:10.452323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811d11a-d1df-4880-a836-0a8485d627bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:10.453026 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811d11a-d1df-4880-a836-0a8485d627bd admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:10.453307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811d11a-d1df-4880-a836-0a8485d627bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:10.453715 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811d11a-d1df-4880-a836-0a8485d627bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:10.454440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811d11a-d1df-4880-a836-0a8485d627bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:45:10.454748 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811d11a-d1df-4880-a836-0a8485d627bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:10.456916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811d11a-d1df-4880-a836-0a8485d627bd admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:10.458429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfa85e-8f3a-4d88-8ec1-fbcd3190fc4f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:10.459633 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfa85e-8f3a-4d88-8ec1-fbcd3190fc4f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:10.459917 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfa85e-8f3a-4d88-8ec1-fbcd3190fc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:10.481544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 776/1542] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:45:10.497632 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-abbfa85e-8f3a-4d88-8ec1-fbcd3190fc4f None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:10.498932 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-abbfa85e-8f3a-4d88-8ec1-fbcd3190fc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:10.504453 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811d11a-d1df-4880-a836-0a8485d627bd admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:10.517001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 767/1543] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:45:10.525940 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811d11a-d1df-4880-a836-0a8485d627bd admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:10.528761 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b2c87-2fd5-4dfa-92e0-4a0b5d8ee5f6 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:10.529043 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b2c87-2fd5-4dfa-92e0-4a0b5d8ee5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:10.529404 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b2c87-2fd5-4dfa-92e0-4a0b5d8ee5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:10.539494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c14227-06d0-42f4-be00-6ae2392e0a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:10.540153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c14227-06d0-42f4-be00-6ae2392e0a7e admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:10.540532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c14227-06d0-42f4-be00-6ae2392e0a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:10.540784 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c14227-06d0-42f4-be00-6ae2392e0a7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:10.541470 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c14227-06d0-42f4-be00-6ae2392e0a7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:10.542723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: WARNING py.warnings [None req-22c14227-06d0-42f4-be00-6ae2392e0a7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:45:10.542723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: warnings.warn(msg) Jul 27 18:45:10.542723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: Jul 27 18:45:10.545143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c14227-06d0-42f4-be00-6ae2392e0a7e admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:10.591683 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-392b2c87-2fd5-4dfa-92e0-4a0b5d8ee5f6 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:10.592909 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-392b2c87-2fd5-4dfa-92e0-4a0b5d8ee5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:10.608460 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 768/1544] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:45:10.612911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320de79a-5102-4e2d-8026-a02a2bdda5d5 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:10.613206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320de79a-5102-4e2d-8026-a02a2bdda5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:10.613504 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320de79a-5102-4e2d-8026-a02a2bdda5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:10.648374 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-320de79a-5102-4e2d-8026-a02a2bdda5d5 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:10.649588 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-320de79a-5102-4e2d-8026-a02a2bdda5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:10.665993 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 769/1545] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:45:10.667006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320de79a-5102-4e2d-8026-a02a2bdda5d5 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:10.681717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320de79a-5102-4e2d-8026-a02a2bdda5d5 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:10.693094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076096c-34be-4bd5-b481-d554fcfb0d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:10.693662 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076096c-34be-4bd5-b481-d554fcfb0d4c admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:10.693943 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076096c-34be-4bd5-b481-d554fcfb0d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:10.694220 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076096c-34be-4bd5-b481-d554fcfb0d4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:10.694921 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076096c-34be-4bd5-b481-d554fcfb0d4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:45:10.695225 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076096c-34be-4bd5-b481-d554fcfb0d4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:10.696405 dv-cinder-799871-43-smb devstack@keystone.service[80428]: WARNING py.warnings [None req-6076096c-34be-4bd5-b481-d554fcfb0d4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:45:10.696405 dv-cinder-799871-43-smb devstack@keystone.service[80428]: warnings.warn(msg) Jul 27 18:45:10.696405 dv-cinder-799871-43-smb devstack@keystone.service[80428]: Jul 27 18:45:10.697298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076096c-34be-4bd5-b481-d554fcfb0d4c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:10.715950 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 777/1546] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:10 2022] POST /identity/v3/projects => generated 365 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:10.717329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c921fb0-ab39-4de7-afdd-785a06658f3b None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:10.717624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c921fb0-ab39-4de7-afdd-785a06658f3b None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:10.717804 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 770/1547] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:45:10.718149 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c921fb0-ab39-4de7-afdd-785a06658f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:10.721022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076096c-34be-4bd5-b481-d554fcfb0d4c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:10.737714 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076096c-34be-4bd5-b481-d554fcfb0d4c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:10.757203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-4c921fb0-ab39-4de7-afdd-785a06658f3b None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:10.758435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4c921fb0-ab39-4de7-afdd-785a06658f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:10.864070 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95bf7c-52e9-4cb5-9f51-5a9cdf45dd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:10.864723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95bf7c-52e9-4cb5-9f51-5a9cdf45dd59 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:10.865003 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95bf7c-52e9-4cb5-9f51-5a9cdf45dd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:10.865339 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95bf7c-52e9-4cb5-9f51-5a9cdf45dd59 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:10.865942 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95bf7c-52e9-4cb5-9f51-5a9cdf45dd59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:10.867059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: WARNING py.warnings [None req-8e95bf7c-52e9-4cb5-9f51-5a9cdf45dd59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:45:10.867059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: warnings.warn(msg) Jul 27 18:45:10.867059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: Jul 27 18:45:10.868608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95bf7c-52e9-4cb5-9f51-5a9cdf45dd59 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:10.880884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 778/1548] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:10.881797 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c921fb0-ab39-4de7-afdd-785a06658f3b None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:10.892315 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c921fb0-ab39-4de7-afdd-785a06658f3b None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:10.897155 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673e291-5604-497c-9734-32b9b9d3aa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:10.901425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673e291-5604-497c-9734-32b9b9d3aa85 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:10.901425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673e291-5604-497c-9734-32b9b9d3aa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:10.901425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673e291-5604-497c-9734-32b9b9d3aa85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:10.901425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673e291-5604-497c-9734-32b9b9d3aa85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:10.901425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673e291-5604-497c-9734-32b9b9d3aa85 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:10.963180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 771/1549] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:10 2022] POST /identity/v3/users => generated 283 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:10.964380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e74f86-0d17-4281-88c3-28b41a65c7c5 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:10.964670 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e74f86-0d17-4281-88c3-28b41a65c7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:10.964948 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e74f86-0d17-4281-88c3-28b41a65c7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:10.985746 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a0e74f86-0d17-4281-88c3-28b41a65c7c5 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:10.986952 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a0e74f86-0d17-4281-88c3-28b41a65c7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:10.994963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 772/1550] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:10.996936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84a1bf-4a2d-493d-a230-700587de27ad None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:10.997227 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84a1bf-4a2d-493d-a230-700587de27ad None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:10.997514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84a1bf-4a2d-493d-a230-700587de27ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.017084 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-7d84a1bf-4a2d-493d-a230-700587de27ad None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:11.018291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7d84a1bf-4a2d-493d-a230-700587de27ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:11.026396 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 773/1551] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:11.027592 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fea46f-8eec-4759-be97-f743ad884303 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.027881 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fea46f-8eec-4759-be97-f743ad884303 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.028160 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fea46f-8eec-4759-be97-f743ad884303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.045812 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 779/1552] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:10 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:11.050732 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673e291-5604-497c-9734-32b9b9d3aa85 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:11.050879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-42fea46f-8eec-4759-be97-f743ad884303 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:11.050879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-42fea46f-8eec-4759-be97-f743ad884303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:11.113887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 774/1553] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:11.115688 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf40789-4b12-43fd-a122-2ccf45e48310 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.116042 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf40789-4b12-43fd-a122-2ccf45e48310 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.116385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf40789-4b12-43fd-a122-2ccf45e48310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.118393 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673e291-5604-497c-9734-32b9b9d3aa85 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:11.125620 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fbeaf-25c0-4bf1-80c2-c5c2fc78a90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:11.126357 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fbeaf-25c0-4bf1-80c2-c5c2fc78a90a admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.126717 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fbeaf-25c0-4bf1-80c2-c5c2fc78a90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.127070 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fbeaf-25c0-4bf1-80c2-c5c2fc78a90a admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.127897 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fbeaf-25c0-4bf1-80c2-c5c2fc78a90a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:45:11.128609 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fbeaf-25c0-4bf1-80c2-c5c2fc78a90a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:11.130329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fbeaf-25c0-4bf1-80c2-c5c2fc78a90a admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:11.141988 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-fcf40789-4b12-43fd-a122-2ccf45e48310 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:11.143123 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 780/1554] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:45:11.144439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598dd11-046b-43e8-b287-ab282e3b3ee8 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.144835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598dd11-046b-43e8-b287-ab282e3b3ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.145233 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598dd11-046b-43e8-b287-ab282e3b3ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.148053 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-fcf40789-4b12-43fd-a122-2ccf45e48310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:11.159855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 775/1555] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:11.161010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf40789-4b12-43fd-a122-2ccf45e48310 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:11.170339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-a598dd11-046b-43e8-b287-ab282e3b3ee8 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:11.171743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a598dd11-046b-43e8-b287-ab282e3b3ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:11.174671 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf40789-4b12-43fd-a122-2ccf45e48310 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:11.179897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0cc71-368e-4ee1-a43f-04684225e99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:11.180645 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0cc71-368e-4ee1-a43f-04684225e99c admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.180925 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0cc71-368e-4ee1-a43f-04684225e99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.181194 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0cc71-368e-4ee1-a43f-04684225e99c admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.181718 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 781/1556] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:11.181898 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0cc71-368e-4ee1-a43f-04684225e99c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:11.183576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0cc71-368e-4ee1-a43f-04684225e99c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:11.194320 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa38e82-f931-433a-9999-15efb0045fc1 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.194616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa38e82-f931-433a-9999-15efb0045fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.195113 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa38e82-f931-433a-9999-15efb0045fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.197093 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 776/1557] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:11.201101 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa832796-b2d0-4e45-b83a-b09ccd458eeb None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.201388 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa832796-b2d0-4e45-b83a-b09ccd458eeb None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.201668 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa832796-b2d0-4e45-b83a-b09ccd458eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.219954 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-9aa38e82-f931-433a-9999-15efb0045fc1 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:11.221207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-9aa38e82-f931-433a-9999-15efb0045fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:11.225710 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-fa832796-b2d0-4e45-b83a-b09ccd458eeb None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:11.227215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-fa832796-b2d0-4e45-b83a-b09ccd458eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:11.229864 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 782/1558] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:11.230860 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa38e82-f931-433a-9999-15efb0045fc1 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:11.241899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa38e82-f931-433a-9999-15efb0045fc1 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:11.244353 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 777/1559] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:11.245643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711c670-11f8-409a-93ff-f5274a3932ae None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.245937 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711c670-11f8-409a-93ff-f5274a3932ae None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.246218 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711c670-11f8-409a-93ff-f5274a3932ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.250508 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52157a0e-4388-4797-b158-27fb3fc7b18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:11.251605 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52157a0e-4388-4797-b158-27fb3fc7b18b admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.252138 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52157a0e-4388-4797-b158-27fb3fc7b18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.252638 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52157a0e-4388-4797-b158-27fb3fc7b18b admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.254150 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52157a0e-4388-4797-b158-27fb3fc7b18b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:11.256332 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52157a0e-4388-4797-b158-27fb3fc7b18b admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:11.265806 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:11.266933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a711c670-11f8-409a-93ff-f5274a3932ae None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:11.268173 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a711c670-11f8-409a-93ff-f5274a3932ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:11.275770 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 778/1560] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:11.285332 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711c670-11f8-409a-93ff-f5274a3932ae None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:11.288607 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711c670-11f8-409a-93ff-f5274a3932ae None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:11.293244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e554cc6-ca97-4adb-8c86-3b3118e6c52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:11.293864 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e554cc6-ca97-4adb-8c86-3b3118e6c52b admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.294144 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e554cc6-ca97-4adb-8c86-3b3118e6c52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.294441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e554cc6-ca97-4adb-8c86-3b3118e6c52b admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.295104 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e554cc6-ca97-4adb-8c86-3b3118e6c52b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:11.297771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e554cc6-ca97-4adb-8c86-3b3118e6c52b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:11.302719 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:11.397135 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 783/1561] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:11 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:11.401573 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 779/1562] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:11 2022] POST /identity/v3/projects => generated 391 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:11.402067 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f987b8-3596-4553-9678-75bf0c15cc57 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.402067 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f987b8-3596-4553-9678-75bf0c15cc57 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.402067 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f987b8-3596-4553-9678-75bf0c15cc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.402328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a5c1e-0511-4cb9-a9ce-cda98ad0f3c0 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.402328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a5c1e-0511-4cb9-a9ce-cda98ad0f3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.402328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a5c1e-0511-4cb9-a9ce-cda98ad0f3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.419390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-69f987b8-3596-4553-9678-75bf0c15cc57 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:11.420152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c53a5c1e-0511-4cb9-a9ce-cda98ad0f3c0 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:11.420638 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-69f987b8-3596-4553-9678-75bf0c15cc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:11.421389 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c53a5c1e-0511-4cb9-a9ce-cda98ad0f3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:11.482598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 784/1563] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:11.487593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f987b8-3596-4553-9678-75bf0c15cc57 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:11.487740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 780/1564] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:11.487740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a5c1e-0511-4cb9-a9ce-cda98ad0f3c0 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:11.494278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f987b8-3596-4553-9678-75bf0c15cc57 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:11.499233 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bee03b-7ea9-46cd-834c-3d4bc8009f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:11.499761 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a5c1e-0511-4cb9-a9ce-cda98ad0f3c0 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:11.500468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bee03b-7ea9-46cd-834c-3d4bc8009f71 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.500768 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bee03b-7ea9-46cd-834c-3d4bc8009f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.501046 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bee03b-7ea9-46cd-834c-3d4bc8009f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.501851 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bee03b-7ea9-46cd-834c-3d4bc8009f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:11.503746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bee03b-7ea9-46cd-834c-3d4bc8009f71 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:11.505149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86667d3d-3986-496b-ae37-ebc4121d7506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:11.505763 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86667d3d-3986-496b-ae37-ebc4121d7506 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.506042 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86667d3d-3986-496b-ae37-ebc4121d7506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.506316 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86667d3d-3986-496b-ae37-ebc4121d7506 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.507002 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86667d3d-3986-496b-ae37-ebc4121d7506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:45:11.507682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86667d3d-3986-496b-ae37-ebc4121d7506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:11.509290 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86667d3d-3986-496b-ae37-ebc4121d7506 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:11.517940 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 785/1565] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:11.517940 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bee03b-7ea9-46cd-834c-3d4bc8009f71 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:11.531421 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 781/1566] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:45:11.531421 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86667d3d-3986-496b-ae37-ebc4121d7506 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:11.531876 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bee03b-7ea9-46cd-834c-3d4bc8009f71 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:11.539521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86667d3d-3986-496b-ae37-ebc4121d7506 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:11.539734 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a011a68-11c4-463d-b6e3-804ab1e095da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:11.539734 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a011a68-11c4-463d-b6e3-804ab1e095da admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.539734 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a011a68-11c4-463d-b6e3-804ab1e095da admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.539734 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a011a68-11c4-463d-b6e3-804ab1e095da admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.540067 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a011a68-11c4-463d-b6e3-804ab1e095da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:45:11.540067 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a011a68-11c4-463d-b6e3-804ab1e095da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:11.540567 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a011a68-11c4-463d-b6e3-804ab1e095da admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:11.545260 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86395df1-afd3-4511-bfb5-17671a6f56d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:11.545918 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86395df1-afd3-4511-bfb5-17671a6f56d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.546198 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86395df1-afd3-4511-bfb5-17671a6f56d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.546549 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86395df1-afd3-4511-bfb5-17671a6f56d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.547923 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86395df1-afd3-4511-bfb5-17671a6f56d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:45:11.548417 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86395df1-afd3-4511-bfb5-17671a6f56d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:11.550232 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86395df1-afd3-4511-bfb5-17671a6f56d0 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:11.556144 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 786/1567] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:45:11.557018 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a011a68-11c4-463d-b6e3-804ab1e095da admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:11.564710 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 782/1568] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:45:11.565553 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86395df1-afd3-4511-bfb5-17671a6f56d0 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:11.570892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a011a68-11c4-463d-b6e3-804ab1e095da admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:11.575848 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86395df1-afd3-4511-bfb5-17671a6f56d0 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:11.576014 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f03dfe-d012-4fa8-865b-736a25090f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:11.576561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f03dfe-d012-4fa8-865b-736a25090f2e admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.576845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f03dfe-d012-4fa8-865b-736a25090f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.577123 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f03dfe-d012-4fa8-865b-736a25090f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.577890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f03dfe-d012-4fa8-865b-736a25090f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:11.579545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f03dfe-d012-4fa8-865b-736a25090f2e admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:11.581473 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d63c07-4dec-4d9a-9f24-94602ec53131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:11.582484 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d63c07-4dec-4d9a-9f24-94602ec53131 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.582769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d63c07-4dec-4d9a-9f24-94602ec53131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.583048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d63c07-4dec-4d9a-9f24-94602ec53131 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.583785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d63c07-4dec-4d9a-9f24-94602ec53131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:11.586220 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d63c07-4dec-4d9a-9f24-94602ec53131 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:11.590028 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 787/1569] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:11.590836 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f03dfe-d012-4fa8-865b-736a25090f2e admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:11.600639 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f03dfe-d012-4fa8-865b-736a25090f2e admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:11.605449 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddd32f-032d-418f-aca5-ae5477aa4577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:11.606068 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddd32f-032d-418f-aca5-ae5477aa4577 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.612929 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddd32f-032d-418f-aca5-ae5477aa4577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.612929 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddd32f-032d-418f-aca5-ae5477aa4577 admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.612929 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cddd32f-032d-418f-aca5-ae5477aa4577 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:45:11.612929 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cddd32f-032d-418f-aca5-ae5477aa4577 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:11.612929 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cddd32f-032d-418f-aca5-ae5477aa4577 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:11.622069 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 788/1570] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:45:11.622896 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddd32f-032d-418f-aca5-ae5477aa4577 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:11.633192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddd32f-032d-418f-aca5-ae5477aa4577 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:11.637821 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb27063-5629-4240-aea6-da0aa534dba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:11.638443 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb27063-5629-4240-aea6-da0aa534dba1 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.638732 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb27063-5629-4240-aea6-da0aa534dba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.639009 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb27063-5629-4240-aea6-da0aa534dba1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.639737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb27063-5629-4240-aea6-da0aa534dba1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:45:11.640046 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb27063-5629-4240-aea6-da0aa534dba1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:11.641676 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb27063-5629-4240-aea6-da0aa534dba1 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:11.653160 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 789/1571] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:45:11.653921 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb27063-5629-4240-aea6-da0aa534dba1 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:11.664841 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb27063-5629-4240-aea6-da0aa534dba1 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:11.669484 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa42e8b-06c4-47d3-a471-38b580ca4a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:11.670132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa42e8b-06c4-47d3-a471-38b580ca4a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.670420 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa42e8b-06c4-47d3-a471-38b580ca4a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.670707 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa42e8b-06c4-47d3-a471-38b580ca4a80 admin admin] PATH_INFO: `/v3/projects/35bec2ebe17e440fad2ebf1b1022993c/users/ab4915f0c90f4456aa7ce8ca23617c59/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.685915 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa42e8b-06c4-47d3-a471-38b580ca4a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35bec2ebe17e440fad2ebf1b1022993c, user_id=ab4915f0c90f4456aa7ce8ca23617c59, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:11.686959 dv-cinder-799871-43-smb devstack@keystone.service[80429]: WARNING py.warnings [None req-5aa42e8b-06c4-47d3-a471-38b580ca4a80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:45:11.686959 dv-cinder-799871-43-smb devstack@keystone.service[80429]: warnings.warn(msg) Jul 27 18:45:11.686959 dv-cinder-799871-43-smb devstack@keystone.service[80429]: Jul 27 18:45:11.689861 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa42e8b-06c4-47d3-a471-38b580ca4a80 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:11.701401 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 783/1572] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:11 2022] POST /identity/v3/users => generated 296 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:11.704844 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d63c07-4dec-4d9a-9f24-94602ec53131 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:11.711890 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d63c07-4dec-4d9a-9f24-94602ec53131 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:11.716763 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db76f0-74df-4086-a5d2-b6a485ccca0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:11.717353 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db76f0-74df-4086-a5d2-b6a485ccca0d admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.717632 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db76f0-74df-4086-a5d2-b6a485ccca0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.717901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db76f0-74df-4086-a5d2-b6a485ccca0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.719097 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db76f0-74df-4086-a5d2-b6a485ccca0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:11.721071 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db76f0-74df-4086-a5d2-b6a485ccca0d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:11.758829 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 790/1573] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:11 2022] PUT /identity/v3/projects/35bec2ebe17e440fad2ebf1b1022993c/users/ab4915f0c90f4456aa7ce8ca23617c59/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:11.759578 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa42e8b-06c4-47d3-a471-38b580ca4a80 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:11.826639 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa42e8b-06c4-47d3-a471-38b580ca4a80 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:11.831325 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c422fc-7c94-43dc-8616-0315c9c916e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:11.831952 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c422fc-7c94-43dc-8616-0315c9c916e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.843337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c422fc-7c94-43dc-8616-0315c9c916e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.843337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c422fc-7c94-43dc-8616-0315c9c916e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.843337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c422fc-7c94-43dc-8616-0315c9c916e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:11.843337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c422fc-7c94-43dc-8616-0315c9c916e2 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:11.844496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 784/1574] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:11 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:11.844496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db76f0-74df-4086-a5d2-b6a485ccca0d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:11.851392 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:11.906543 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db76f0-74df-4086-a5d2-b6a485ccca0d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:11.911597 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd729e-1973-4b7b-9c4a-f0273129e853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:11.912207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd729e-1973-4b7b-9c4a-f0273129e853 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:11.912487 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd729e-1973-4b7b-9c4a-f0273129e853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:11.912761 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd729e-1973-4b7b-9c4a-f0273129e853 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:11.913416 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd729e-1973-4b7b-9c4a-f0273129e853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:11.915383 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd729e-1973-4b7b-9c4a-f0273129e853 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:11.966143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 791/1575] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:11 2022] POST /identity/v3/projects => generated 387 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:11.967085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c422fc-7c94-43dc-8616-0315c9c916e2 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:12.026134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 785/1576] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:11 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:12.026134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd729e-1973-4b7b-9c4a-f0273129e853 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:12.029336 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:12.031576 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c422fc-7c94-43dc-8616-0315c9c916e2 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:12.088717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd729e-1973-4b7b-9c4a-f0273129e853 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:12.091132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf909f-e4dd-4b05-8e60-66de8f1802e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:12.091857 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf909f-e4dd-4b05-8e60-66de8f1802e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:12.092191 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf909f-e4dd-4b05-8e60-66de8f1802e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:12.092470 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf909f-e4dd-4b05-8e60-66de8f1802e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:12.093172 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf909f-e4dd-4b05-8e60-66de8f1802e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:12.095292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68bcd3-ae5e-427e-b14b-1a77905f3094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:12.095472 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf909f-e4dd-4b05-8e60-66de8f1802e3 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:12.095597 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68bcd3-ae5e-427e-b14b-1a77905f3094 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:12.095884 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68bcd3-ae5e-427e-b14b-1a77905f3094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:12.096181 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68bcd3-ae5e-427e-b14b-1a77905f3094 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:12.096837 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68bcd3-ae5e-427e-b14b-1a77905f3094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:12.098752 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68bcd3-ae5e-427e-b14b-1a77905f3094 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:12.108872 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 792/1577] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:12.108872 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf909f-e4dd-4b05-8e60-66de8f1802e3 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:12.116858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf909f-e4dd-4b05-8e60-66de8f1802e3 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:12.121582 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e8519-a79d-4a2a-84e7-cbfe55f20094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:12.122190 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e8519-a79d-4a2a-84e7-cbfe55f20094 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:12.122476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e8519-a79d-4a2a-84e7-cbfe55f20094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:12.122777 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e8519-a79d-4a2a-84e7-cbfe55f20094 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:12.123473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e8519-a79d-4a2a-84e7-cbfe55f20094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:12.125556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e8519-a79d-4a2a-84e7-cbfe55f20094 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:12.212992 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 786/1578] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:12 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:12.213842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68bcd3-ae5e-427e-b14b-1a77905f3094 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:12.277353 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68bcd3-ae5e-427e-b14b-1a77905f3094 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:12.278286 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 793/1579] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:12 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:12.279673 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00609855-e775-42c8-9f8a-a29a0a8ed5ed None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:12.280055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00609855-e775-42c8-9f8a-a29a0a8ed5ed None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:12.280338 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00609855-e775-42c8-9f8a-a29a0a8ed5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:12.314980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-00609855-e775-42c8-9f8a-a29a0a8ed5ed None None] MFA Rules not processed for user `ab4915f0c90f4456aa7ce8ca23617c59`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:12.316251 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-00609855-e775-42c8-9f8a-a29a0a8ed5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:12.352647 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327ea05-b6bb-46f1-91c0-ac30c6b4636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:12.353283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327ea05-b6bb-46f1-91c0-ac30c6b4636f admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:12.353570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327ea05-b6bb-46f1-91c0-ac30c6b4636f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:12.353850 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327ea05-b6bb-46f1-91c0-ac30c6b4636f admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:12.354551 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327ea05-b6bb-46f1-91c0-ac30c6b4636f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:12.356207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327ea05-b6bb-46f1-91c0-ac30c6b4636f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:12.366846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 787/1580] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:12.367760 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327ea05-b6bb-46f1-91c0-ac30c6b4636f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:12.377855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327ea05-b6bb-46f1-91c0-ac30c6b4636f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:12.382585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a47037-9afd-4ebd-bed3-e4aa273260cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:12.383423 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a47037-9afd-4ebd-bed3-e4aa273260cb admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:12.383712 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a47037-9afd-4ebd-bed3-e4aa273260cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:12.383995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a47037-9afd-4ebd-bed3-e4aa273260cb admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:12.384681 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a47037-9afd-4ebd-bed3-e4aa273260cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:12.386663 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a47037-9afd-4ebd-bed3-e4aa273260cb admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:12.388544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 794/1581] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:12.389184 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00609855-e775-42c8-9f8a-a29a0a8ed5ed None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:12.395177 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:12.401274 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00609855-e775-42c8-9f8a-a29a0a8ed5ed None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:12.406013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd3346-ca5c-4f08-ad0e-d42f483917d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:12.406619 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd3346-ca5c-4f08-ad0e-d42f483917d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:12.407637 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd3346-ca5c-4f08-ad0e-d42f483917d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:12.407912 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd3346-ca5c-4f08-ad0e-d42f483917d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:12.408762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd3346-ca5c-4f08-ad0e-d42f483917d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:12.410733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd3346-ca5c-4f08-ad0e-d42f483917d7 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:12.519895 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 788/1582] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:12 2022] POST /identity/v3/users => generated 283 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:12.520711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a47037-9afd-4ebd-bed3-e4aa273260cb admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:12.530258 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a47037-9afd-4ebd-bed3-e4aa273260cb admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:12.538648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca3351-780a-4080-a17a-5825b6a1bb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:12.539318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca3351-780a-4080-a17a-5825b6a1bb6d admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:12.539608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca3351-780a-4080-a17a-5825b6a1bb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:12.539890 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca3351-780a-4080-a17a-5825b6a1bb6d admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:12.544897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca3351-780a-4080-a17a-5825b6a1bb6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:12.544897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca3351-780a-4080-a17a-5825b6a1bb6d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:12.549114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 795/1583] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:12 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:12.553342 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd3346-ca5c-4f08-ad0e-d42f483917d7 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:12.564528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd3346-ca5c-4f08-ad0e-d42f483917d7 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:12.569300 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6345e-9056-44e2-94b6-e72524d2109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:12.573491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6345e-9056-44e2-94b6-e72524d2109d admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:12.573491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6345e-9056-44e2-94b6-e72524d2109d admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:12.573491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6345e-9056-44e2-94b6-e72524d2109d admin admin] PATH_INFO: `/v3/projects/a1da346fa0fb4afdbd3b9605fc276c4b/users/b0f74e526a8d4325bd01a951a8f4c1ad/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:12.587337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6345e-9056-44e2-94b6-e72524d2109d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1da346fa0fb4afdbd3b9605fc276c4b, user_id=b0f74e526a8d4325bd01a951a8f4c1ad, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:12.590031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6345e-9056-44e2-94b6-e72524d2109d admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:12.622074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:12.629407 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 789/1584] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:12 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:12.630780 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca3351-780a-4080-a17a-5825b6a1bb6d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:12.639917 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca3351-780a-4080-a17a-5825b6a1bb6d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:12.645259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5da55-23bd-49ba-b69b-599618a7b525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:12.645872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5da55-23bd-49ba-b69b-599618a7b525 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:12.646146 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5da55-23bd-49ba-b69b-599618a7b525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:12.646429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5da55-23bd-49ba-b69b-599618a7b525 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:12.647090 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5da55-23bd-49ba-b69b-599618a7b525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:12.649131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5da55-23bd-49ba-b69b-599618a7b525 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:12.684732 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 796/1585] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:12 2022] PUT /identity/v3/projects/a1da346fa0fb4afdbd3b9605fc276c4b/users/b0f74e526a8d4325bd01a951a8f4c1ad/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:12.685697 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6345e-9056-44e2-94b6-e72524d2109d admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:12.741631 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 790/1586] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:12 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:12.742581 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5da55-23bd-49ba-b69b-599618a7b525 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:12.750184 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6345e-9056-44e2-94b6-e72524d2109d admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:12.753058 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5da55-23bd-49ba-b69b-599618a7b525 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:12.755574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ab484-376f-4db2-bf9d-e4bcdd6aa280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:12.756199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ab484-376f-4db2-bf9d-e4bcdd6aa280 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:12.756488 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ab484-376f-4db2-bf9d-e4bcdd6aa280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:12.756764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ab484-376f-4db2-bf9d-e4bcdd6aa280 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:12.757433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ab484-376f-4db2-bf9d-e4bcdd6aa280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:12.757964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f945a8a-ad78-4111-9d2d-38c5e3f26217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:12.758573 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f945a8a-ad78-4111-9d2d-38c5e3f26217 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:12.758851 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f945a8a-ad78-4111-9d2d-38c5e3f26217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:12.759120 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f945a8a-ad78-4111-9d2d-38c5e3f26217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:12.759630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ab484-376f-4db2-bf9d-e4bcdd6aa280 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:12.759863 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f945a8a-ad78-4111-9d2d-38c5e3f26217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:12.761455 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f945a8a-ad78-4111-9d2d-38c5e3f26217 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:12.774599 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 791/1587] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:12.775661 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f945a8a-ad78-4111-9d2d-38c5e3f26217 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:12.786184 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f945a8a-ad78-4111-9d2d-38c5e3f26217 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:12.790722 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b01f54-debc-4318-9978-e2c5751bd17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:12.791344 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b01f54-debc-4318-9978-e2c5751bd17a admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:12.791633 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b01f54-debc-4318-9978-e2c5751bd17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:12.791914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b01f54-debc-4318-9978-e2c5751bd17a admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:12.792570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b01f54-debc-4318-9978-e2c5751bd17a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:12.794490 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b01f54-debc-4318-9978-e2c5751bd17a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:12.856164 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 797/1588] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:12 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:12.857102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ab484-376f-4db2-bf9d-e4bcdd6aa280 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:12.867073 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ab484-376f-4db2-bf9d-e4bcdd6aa280 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:12.871720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de638985-e0be-4831-8fd3-8419df7b918b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:12.872313 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de638985-e0be-4831-8fd3-8419df7b918b admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:12.872592 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de638985-e0be-4831-8fd3-8419df7b918b admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:12.872863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de638985-e0be-4831-8fd3-8419df7b918b admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:12.873547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de638985-e0be-4831-8fd3-8419df7b918b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:12.875151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de638985-e0be-4831-8fd3-8419df7b918b admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:12.885324 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 798/1589] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:12.886218 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de638985-e0be-4831-8fd3-8419df7b918b admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:12.894627 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 792/1590] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:12 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:12.894627 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b01f54-debc-4318-9978-e2c5751bd17a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:12.897977 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de638985-e0be-4831-8fd3-8419df7b918b admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:12.956511 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66b1ff-4186-4804-a450-ed9f06ef0061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:12.957142 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66b1ff-4186-4804-a450-ed9f06ef0061 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:12.957505 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66b1ff-4186-4804-a450-ed9f06ef0061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:12.957782 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66b1ff-4186-4804-a450-ed9f06ef0061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:12.957892 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b01f54-debc-4318-9978-e2c5751bd17a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:12.958480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66b1ff-4186-4804-a450-ed9f06ef0061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:12.960128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66b1ff-4186-4804-a450-ed9f06ef0061 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:12.962738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391e684-219e-460c-bb22-a4c70cfa63b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:12.963386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391e684-219e-460c-bb22-a4c70cfa63b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:12.963670 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391e684-219e-460c-bb22-a4c70cfa63b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:12.963945 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391e684-219e-460c-bb22-a4c70cfa63b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:12.964637 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391e684-219e-460c-bb22-a4c70cfa63b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:12.966245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391e684-219e-460c-bb22-a4c70cfa63b7 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:12.970947 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 799/1591] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:12.972194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b95e97-fb96-4405-962c-bbd1e1fd4b0e None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:12.972480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b95e97-fb96-4405-962c-bbd1e1fd4b0e None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:12.972764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b95e97-fb96-4405-962c-bbd1e1fd4b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:12.980217 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 793/1592] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:12.981294 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391e684-219e-460c-bb22-a4c70cfa63b7 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:12.992586 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391e684-219e-460c-bb22-a4c70cfa63b7 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:12.997505 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b11294-28c7-4ca2-9bff-bcdb2f3a1d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:13.000479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b11294-28c7-4ca2-9bff-bcdb2f3a1d48 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:13.000479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b11294-28c7-4ca2-9bff-bcdb2f3a1d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:13.000479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b11294-28c7-4ca2-9bff-bcdb2f3a1d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:13.000479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b11294-28c7-4ca2-9bff-bcdb2f3a1d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:13.001782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b11294-28c7-4ca2-9bff-bcdb2f3a1d48 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:13.005075 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-d8b95e97-fb96-4405-962c-bbd1e1fd4b0e None None] MFA Rules not processed for user `b0f74e526a8d4325bd01a951a8f4c1ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:13.006329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-d8b95e97-fb96-4405-962c-bbd1e1fd4b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:13.012787 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 794/1593] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:13.013580 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b11294-28c7-4ca2-9bff-bcdb2f3a1d48 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:13.023687 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b11294-28c7-4ca2-9bff-bcdb2f3a1d48 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:13.028830 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940fb52-3fd9-4bb2-92d1-0cb396f05dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:13.029492 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940fb52-3fd9-4bb2-92d1-0cb396f05dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:13.029771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940fb52-3fd9-4bb2-92d1-0cb396f05dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:13.030045 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940fb52-3fd9-4bb2-92d1-0cb396f05dcc admin admin] PATH_INFO: `/v3/projects/cfc3633f57a545048abf93eb58e0f77e/users/b05240b3f0bf40789d476e4bdad8bea0/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:13.033004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:13.044966 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940fb52-3fd9-4bb2-92d1-0cb396f05dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc3633f57a545048abf93eb58e0f77e, user_id=b05240b3f0bf40789d476e4bdad8bea0, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:13.048282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940fb52-3fd9-4bb2-92d1-0cb396f05dcc admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:13.074781 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 800/1594] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:13.075657 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b95e97-fb96-4405-962c-bbd1e1fd4b0e None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:13.086338 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b95e97-fb96-4405-962c-bbd1e1fd4b0e None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:13.091147 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a810d-fa04-4f63-add8-083b3209d0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:13.091793 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a810d-fa04-4f63-add8-083b3209d0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:13.092079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a810d-fa04-4f63-add8-083b3209d0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:13.092363 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a810d-fa04-4f63-add8-083b3209d0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:13.093062 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a810d-fa04-4f63-add8-083b3209d0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:13.094763 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a810d-fa04-4f63-add8-083b3209d0c5 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:13.105040 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 801/1595] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:13.106119 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a810d-fa04-4f63-add8-083b3209d0c5 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:13.116662 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a810d-fa04-4f63-add8-083b3209d0c5 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:13.121973 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854c64c-cbd8-4529-929c-e8caba6bbc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:13.122592 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854c64c-cbd8-4529-929c-e8caba6bbc62 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:13.122881 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854c64c-cbd8-4529-929c-e8caba6bbc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:13.123164 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854c64c-cbd8-4529-929c-e8caba6bbc62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:13.123979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854c64c-cbd8-4529-929c-e8caba6bbc62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:13.126494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854c64c-cbd8-4529-929c-e8caba6bbc62 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:13.137118 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 802/1596] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:13.137907 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854c64c-cbd8-4529-929c-e8caba6bbc62 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:13.140457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 795/1597] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:13 2022] PUT /identity/v3/projects/cfc3633f57a545048abf93eb58e0f77e/users/b05240b3f0bf40789d476e4bdad8bea0/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:13.144876 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940fb52-3fd9-4bb2-92d1-0cb396f05dcc admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:13.148168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854c64c-cbd8-4529-929c-e8caba6bbc62 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:13.209208 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940fb52-3fd9-4bb2-92d1-0cb396f05dcc admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:13.209693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd43758-bd1d-417a-8f9b-a70fcfcfee62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:13.210334 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd43758-bd1d-417a-8f9b-a70fcfcfee62 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:13.210623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd43758-bd1d-417a-8f9b-a70fcfcfee62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:13.210921 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd43758-bd1d-417a-8f9b-a70fcfcfee62 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:13.211624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd43758-bd1d-417a-8f9b-a70fcfcfee62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:13.213960 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd43758-bd1d-417a-8f9b-a70fcfcfee62 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:13.214707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec72e61-1091-4e7d-a3f0-fd97fa8310c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:13.215362 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec72e61-1091-4e7d-a3f0-fd97fa8310c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:13.215648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec72e61-1091-4e7d-a3f0-fd97fa8310c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:13.215925 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec72e61-1091-4e7d-a3f0-fd97fa8310c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:13.216628 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec72e61-1091-4e7d-a3f0-fd97fa8310c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:13.218224 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec72e61-1091-4e7d-a3f0-fd97fa8310c5 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:13.229562 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 796/1598] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:13.230428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec72e61-1091-4e7d-a3f0-fd97fa8310c5 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:13.238950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:13.242647 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec72e61-1091-4e7d-a3f0-fd97fa8310c5 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:13.247326 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b926748-cbb7-4fae-866b-061b1aab0be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:13.247930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b926748-cbb7-4fae-866b-061b1aab0be7 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:13.248207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b926748-cbb7-4fae-866b-061b1aab0be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:13.248505 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b926748-cbb7-4fae-866b-061b1aab0be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:13.249234 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b926748-cbb7-4fae-866b-061b1aab0be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:13.250877 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b926748-cbb7-4fae-866b-061b1aab0be7 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:13.261104 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 797/1599] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:13.261899 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b926748-cbb7-4fae-866b-061b1aab0be7 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:13.271454 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b926748-cbb7-4fae-866b-061b1aab0be7 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:13.276049 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a7465-332e-427b-8cb0-c0df3827895e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:13.276694 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a7465-332e-427b-8cb0-c0df3827895e admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:13.276905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a7465-332e-427b-8cb0-c0df3827895e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:13.277175 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a7465-332e-427b-8cb0-c0df3827895e admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:13.277848 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a7465-332e-427b-8cb0-c0df3827895e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:13.279446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a7465-332e-427b-8cb0-c0df3827895e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:13.290578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 798/1600] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:13.292525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaca5c-9d46-4b33-b855-8fa2f2462abf None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:13.292831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaca5c-9d46-4b33-b855-8fa2f2462abf None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:13.293109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaca5c-9d46-4b33-b855-8fa2f2462abf None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:13.294622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 799/1601] 10.222.0.65 () {54 vars in 962 bytes} [Wed Jul 27 18:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:45:13.295391 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eaca5c-9d46-4b33-b855-8fa2f2462abf None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:13.308275 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eaca5c-9d46-4b33-b855-8fa2f2462abf None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:13.312925 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221551c1-4ea0-4024-981d-c59e488e0728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:13.317428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221551c1-4ea0-4024-981d-c59e488e0728 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:13.317428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221551c1-4ea0-4024-981d-c59e488e0728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:13.317428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221551c1-4ea0-4024-981d-c59e488e0728 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:13.317428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221551c1-4ea0-4024-981d-c59e488e0728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:13.317428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221551c1-4ea0-4024-981d-c59e488e0728 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:13.326879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 800/1602] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:13.327689 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221551c1-4ea0-4024-981d-c59e488e0728 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:13.339335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221551c1-4ea0-4024-981d-c59e488e0728 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:13.344096 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f624ff-ea4b-4ed6-bb33-bb84e45fb14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:13.344440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 803/1603] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:13 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:13.345028 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f624ff-ea4b-4ed6-bb33-bb84e45fb14d admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:13.347885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f624ff-ea4b-4ed6-bb33-bb84e45fb14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:13.347885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f624ff-ea4b-4ed6-bb33-bb84e45fb14d admin admin] PATH_INFO: `/v3/projects/4ef495c50e0344f78074eb53e76b1d7b/users/dc4d9a6b24314144a7796948b20a00c3/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:13.348096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef350e-03a3-40c2-8d4d-3a28768cf1f7 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:13.348096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef350e-03a3-40c2-8d4d-3a28768cf1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:13.348096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef350e-03a3-40c2-8d4d-3a28768cf1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:13.362268 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f624ff-ea4b-4ed6-bb33-bb84e45fb14d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef495c50e0344f78074eb53e76b1d7b, user_id=dc4d9a6b24314144a7796948b20a00c3, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:13.365111 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f624ff-ea4b-4ed6-bb33-bb84e45fb14d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:13.365536 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-8eef350e-03a3-40c2-8d4d-3a28768cf1f7 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:13.366775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-8eef350e-03a3-40c2-8d4d-3a28768cf1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:13.374759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 804/1604] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:13.376138 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef350e-03a3-40c2-8d4d-3a28768cf1f7 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:13.386179 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef350e-03a3-40c2-8d4d-3a28768cf1f7 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:13.391100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbc8d5-9b7b-4169-ba67-c2a8d1217240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:13.392410 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbc8d5-9b7b-4169-ba67-c2a8d1217240 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:13.392794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbc8d5-9b7b-4169-ba67-c2a8d1217240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:13.393071 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbc8d5-9b7b-4169-ba67-c2a8d1217240 admin admin] PATH_INFO: `/v3/projects/9115211ae1634cf2ab7d9784a36c743a/users/b25caac30f7641f0b0d746ebff0b54b9/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:13.408570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbc8d5-9b7b-4169-ba67-c2a8d1217240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9115211ae1634cf2ab7d9784a36c743a, user_id=b25caac30f7641f0b0d746ebff0b54b9, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:13.411287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbc8d5-9b7b-4169-ba67-c2a8d1217240 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:13.471493 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 801/1605] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:13 2022] PUT /identity/v3/projects/4ef495c50e0344f78074eb53e76b1d7b/users/dc4d9a6b24314144a7796948b20a00c3/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:13.472331 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f624ff-ea4b-4ed6-bb33-bb84e45fb14d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:13.502441 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 805/1606] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:13 2022] PUT /identity/v3/projects/9115211ae1634cf2ab7d9784a36c743a/users/b25caac30f7641f0b0d746ebff0b54b9/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:13.505675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbc8d5-9b7b-4169-ba67-c2a8d1217240 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:13.538468 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f624ff-ea4b-4ed6-bb33-bb84e45fb14d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:13.574574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbc8d5-9b7b-4169-ba67-c2a8d1217240 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:13.583378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa24979-02d4-44f4-8d2f-131efa26e530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:13.584067 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa24979-02d4-44f4-8d2f-131efa26e530 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:13.584349 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa24979-02d4-44f4-8d2f-131efa26e530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:13.584629 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa24979-02d4-44f4-8d2f-131efa26e530 admin admin] PATH_INFO: `/v3/projects/d36d7265f2274436a89e5dad0e66eba2/users/91402fce003f49cf9b3cb3c170fbed71/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:13.588291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:13.600967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6459d-a9e7-4062-a01d-466f72961fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:13.601499 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa24979-02d4-44f4-8d2f-131efa26e530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36d7265f2274436a89e5dad0e66eba2, user_id=91402fce003f49cf9b3cb3c170fbed71, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:13.601643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6459d-a9e7-4062-a01d-466f72961fe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:13.601920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6459d-a9e7-4062-a01d-466f72961fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:13.602198 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6459d-a9e7-4062-a01d-466f72961fe6 admin admin] PATH_INFO: `/v3/projects/707bc345a1f04fcfadaba7d722544a36/users/dd70947488cd4ee6b9eff3ea33ab6778/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:13.604407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa24979-02d4-44f4-8d2f-131efa26e530 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:13.616920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6459d-a9e7-4062-a01d-466f72961fe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=707bc345a1f04fcfadaba7d722544a36, user_id=dd70947488cd4ee6b9eff3ea33ab6778, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:13.619644 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6459d-a9e7-4062-a01d-466f72961fe6 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:13.751870 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 806/1607] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:13 2022] PUT /identity/v3/projects/d36d7265f2274436a89e5dad0e66eba2/users/91402fce003f49cf9b3cb3c170fbed71/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:13.753161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2e03f-5103-43d6-bd07-39681ddf0783 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:13.763526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2e03f-5103-43d6-bd07-39681ddf0783 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:13.763744 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 802/1608] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:13 2022] PUT /identity/v3/projects/707bc345a1f04fcfadaba7d722544a36/users/dd70947488cd4ee6b9eff3ea33ab6778/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:13.763862 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2e03f-5103-43d6-bd07-39681ddf0783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:13.763956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6459d-a9e7-4062-a01d-466f72961fe6 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:13.795766 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-3ea2e03f-5103-43d6-bd07-39681ddf0783 None None] MFA Rules not processed for user `be769d4dd016466f9174e7d5e47a2a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:13.797099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-3ea2e03f-5103-43d6-bd07-39681ddf0783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:13.805979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:13.826768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6459d-a9e7-4062-a01d-466f72961fe6 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:13.832686 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10575f-2a98-4ce1-bdb5-07d0261dab54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:13.833380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10575f-2a98-4ce1-bdb5-07d0261dab54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:13.833663 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10575f-2a98-4ce1-bdb5-07d0261dab54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:13.833956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10575f-2a98-4ce1-bdb5-07d0261dab54 admin admin] PATH_INFO: `/v3/projects/ed0f33af11414f889460ec4ed7179503/users/fa24cdd15afd4c9e8b34dbfa05a5db24/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:13.852367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10575f-2a98-4ce1-bdb5-07d0261dab54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed0f33af11414f889460ec4ed7179503, user_id=fa24cdd15afd4c9e8b34dbfa05a5db24, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:13.856504 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10575f-2a98-4ce1-bdb5-07d0261dab54 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:13.876312 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 807/1609] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Jul 27 18:45:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:13.877084 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2e03f-5103-43d6-bd07-39681ddf0783 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:13.889011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2e03f-5103-43d6-bd07-39681ddf0783 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:13.894417 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ce75b-0634-4a17-83ad-720a13af6f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:13.895141 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ce75b-0634-4a17-83ad-720a13af6f72 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:13.895520 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ce75b-0634-4a17-83ad-720a13af6f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:13.895871 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ce75b-0634-4a17-83ad-720a13af6f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:13.896650 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ce75b-0634-4a17-83ad-720a13af6f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:13.898350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ce75b-0634-4a17-83ad-720a13af6f72 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:13.909002 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 808/1610] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:13.909914 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ce75b-0634-4a17-83ad-720a13af6f72 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:13.947692 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 803/1611] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:13 2022] PUT /identity/v3/projects/ed0f33af11414f889460ec4ed7179503/users/fa24cdd15afd4c9e8b34dbfa05a5db24/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:13.948957 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f261b-7b8e-42ab-b242-6cefdeba06c8 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:13.949256 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f261b-7b8e-42ab-b242-6cefdeba06c8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:13.949515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f261b-7b8e-42ab-b242-6cefdeba06c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:13.968768 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ce75b-0634-4a17-83ad-720a13af6f72 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:13.979940 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b74f261b-7b8e-42ab-b242-6cefdeba06c8 None None] MFA Rules not processed for user `dc4d9a6b24314144a7796948b20a00c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:13.981158 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b74f261b-7b8e-42ab-b242-6cefdeba06c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:14.020957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3c9b8-98f8-4489-bec4-1d47504b8df5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:14.021615 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3c9b8-98f8-4489-bec4-1d47504b8df5 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:14.022065 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3c9b8-98f8-4489-bec4-1d47504b8df5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:14.022212 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3c9b8-98f8-4489-bec4-1d47504b8df5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:14.043768 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:14.046227 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 804/1612] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:14.048736 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5f14c-43d3-47bf-b4e8-dfed0d7324ae None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:14.048736 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5f14c-43d3-47bf-b4e8-dfed0d7324ae None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:14.049003 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5f14c-43d3-47bf-b4e8-dfed0d7324ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:14.079929 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-75f5f14c-43d3-47bf-b4e8-dfed0d7324ae None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:14.081194 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-75f5f14c-43d3-47bf-b4e8-dfed0d7324ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:14.089657 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 805/1613] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:14.090854 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba6959-697a-4e0b-a5e0-ae8c90cf1009 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:14.091149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba6959-697a-4e0b-a5e0-ae8c90cf1009 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:14.091463 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba6959-697a-4e0b-a5e0-ae8c90cf1009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:14.093934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3c9b8-98f8-4489-bec4-1d47504b8df5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:14.096264 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3c9b8-98f8-4489-bec4-1d47504b8df5 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:14.108971 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 809/1614] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:14.110965 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bf2e9-8c8c-41bb-ba15-25b9bd068a81 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:14.111370 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bf2e9-8c8c-41bb-ba15-25b9bd068a81 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:14.111576 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bf2e9-8c8c-41bb-ba15-25b9bd068a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:14.113038 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-88ba6959-697a-4e0b-a5e0-ae8c90cf1009 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:14.114350 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-88ba6959-697a-4e0b-a5e0-ae8c90cf1009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:14.126367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 806/1615] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:14.133723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba6959-697a-4e0b-a5e0-ae8c90cf1009 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:14.152793 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-927bf2e9-8c8c-41bb-ba15-25b9bd068a81 None None] MFA Rules not processed for user `dd70947488cd4ee6b9eff3ea33ab6778`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:14.154112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-927bf2e9-8c8c-41bb-ba15-25b9bd068a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:14.226827 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba6959-697a-4e0b-a5e0-ae8c90cf1009 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:14.239000 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed917148-12ee-4bcb-8b8d-ee0e1a10e382 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:14.239716 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed917148-12ee-4bcb-8b8d-ee0e1a10e382 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:14.240002 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed917148-12ee-4bcb-8b8d-ee0e1a10e382 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:14.240565 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed917148-12ee-4bcb-8b8d-ee0e1a10e382 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:14.246350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 810/1616] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:14.251179 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bf2e9-8c8c-41bb-ba15-25b9bd068a81 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:14.263604 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bf2e9-8c8c-41bb-ba15-25b9bd068a81 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:14.269246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f637e-d395-44d6-8224-c215e50a9463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:14.269956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f637e-d395-44d6-8224-c215e50a9463 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:14.270243 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f637e-d395-44d6-8224-c215e50a9463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:14.270526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f637e-d395-44d6-8224-c215e50a9463 admin admin] PATH_INFO: `/v3/projects/f8e9820b17de4731a880415d5bca6f72/users/956c2e68acb344f2be9b9e9cbcab9f69/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:14.287111 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f637e-d395-44d6-8224-c215e50a9463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8e9820b17de4731a880415d5bca6f72, user_id=956c2e68acb344f2be9b9e9cbcab9f69, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:14.290017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f637e-d395-44d6-8224-c215e50a9463 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:14.291503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:14.319665 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed917148-12ee-4bcb-8b8d-ee0e1a10e382 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:14.321217 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed917148-12ee-4bcb-8b8d-ee0e1a10e382 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:14.331363 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 807/1617] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:14.332675 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a08da8-1bb7-46dd-9e6d-fe623067cd0d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:14.332906 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a08da8-1bb7-46dd-9e6d-fe623067cd0d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:14.333188 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a08da8-1bb7-46dd-9e6d-fe623067cd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:14.361321 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-20a08da8-1bb7-46dd-9e6d-fe623067cd0d None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:14.362550 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-20a08da8-1bb7-46dd-9e6d-fe623067cd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:14.370717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 808/1618] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:14.371361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a08da8-1bb7-46dd-9e6d-fe623067cd0d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:14.426751 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 811/1619] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:14 2022] PUT /identity/v3/projects/f8e9820b17de4731a880415d5bca6f72/users/956c2e68acb344f2be9b9e9cbcab9f69/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:14.428853 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f637e-d395-44d6-8224-c215e50a9463 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:14.448046 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a08da8-1bb7-46dd-9e6d-fe623067cd0d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:14.513620 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f637e-d395-44d6-8224-c215e50a9463 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:14.518967 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de179b-ff2a-4da4-a7a8-6b2bf68a2b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:14.520543 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de179b-ff2a-4da4-a7a8-6b2bf68a2b39 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:14.520834 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de179b-ff2a-4da4-a7a8-6b2bf68a2b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:14.525334 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de179b-ff2a-4da4-a7a8-6b2bf68a2b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:14.525462 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7607ce-1350-4486-9c39-fa39b2330ca3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:14.525462 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7607ce-1350-4486-9c39-fa39b2330ca3 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:14.525462 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7607ce-1350-4486-9c39-fa39b2330ca3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:14.525714 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7607ce-1350-4486-9c39-fa39b2330ca3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:14.577072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:14.606422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de179b-ff2a-4da4-a7a8-6b2bf68a2b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:14.607882 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7607ce-1350-4486-9c39-fa39b2330ca3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:14.608454 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de179b-ff2a-4da4-a7a8-6b2bf68a2b39 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:14.609397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7607ce-1350-4486-9c39-fa39b2330ca3 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:14.619485 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 812/1620] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:14.621769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 809/1621] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:14.635204 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de179b-ff2a-4da4-a7a8-6b2bf68a2b39 service neutron] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:14.635381 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7607ce-1350-4486-9c39-fa39b2330ca3 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:14.635481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-45de179b-ff2a-4da4-a7a8-6b2bf68a2b39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:14.640997 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7607ce-1350-4486-9c39-fa39b2330ca3 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:14.642364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de179b-ff2a-4da4-a7a8-6b2bf68a2b39 service neutron] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:14.646473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd7504-7e70-4108-95b1-706121fb7932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:14.647110 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd7504-7e70-4108-95b1-706121fb7932 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:14.647340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d5be4-0a6c-4bf2-9ecc-d5f95b95e1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:14.647564 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd7504-7e70-4108-95b1-706121fb7932 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:14.647664 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd7504-7e70-4108-95b1-706121fb7932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:14.647973 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d5be4-0a6c-4bf2-9ecc-d5f95b95e1ed admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:14.648257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d5be4-0a6c-4bf2-9ecc-d5f95b95e1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:14.648600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d5be4-0a6c-4bf2-9ecc-d5f95b95e1ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:14.649221 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d5be4-0a6c-4bf2-9ecc-d5f95b95e1ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:14.651125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d5be4-0a6c-4bf2-9ecc-d5f95b95e1ed admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:14.659144 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd7504-7e70-4108-95b1-706121fb7932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:14.661246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd7504-7e70-4108-95b1-706121fb7932 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:14.672126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 813/1622] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:14.672992 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd7504-7e70-4108-95b1-706121fb7932 service neutron] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:14.681205 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd7504-7e70-4108-95b1-706121fb7932 service neutron] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:14.686023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d711287-7c06-4131-8916-4d7610384c80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:14.686756 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d711287-7c06-4131-8916-4d7610384c80 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:14.687106 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d711287-7c06-4131-8916-4d7610384c80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:14.687475 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d711287-7c06-4131-8916-4d7610384c80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:14.698308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d711287-7c06-4131-8916-4d7610384c80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:14.699898 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d711287-7c06-4131-8916-4d7610384c80 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:14.710810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 814/1623] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:14.711755 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d711287-7c06-4131-8916-4d7610384c80 service neutron] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:14.722035 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d711287-7c06-4131-8916-4d7610384c80 service neutron] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:14.727554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6d437-2133-4d50-be05-69060ecd2470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:14.728196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6d437-2133-4d50-be05-69060ecd2470 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:14.728479 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6d437-2133-4d50-be05-69060ecd2470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:14.728752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6d437-2133-4d50-be05-69060ecd2470 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:14.729452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6d437-2133-4d50-be05-69060ecd2470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:14.731111 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6d437-2133-4d50-be05-69060ecd2470 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:14.743312 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 815/1624] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:14.745044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaba21a-fff1-40e5-b9dd-b198aa97ed37 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:14.745239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaba21a-fff1-40e5-b9dd-b198aa97ed37 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:14.745613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaba21a-fff1-40e5-b9dd-b198aa97ed37 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:14.747508 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 816/1625] 10.222.0.65 () {54 vars in 912 bytes} [Wed Jul 27 18:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:45:14.748425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaba21a-fff1-40e5-b9dd-b198aa97ed37 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:14.770815 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaba21a-fff1-40e5-b9dd-b198aa97ed37 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:14.776169 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ea5c9-27ee-4041-bd3e-971b37f0ad38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:14.776934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ea5c9-27ee-4041-bd3e-971b37f0ad38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:14.777424 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ea5c9-27ee-4041-bd3e-971b37f0ad38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:14.777780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ea5c9-27ee-4041-bd3e-971b37f0ad38 admin admin] PATH_INFO: `/v3/projects/f8e9820b17de4731a880415d5bca6f72/users/956c2e68acb344f2be9b9e9cbcab9f69/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:14.779870 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ea5c9-27ee-4041-bd3e-971b37f0ad38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8e9820b17de4731a880415d5bca6f72, user_id=956c2e68acb344f2be9b9e9cbcab9f69, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:14.783060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ea5c9-27ee-4041-bd3e-971b37f0ad38 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:14.795886 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 817/1626] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:14 2022] PUT /identity/v3/projects/f8e9820b17de4731a880415d5bca6f72/users/956c2e68acb344f2be9b9e9cbcab9f69/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:14.797712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0a228-2c70-43c1-beed-6b9ce26e2a0b None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:14.798200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0a228-2c70-43c1-beed-6b9ce26e2a0b None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:14.798717 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0a228-2c70-43c1-beed-6b9ce26e2a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:14.815933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 810/1627] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:14 2022] POST /identity/v3/projects => generated 373 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:14.817282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1963d1-112e-4605-9864-50f5023e2354 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:14.817577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1963d1-112e-4605-9864-50f5023e2354 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:14.818135 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1963d1-112e-4605-9864-50f5023e2354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:14.826160 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-adb0a228-2c70-43c1-beed-6b9ce26e2a0b None None] MFA Rules not processed for user `be769d4dd016466f9174e7d5e47a2a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:14.832752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-adb0a228-2c70-43c1-beed-6b9ce26e2a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:14.911227 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-1a1963d1-112e-4605-9864-50f5023e2354 None None] MFA Rules not processed for user `956c2e68acb344f2be9b9e9cbcab9f69`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:14.913371 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1a1963d1-112e-4605-9864-50f5023e2354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:14.918272 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:14.951110 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 818/1628] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 18:45:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:14.952460 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0a228-2c70-43c1-beed-6b9ce26e2a0b None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:15.035996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 811/1629] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:15.039422 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1963d1-112e-4605-9864-50f5023e2354 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:15.066480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0a228-2c70-43c1-beed-6b9ce26e2a0b None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:15.074792 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1c03e-b3b1-4b14-81bf-ad558bdc51ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:15.075604 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1c03e-b3b1-4b14-81bf-ad558bdc51ff admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:15.075948 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1c03e-b3b1-4b14-81bf-ad558bdc51ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:15.076370 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1c03e-b3b1-4b14-81bf-ad558bdc51ff admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:15.077223 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1c03e-b3b1-4b14-81bf-ad558bdc51ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:15.080579 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1c03e-b3b1-4b14-81bf-ad558bdc51ff admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:15.182652 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1963d1-112e-4605-9864-50f5023e2354 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:15.191551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 819/1630] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:14 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:15.191872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5499266-4646-4bb7-b58a-201c50630195 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:15.191872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5499266-4646-4bb7-b58a-201c50630195 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:15.191872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5499266-4646-4bb7-b58a-201c50630195 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:15.191872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5499266-4646-4bb7-b58a-201c50630195 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:15.193991 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1c03e-b3b1-4b14-81bf-ad558bdc51ff admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:15.203841 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:15.204923 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5499266-4646-4bb7-b58a-201c50630195 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:15.208976 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5499266-4646-4bb7-b58a-201c50630195 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:15.209322 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1c03e-b3b1-4b14-81bf-ad558bdc51ff admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:15.219654 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1bc96-947e-49ad-a44d-bf62883f2360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:15.220399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1bc96-947e-49ad-a44d-bf62883f2360 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:15.220792 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1bc96-947e-49ad-a44d-bf62883f2360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:15.221163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1bc96-947e-49ad-a44d-bf62883f2360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:15.221946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1bc96-947e-49ad-a44d-bf62883f2360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:15.222216 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 812/1631] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:15.224858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1bc96-947e-49ad-a44d-bf62883f2360 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:15.240658 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 820/1632] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:15.245317 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5499266-4646-4bb7-b58a-201c50630195 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:15.271222 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5499266-4646-4bb7-b58a-201c50630195 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:15.278865 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a75cec-fc09-4b71-9da1-551a45eeddc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:15.280041 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a75cec-fc09-4b71-9da1-551a45eeddc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:15.280718 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a75cec-fc09-4b71-9da1-551a45eeddc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:15.281206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a75cec-fc09-4b71-9da1-551a45eeddc9 admin admin] PATH_INFO: `/v3/projects/561cc95a06f5425b8aaaa1685c9277a3/users/a20fe951f46c488a84eff12c74d05515/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:15.310872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a75cec-fc09-4b71-9da1-551a45eeddc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=561cc95a06f5425b8aaaa1685c9277a3, user_id=a20fe951f46c488a84eff12c74d05515, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:15.318771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a75cec-fc09-4b71-9da1-551a45eeddc9 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:15.454299 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1bc96-947e-49ad-a44d-bf62883f2360 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:15.454860 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 813/1633] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:15 2022] PUT /identity/v3/projects/561cc95a06f5425b8aaaa1685c9277a3/users/a20fe951f46c488a84eff12c74d05515/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:15.466844 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1bc96-947e-49ad-a44d-bf62883f2360 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:15.614747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a4e18-4ff0-4ea7-9de2-0b2cb0da3f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:15.615496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a4e18-4ff0-4ea7-9de2-0b2cb0da3f0e admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:15.615948 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a4e18-4ff0-4ea7-9de2-0b2cb0da3f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:15.616235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a4e18-4ff0-4ea7-9de2-0b2cb0da3f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:15.616978 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a4e18-4ff0-4ea7-9de2-0b2cb0da3f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:15.618765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a4e18-4ff0-4ea7-9de2-0b2cb0da3f0e admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:15.631849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 821/1634] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:15.636134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a75cec-fc09-4b71-9da1-551a45eeddc9 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:15.652237 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a75cec-fc09-4b71-9da1-551a45eeddc9 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:15.658173 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ecbe3-b78b-4332-87c9-7fa192b3b2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:15.658960 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecbe3-b78b-4332-87c9-7fa192b3b2df admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:15.659348 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecbe3-b78b-4332-87c9-7fa192b3b2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:15.659701 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecbe3-b78b-4332-87c9-7fa192b3b2df admin admin] PATH_INFO: `/v3/projects/561cc95a06f5425b8aaaa1685c9277a3/users/a20fe951f46c488a84eff12c74d05515/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:15.672709 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ecbe3-b78b-4332-87c9-7fa192b3b2df admin admin] RBAC: Authorizing `identity:create_grant(project_id=561cc95a06f5425b8aaaa1685c9277a3, user_id=a20fe951f46c488a84eff12c74d05515, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:15.676063 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ecbe3-b78b-4332-87c9-7fa192b3b2df admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:15.709053 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 814/1635] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:15 2022] PUT /identity/v3/projects/561cc95a06f5425b8aaaa1685c9277a3/users/a20fe951f46c488a84eff12c74d05515/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:15.713112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314689d-7b94-4243-8149-d70d5924e282 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:15.713408 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314689d-7b94-4243-8149-d70d5924e282 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:15.713698 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314689d-7b94-4243-8149-d70d5924e282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:15.749024 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-3314689d-7b94-4243-8149-d70d5924e282 None None] MFA Rules not processed for user `a20fe951f46c488a84eff12c74d05515`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:15.750417 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-3314689d-7b94-4243-8149-d70d5924e282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:15.841560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 822/1636] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:15.915751 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ecbe3-b78b-4332-87c9-7fa192b3b2df admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:15.987484 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ecbe3-b78b-4332-87c9-7fa192b3b2df admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:15.992603 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42b934-b5ad-415b-bc1c-eba61f7c2bd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:15.993469 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42b934-b5ad-415b-bc1c-eba61f7c2bd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:15.993931 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42b934-b5ad-415b-bc1c-eba61f7c2bd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:15.994560 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42b934-b5ad-415b-bc1c-eba61f7c2bd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:16.041636 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:16.132325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42b934-b5ad-415b-bc1c-eba61f7c2bd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:16.136207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42b934-b5ad-415b-bc1c-eba61f7c2bd9 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:16.148007 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 815/1637] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:15 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:16.270271 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314689d-7b94-4243-8149-d70d5924e282 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:16.281320 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314689d-7b94-4243-8149-d70d5924e282 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:16.286117 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4db5aa-12b7-4106-8403-54601ab68246 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:16.286754 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4db5aa-12b7-4106-8403-54601ab68246 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:16.287049 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4db5aa-12b7-4106-8403-54601ab68246 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:16.287356 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4db5aa-12b7-4106-8403-54601ab68246 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:16.300881 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4db5aa-12b7-4106-8403-54601ab68246 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:16.302217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4db5aa-12b7-4106-8403-54601ab68246 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:16.313351 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 823/1638] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:16.576674 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42b934-b5ad-415b-bc1c-eba61f7c2bd9 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:16.949547 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42b934-b5ad-415b-bc1c-eba61f7c2bd9 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:16.949547 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea01d7-9dcf-4cb0-ac90-f38c9329e3a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:16.949547 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea01d7-9dcf-4cb0-ac90-f38c9329e3a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:16.949547 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea01d7-9dcf-4cb0-ac90-f38c9329e3a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:16.951946 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea01d7-9dcf-4cb0-ac90-f38c9329e3a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:16.951946 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea01d7-9dcf-4cb0-ac90-f38c9329e3a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:16.951946 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea01d7-9dcf-4cb0-ac90-f38c9329e3a6 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:16.951946 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 816/1639] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:16 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:16.954953 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314b467-4d92-4a49-a3f2-b7cfed400520 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:16.954953 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314b467-4d92-4a49-a3f2-b7cfed400520 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:16.954953 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314b467-4d92-4a49-a3f2-b7cfed400520 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:16.954953 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 824/1640] 10.222.0.65 () {54 vars in 962 bytes} [Wed Jul 27 18:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:45:16.958802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17a903-d7c1-4322-996c-5f7a9a7a8cc6 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:16.958802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17a903-d7c1-4322-996c-5f7a9a7a8cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:16.958802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17a903-d7c1-4322-996c-5f7a9a7a8cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:16.999024 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-6b17a903-d7c1-4322-996c-5f7a9a7a8cc6 None None] MFA Rules not processed for user `be769d4dd016466f9174e7d5e47a2a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:17.000210 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6b17a903-d7c1-4322-996c-5f7a9a7a8cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:17.104994 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 817/1641] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Jul 27 18:45:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:17.114639 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b221d-7a13-4be9-985b-297df982140f None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:17.115170 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b221d-7a13-4be9-985b-297df982140f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:17.115646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b221d-7a13-4be9-985b-297df982140f None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:17.118446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 825/1642] 10.222.0.65 () {54 vars in 912 bytes} [Wed Jul 27 18:45:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:45:17.124618 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd43b39-efc8-43ce-a00c-28f235acd051 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:17.125114 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd43b39-efc8-43ce-a00c-28f235acd051 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:17.126506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd43b39-efc8-43ce-a00c-28f235acd051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:17.162461 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-1bd43b39-efc8-43ce-a00c-28f235acd051 None None] MFA Rules not processed for user `be769d4dd016466f9174e7d5e47a2a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:17.163925 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1bd43b39-efc8-43ce-a00c-28f235acd051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:17.179598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 818/1643] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 18:45:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:17.255947 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b221d-7a13-4be9-985b-297df982140f None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:17.267742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b221d-7a13-4be9-985b-297df982140f None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:17.271615 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d2e7e-27ea-40aa-a84a-d0b4aaa086b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:17.272542 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d2e7e-27ea-40aa-a84a-d0b4aaa086b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:17.272832 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d2e7e-27ea-40aa-a84a-d0b4aaa086b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:17.273136 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d2e7e-27ea-40aa-a84a-d0b4aaa086b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:17.286996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d2e7e-27ea-40aa-a84a-d0b4aaa086b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:17.288569 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d2e7e-27ea-40aa-a84a-d0b4aaa086b2 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:17.302815 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 826/1644] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:18.034679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd43b39-efc8-43ce-a00c-28f235acd051 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:18.093628 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:18.123439 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd43b39-efc8-43ce-a00c-28f235acd051 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:18.129311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1a955-cc25-4386-a0d0-1fad02c7a2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:18.130215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1a955-cc25-4386-a0d0-1fad02c7a2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:18.131250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1a955-cc25-4386-a0d0-1fad02c7a2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:18.131770 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1a955-cc25-4386-a0d0-1fad02c7a2e6 admin admin] PATH_INFO: `/v3/users/dd70947488cd4ee6b9eff3ea33ab6778` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:18.133570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1a955-cc25-4386-a0d0-1fad02c7a2e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd70947488cd4ee6b9eff3ea33ab6778)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:18.136493 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1a955-cc25-4386-a0d0-1fad02c7a2e6 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:18.405657 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-efc1a955-cc25-4386-a0d0-1fad02c7a2e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd70947488cd4ee6b9eff3ea33ab6778'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:18.406653 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-efc1a955-cc25-4386-a0d0-1fad02c7a2e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd70947488cd4ee6b9eff3ea33ab6778'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:18.514340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-efc1a955-cc25-4386-a0d0-1fad02c7a2e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd70947488cd4ee6b9eff3ea33ab6778'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:18.542219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-efc1a955-cc25-4386-a0d0-1fad02c7a2e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd70947488cd4ee6b9eff3ea33ab6778'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:18.543375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-efc1a955-cc25-4386-a0d0-1fad02c7a2e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd70947488cd4ee6b9eff3ea33ab6778'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:18.604537 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 819/1645] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:45:18 2022] DELETE /identity/v3/users/dd70947488cd4ee6b9eff3ea33ab6778 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:18.612237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb92464-ff43-4cac-87f8-e506ddfffb6f None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:18.612807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb92464-ff43-4cac-87f8-e506ddfffb6f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:18.612807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb92464-ff43-4cac-87f8-e506ddfffb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:18.661001 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-fbb92464-ff43-4cac-87f8-e506ddfffb6f None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:18.663960 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-fbb92464-ff43-4cac-87f8-e506ddfffb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:18.762127 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:18.796351 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 827/1646] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:18.803025 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1a955-cc25-4386-a0d0-1fad02c7a2e6 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:18.805063 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-efc1a955-cc25-4386-a0d0-1fad02c7a2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:18.918610 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1a955-cc25-4386-a0d0-1fad02c7a2e6 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:18.935078 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b69db-7b20-4aab-8014-4c78ec46ca80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:18.936378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b69db-7b20-4aab-8014-4c78ec46ca80 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:18.936488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b69db-7b20-4aab-8014-4c78ec46ca80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:18.936730 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b69db-7b20-4aab-8014-4c78ec46ca80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:18.950296 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b69db-7b20-4aab-8014-4c78ec46ca80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:18.951839 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b69db-7b20-4aab-8014-4c78ec46ca80 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:18.983889 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 820/1647] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:20.206935 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb92464-ff43-4cac-87f8-e506ddfffb6f None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:20.209318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-fbb92464-ff43-4cac-87f8-e506ddfffb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:20.238412 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb92464-ff43-4cac-87f8-e506ddfffb6f None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:20.254354 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c12f1f-80d6-4244-8002-8f83aeaeaffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:20.255753 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c12f1f-80d6-4244-8002-8f83aeaeaffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:20.256941 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c12f1f-80d6-4244-8002-8f83aeaeaffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:20.258666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c12f1f-80d6-4244-8002-8f83aeaeaffa admin admin] PATH_INFO: `/v3/projects/707bc345a1f04fcfadaba7d722544a36` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:20.262751 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c12f1f-80d6-4244-8002-8f83aeaeaffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=707bc345a1f04fcfadaba7d722544a36)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:20.268545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c12f1f-80d6-4244-8002-8f83aeaeaffa admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:20.491832 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-b6c12f1f-80d6-4244-8002-8f83aeaeaffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '707bc345a1f04fcfadaba7d722544a36', 'request_id': 'req-b6c12f1f-80d6-4244-8002-8f83aeaeaffa'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:20.508938 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-b6c12f1f-80d6-4244-8002-8f83aeaeaffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '707bc345a1f04fcfadaba7d722544a36', 'request_id': 'req-b6c12f1f-80d6-4244-8002-8f83aeaeaffa'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:20.622782 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-b6c12f1f-80d6-4244-8002-8f83aeaeaffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '707bc345a1f04fcfadaba7d722544a36', 'request_id': 'req-b6c12f1f-80d6-4244-8002-8f83aeaeaffa'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:20.681418 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-b6c12f1f-80d6-4244-8002-8f83aeaeaffa admin admin] The token cache is being invalidate because project 707bc345a1f04fcfadaba7d722544a36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:45:20.681802 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-b6c12f1f-80d6-4244-8002-8f83aeaeaffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:20.683330 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-b6c12f1f-80d6-4244-8002-8f83aeaeaffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:20.688857 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 828/1648] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:45:20 2022] DELETE /identity/v3/projects/707bc345a1f04fcfadaba7d722544a36 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:20.692463 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b69db-7b20-4aab-8014-4c78ec46ca80 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:20.725734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b69db-7b20-4aab-8014-4c78ec46ca80 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:20.924529 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4879b-8bee-44b5-ab93-c5c97476e457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:20.926305 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4879b-8bee-44b5-ab93-c5c97476e457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:20.928236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4879b-8bee-44b5-ab93-c5c97476e457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:20.928850 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4879b-8bee-44b5-ab93-c5c97476e457 admin admin] PATH_INFO: `/v3/users/a20fe951f46c488a84eff12c74d05515` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:20.932849 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4879b-8bee-44b5-ab93-c5c97476e457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a20fe951f46c488a84eff12c74d05515)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:20.942032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4879b-8bee-44b5-ab93-c5c97476e457 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:20.946605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:21.327230 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4ee4879b-8bee-44b5-ab93-c5c97476e457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a20fe951f46c488a84eff12c74d05515'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:21.329559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4ee4879b-8bee-44b5-ab93-c5c97476e457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a20fe951f46c488a84eff12c74d05515'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:21.437034 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4ee4879b-8bee-44b5-ab93-c5c97476e457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a20fe951f46c488a84eff12c74d05515'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:21.482323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4ee4879b-8bee-44b5-ab93-c5c97476e457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a20fe951f46c488a84eff12c74d05515'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:21.483425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4ee4879b-8bee-44b5-ab93-c5c97476e457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a20fe951f46c488a84eff12c74d05515'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:21.512648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 821/1649] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:45:20 2022] DELETE /identity/v3/users/a20fe951f46c488a84eff12c74d05515 => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:45:24.123700 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c12f1f-80d6-4244-8002-8f83aeaeaffa admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:24.126511 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b6c12f1f-80d6-4244-8002-8f83aeaeaffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:24.189563 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c12f1f-80d6-4244-8002-8f83aeaeaffa admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:24.424188 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dedb10-6355-48a6-a6f7-2fc4b02ee933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:24.424942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dedb10-6355-48a6-a6f7-2fc4b02ee933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:24.425335 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dedb10-6355-48a6-a6f7-2fc4b02ee933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:24.425715 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dedb10-6355-48a6-a6f7-2fc4b02ee933 admin admin] PATH_INFO: `/v3/projects/561cc95a06f5425b8aaaa1685c9277a3` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:24.428548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dedb10-6355-48a6-a6f7-2fc4b02ee933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=561cc95a06f5425b8aaaa1685c9277a3)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:24.442876 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dedb10-6355-48a6-a6f7-2fc4b02ee933 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:24.755618 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-85dedb10-6355-48a6-a6f7-2fc4b02ee933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561cc95a06f5425b8aaaa1685c9277a3', 'request_id': 'req-85dedb10-6355-48a6-a6f7-2fc4b02ee933'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:24.784092 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-85dedb10-6355-48a6-a6f7-2fc4b02ee933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561cc95a06f5425b8aaaa1685c9277a3', 'request_id': 'req-85dedb10-6355-48a6-a6f7-2fc4b02ee933'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:24.833405 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4879b-8bee-44b5-ab93-c5c97476e457 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:24.835820 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4ee4879b-8bee-44b5-ab93-c5c97476e457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:24.871136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4879b-8bee-44b5-ab93-c5c97476e457 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:24.925004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-85dedb10-6355-48a6-a6f7-2fc4b02ee933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561cc95a06f5425b8aaaa1685c9277a3', 'request_id': 'req-85dedb10-6355-48a6-a6f7-2fc4b02ee933'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:24.950256 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-85dedb10-6355-48a6-a6f7-2fc4b02ee933 admin admin] The token cache is being invalidate because project 561cc95a06f5425b8aaaa1685c9277a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:45:24.951539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-85dedb10-6355-48a6-a6f7-2fc4b02ee933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:24.955198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-85dedb10-6355-48a6-a6f7-2fc4b02ee933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:24.963143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 829/1650] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:45:24 2022] DELETE /identity/v3/projects/561cc95a06f5425b8aaaa1685c9277a3 => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:24.968800 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6f9af-fc63-4ed1-91df-1121cfc1ec24 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:24.969525 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6f9af-fc63-4ed1-91df-1121cfc1ec24 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:24.970029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6f9af-fc63-4ed1-91df-1121cfc1ec24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:25.001517 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:25.041910 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-64b6f9af-fc63-4ed1-91df-1121cfc1ec24 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:25.049626 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-64b6f9af-fc63-4ed1-91df-1121cfc1ec24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:25.102761 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd5dc1-9826-40bc-8a34-d4b6e35bd195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:25.103795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd5dc1-9826-40bc-8a34-d4b6e35bd195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:25.105005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd5dc1-9826-40bc-8a34-d4b6e35bd195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:25.105534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd5dc1-9826-40bc-8a34-d4b6e35bd195 admin admin] PATH_INFO: `/v3/users/b0f74e526a8d4325bd01a951a8f4c1ad` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:25.112828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd5dc1-9826-40bc-8a34-d4b6e35bd195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f74e526a8d4325bd01a951a8f4c1ad)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:25.115386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd5dc1-9826-40bc-8a34-d4b6e35bd195 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:25.236022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 830/1651] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:25.245644 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d489a3-b638-497a-98fe-3b58fd9f5379 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:25.246084 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d489a3-b638-497a-98fe-3b58fd9f5379 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:25.246565 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d489a3-b638-497a-98fe-3b58fd9f5379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:25.295812 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-a5d489a3-b638-497a-98fe-3b58fd9f5379 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:25.302244 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a5d489a3-b638-497a-98fe-3b58fd9f5379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:25.320621 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 831/1652] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:45:25.324614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d489a3-b638-497a-98fe-3b58fd9f5379 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:25.336428 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d489a3-b638-497a-98fe-3b58fd9f5379 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:25.348373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be26a7-c805-4b49-8776-7c16a8289981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:25.349722 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be26a7-c805-4b49-8776-7c16a8289981 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:25.350800 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be26a7-c805-4b49-8776-7c16a8289981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:25.352882 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be26a7-c805-4b49-8776-7c16a8289981 admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:25.352882 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be26a7-c805-4b49-8776-7c16a8289981 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:45:25.352882 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be26a7-c805-4b49-8776-7c16a8289981 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:25.355646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be26a7-c805-4b49-8776-7c16a8289981 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:25.373476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 832/1653] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:45:25.378488 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be26a7-c805-4b49-8776-7c16a8289981 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:25.378744 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-36bd5dc1-9826-40bc-8a34-d4b6e35bd195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f74e526a8d4325bd01a951a8f4c1ad'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:25.381512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-36bd5dc1-9826-40bc-8a34-d4b6e35bd195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f74e526a8d4325bd01a951a8f4c1ad'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:25.404334 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be26a7-c805-4b49-8776-7c16a8289981 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:25.417909 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068807f-6cd8-4341-b7ab-f788e585f085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:25.418566 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068807f-6cd8-4341-b7ab-f788e585f085 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:25.418911 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068807f-6cd8-4341-b7ab-f788e585f085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:25.419201 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068807f-6cd8-4341-b7ab-f788e585f085 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:25.420119 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2068807f-6cd8-4341-b7ab-f788e585f085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:25.424797 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2068807f-6cd8-4341-b7ab-f788e585f085 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:25.471807 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-36bd5dc1-9826-40bc-8a34-d4b6e35bd195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f74e526a8d4325bd01a951a8f4c1ad'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:25.496113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-36bd5dc1-9826-40bc-8a34-d4b6e35bd195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f74e526a8d4325bd01a951a8f4c1ad'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:25.497229 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-36bd5dc1-9826-40bc-8a34-d4b6e35bd195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f74e526a8d4325bd01a951a8f4c1ad'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:25.553244 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 833/1654] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:25 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:25.557424 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068807f-6cd8-4341-b7ab-f788e585f085 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:25.558973 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:25.566404 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2068807f-6cd8-4341-b7ab-f788e585f085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:25.577391 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 822/1655] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:45:24 2022] DELETE /identity/v3/users/b0f74e526a8d4325bd01a951a8f4c1ad => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:25.583060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdfef6-fe4f-4c70-a492-24af5024695b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:25.584682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdfef6-fe4f-4c70-a492-24af5024695b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:25.585148 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdfef6-fe4f-4c70-a492-24af5024695b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:25.648823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-d3bdfef6-fe4f-4c70-a492-24af5024695b None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:25.651366 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d3bdfef6-fe4f-4c70-a492-24af5024695b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:25.779960 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068807f-6cd8-4341-b7ab-f788e585f085 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:25.835971 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 823/1656] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:25.895927 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdfef6-fe4f-4c70-a492-24af5024695b None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:25.897662 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d3bdfef6-fe4f-4c70-a492-24af5024695b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:25.933120 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd556b-ea9f-4c6a-8690-bc428576afef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:25.935319 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd556b-ea9f-4c6a-8690-bc428576afef admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:25.936161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd556b-ea9f-4c6a-8690-bc428576afef admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:25.937920 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd556b-ea9f-4c6a-8690-bc428576afef admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:25.938826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd556b-ea9f-4c6a-8690-bc428576afef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:25.959355 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd556b-ea9f-4c6a-8690-bc428576afef admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:26.040659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdfef6-fe4f-4c70-a492-24af5024695b None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:26.046758 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b73c3-5ca0-411a-98ff-0830019baccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:26.047625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b73c3-5ca0-411a-98ff-0830019baccf service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:26.047906 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b73c3-5ca0-411a-98ff-0830019baccf service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:26.048182 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b73c3-5ca0-411a-98ff-0830019baccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:26.073609 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b73c3-5ca0-411a-98ff-0830019baccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:26.082379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b73c3-5ca0-411a-98ff-0830019baccf service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:26.089527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 834/1657] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:25 2022] POST /identity/v3/users => generated 292 bytes in 532 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:26.096436 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd556b-ea9f-4c6a-8690-bc428576afef admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:26.116159 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 824/1658] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:45:26.125691 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd556b-ea9f-4c6a-8690-bc428576afef admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:26.136375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fbee2-4eed-47f4-958c-068110a57f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:26.144491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fbee2-4eed-47f4-958c-068110a57f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:26.145103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fbee2-4eed-47f4-958c-068110a57f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:26.145529 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fbee2-4eed-47f4-958c-068110a57f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:26.146404 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fbee2-4eed-47f4-958c-068110a57f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:26.148477 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fbee2-4eed-47f4-958c-068110a57f6b admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:26.168246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 835/1659] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:26.172068 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b73c3-5ca0-411a-98ff-0830019baccf service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:26.183712 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b73c3-5ca0-411a-98ff-0830019baccf service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:26.192279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe43940-b2a3-49ab-8b9b-55d9ade49aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:26.192279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe43940-b2a3-49ab-8b9b-55d9ade49aab admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:26.192279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe43940-b2a3-49ab-8b9b-55d9ade49aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:26.192279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe43940-b2a3-49ab-8b9b-55d9ade49aab admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:26.193351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe43940-b2a3-49ab-8b9b-55d9ade49aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:26.195731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe43940-b2a3-49ab-8b9b-55d9ade49aab admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:26.221121 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 825/1660] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:26.225127 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fbee2-4eed-47f4-958c-068110a57f6b admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:26.241993 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fbee2-4eed-47f4-958c-068110a57f6b admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:26.254136 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dedac1-6357-4bea-bf97-16167f57186d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:26.254872 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dedac1-6357-4bea-bf97-16167f57186d admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:26.260504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dedac1-6357-4bea-bf97-16167f57186d admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:26.260799 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dedac1-6357-4bea-bf97-16167f57186d admin admin] PATH_INFO: `/v3/projects/d816e21ffa944ca28ce5f228b4210422/users/f352a6f14c0f4975a017d37f92578940/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:26.299622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dedac1-6357-4bea-bf97-16167f57186d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d816e21ffa944ca28ce5f228b4210422, user_id=f352a6f14c0f4975a017d37f92578940, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:26.303368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dedac1-6357-4bea-bf97-16167f57186d admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:26.417323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 836/1661] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:26 2022] PUT /identity/v3/projects/d816e21ffa944ca28ce5f228b4210422/users/f352a6f14c0f4975a017d37f92578940/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:26.428849 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718ae32-8efb-4740-b24d-b8d7477168c7 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:26.429138 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718ae32-8efb-4740-b24d-b8d7477168c7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:26.429421 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718ae32-8efb-4740-b24d-b8d7477168c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:26.493601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-e718ae32-8efb-4740-b24d-b8d7477168c7 None None] MFA Rules not processed for user `f352a6f14c0f4975a017d37f92578940`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:26.494878 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e718ae32-8efb-4740-b24d-b8d7477168c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:26.680777 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 826/1662] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:26.685145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dedac1-6357-4bea-bf97-16167f57186d admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:26.792745 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dedac1-6357-4bea-bf97-16167f57186d admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:26.799522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4d8e9-c4b8-41cb-b3ca-013135e529ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:26.800413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4d8e9-c4b8-41cb-b3ca-013135e529ae admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:26.801391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4d8e9-c4b8-41cb-b3ca-013135e529ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:26.801391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4d8e9-c4b8-41cb-b3ca-013135e529ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:26.802312 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4d8e9-c4b8-41cb-b3ca-013135e529ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:26.805145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4d8e9-c4b8-41cb-b3ca-013135e529ae admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:26.913419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:26.989596 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718ae32-8efb-4740-b24d-b8d7477168c7 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:27.018382 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 837/1663] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:26 2022] POST /identity/v3/projects => generated 385 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:27.029705 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718ae32-8efb-4740-b24d-b8d7477168c7 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:27.102142 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211c149-f118-454d-805b-e02c6cac1f09 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:27.102142 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211c149-f118-454d-805b-e02c6cac1f09 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:27.102142 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211c149-f118-454d-805b-e02c6cac1f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:27.183256 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-2211c149-f118-454d-805b-e02c6cac1f09 None None] MFA Rules not processed for user `b05240b3f0bf40789d476e4bdad8bea0`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:27.185211 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2211c149-f118-454d-805b-e02c6cac1f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:27.234200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e265855-ad5c-4d3c-8e4f-837c178eb9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:27.235502 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e265855-ad5c-4d3c-8e4f-837c178eb9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:27.237511 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e265855-ad5c-4d3c-8e4f-837c178eb9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:27.238211 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e265855-ad5c-4d3c-8e4f-837c178eb9e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:27.240493 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e265855-ad5c-4d3c-8e4f-837c178eb9e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:27.247107 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e265855-ad5c-4d3c-8e4f-837c178eb9e3 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:27.358953 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 827/1664] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:26 2022] POST /identity/v3/users => generated 299 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:27.361259 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 838/1665] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:45:27.363990 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e265855-ad5c-4d3c-8e4f-837c178eb9e3 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:27.371600 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ddc3c-ccb1-4d63-a185-a5feac33110c None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:27.371925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ddc3c-ccb1-4d63-a185-a5feac33110c None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:27.372165 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ddc3c-ccb1-4d63-a185-a5feac33110c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:27.377231 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e265855-ad5c-4d3c-8e4f-837c178eb9e3 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:27.384598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e79632-467c-423a-98c3-d7651e8f61b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:27.385697 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e79632-467c-423a-98c3-d7651e8f61b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:27.386364 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e79632-467c-423a-98c3-d7651e8f61b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:27.386927 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e79632-467c-423a-98c3-d7651e8f61b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:27.387897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e79632-467c-423a-98c3-d7651e8f61b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:27.389805 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e79632-467c-423a-98c3-d7651e8f61b5 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:27.432212 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 828/1666] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:27.433602 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e79632-467c-423a-98c3-d7651e8f61b5 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:27.436749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f6e79632-467c-423a-98c3-d7651e8f61b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:27.447019 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-443ddc3c-ccb1-4d63-a185-a5feac33110c None None] MFA Rules not processed for user `b05240b3f0bf40789d476e4bdad8bea0`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:27.454553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-443ddc3c-ccb1-4d63-a185-a5feac33110c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:27.481887 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 839/1667] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:27.483461 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ddc3c-ccb1-4d63-a185-a5feac33110c None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:27.489919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e79632-467c-423a-98c3-d7651e8f61b5 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:27.497711 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ddc3c-ccb1-4d63-a185-a5feac33110c None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:27.500087 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692019d-7302-432a-82a1-fd02299bf9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:27.500087 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692019d-7302-432a-82a1-fd02299bf9c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:27.500087 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692019d-7302-432a-82a1-fd02299bf9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:27.501284 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692019d-7302-432a-82a1-fd02299bf9c4 admin admin] PATH_INFO: `/v3/projects/a1da346fa0fb4afdbd3b9605fc276c4b` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:27.507025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4a16c-e996-4dbf-a337-f7720aac734e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:27.507346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692019d-7302-432a-82a1-fd02299bf9c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1da346fa0fb4afdbd3b9605fc276c4b)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:27.507767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4a16c-e996-4dbf-a337-f7720aac734e admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:27.508054 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4a16c-e996-4dbf-a337-f7720aac734e admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:27.508337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4a16c-e996-4dbf-a337-f7720aac734e admin admin] PATH_INFO: `/v3/projects/88970991f2b14188b0cad25ac3abd588/users/10c6abed030346d59758f315d005c361/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:27.510237 dv-cinder-799871-43-smb devstack@keystone.service[80428]: WARNING py.warnings [None req-7692019d-7302-432a-82a1-fd02299bf9c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:45:27.510237 dv-cinder-799871-43-smb devstack@keystone.service[80428]: warnings.warn(msg) Jul 27 18:45:27.510237 dv-cinder-799871-43-smb devstack@keystone.service[80428]: Jul 27 18:45:27.512025 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692019d-7302-432a-82a1-fd02299bf9c4 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:27.554437 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:27.554641 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4a16c-e996-4dbf-a337-f7720aac734e admin admin] RBAC: Authorizing `identity:create_grant(project_id=88970991f2b14188b0cad25ac3abd588, user_id=10c6abed030346d59758f315d005c361, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:27.571857 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4a16c-e996-4dbf-a337-f7720aac734e admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:27.653874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 840/1668] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:27 2022] PUT /identity/v3/projects/88970991f2b14188b0cad25ac3abd588/users/10c6abed030346d59758f315d005c361/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:27.658126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4a16c-e996-4dbf-a337-f7720aac734e admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:27.666506 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ade4a16c-e996-4dbf-a337-f7720aac734e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:27.748749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7692019d-7302-432a-82a1-fd02299bf9c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1da346fa0fb4afdbd3b9605fc276c4b', 'request_id': 'req-7692019d-7302-432a-82a1-fd02299bf9c4'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:27.771680 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7692019d-7302-432a-82a1-fd02299bf9c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1da346fa0fb4afdbd3b9605fc276c4b', 'request_id': 'req-7692019d-7302-432a-82a1-fd02299bf9c4'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:27.871742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4a16c-e996-4dbf-a337-f7720aac734e admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:27.896975 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7692019d-7302-432a-82a1-fd02299bf9c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1da346fa0fb4afdbd3b9605fc276c4b', 'request_id': 'req-7692019d-7302-432a-82a1-fd02299bf9c4'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:27.944429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7692019d-7302-432a-82a1-fd02299bf9c4 admin admin] The token cache is being invalidate because project a1da346fa0fb4afdbd3b9605fc276c4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:45:27.944429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7692019d-7302-432a-82a1-fd02299bf9c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:27.944429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7692019d-7302-432a-82a1-fd02299bf9c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:27.949627 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 829/1669] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:45:27 2022] DELETE /identity/v3/projects/a1da346fa0fb4afdbd3b9605fc276c4b => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:27.949627 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692019d-7302-432a-82a1-fd02299bf9c4 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:27.951336 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7692019d-7302-432a-82a1-fd02299bf9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:28.049148 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ccea6-847d-4fd5-aa99-cc48b06caa1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:28.052234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ccea6-847d-4fd5-aa99-cc48b06caa1a service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:28.052593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ccea6-847d-4fd5-aa99-cc48b06caa1a service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:28.052995 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ccea6-847d-4fd5-aa99-cc48b06caa1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:28.080230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-9b5ccea6-847d-4fd5-aa99-cc48b06caa1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:28.106378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692019d-7302-432a-82a1-fd02299bf9c4 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:28.123368 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f315e-ed2c-4e30-9f3e-667965ddfa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:28.124029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f315e-ed2c-4e30-9f3e-667965ddfa6c admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:28.124315 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f315e-ed2c-4e30-9f3e-667965ddfa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:28.124812 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f315e-ed2c-4e30-9f3e-667965ddfa6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:28.126374 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f315e-ed2c-4e30-9f3e-667965ddfa6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:28.129533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f315e-ed2c-4e30-9f3e-667965ddfa6c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:28.158038 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 830/1670] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:28.159682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5b2d4-58a9-440e-a853-e1559049223b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:28.160214 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5b2d4-58a9-440e-a853-e1559049223b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:28.160639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5b2d4-58a9-440e-a853-e1559049223b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:28.188129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ccea6-847d-4fd5-aa99-cc48b06caa1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:28.190815 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ccea6-847d-4fd5-aa99-cc48b06caa1a service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:28.197325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5ad5b2d4-58a9-440e-a853-e1559049223b None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:28.198627 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5ad5b2d4-58a9-440e-a853-e1559049223b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:28.207524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 841/1671] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:28.208677 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ccea6-847d-4fd5-aa99-cc48b06caa1a service nova] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:28.222370 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ccea6-847d-4fd5-aa99-cc48b06caa1a service nova] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:28.223206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 831/1672] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:28.230028 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ed034-c2f6-41fb-b74b-24d3eff419f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:28.230937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ed034-c2f6-41fb-b74b-24d3eff419f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:28.231376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb023866-6467-4dea-bff7-1fcd3f796201 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:28.231791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb023866-6467-4dea-bff7-1fcd3f796201 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:28.232513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb023866-6467-4dea-bff7-1fcd3f796201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:28.232629 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ed034-c2f6-41fb-b74b-24d3eff419f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:28.233070 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ed034-c2f6-41fb-b74b-24d3eff419f0 admin admin] PATH_INFO: `/v3/projects/88970991f2b14188b0cad25ac3abd588/users/10c6abed030346d59758f315d005c361/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:28.235673 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ed034-c2f6-41fb-b74b-24d3eff419f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88970991f2b14188b0cad25ac3abd588, user_id=10c6abed030346d59758f315d005c361, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:28.239764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ed034-c2f6-41fb-b74b-24d3eff419f0 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:28.254826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 842/1673] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:28 2022] PUT /identity/v3/projects/88970991f2b14188b0cad25ac3abd588/users/10c6abed030346d59758f315d005c361/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:28.266807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9c0c9-61a9-4ffa-83f2-4c8f2e298d25 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:28.269411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9c0c9-61a9-4ffa-83f2-4c8f2e298d25 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:28.269796 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-bb023866-6467-4dea-bff7-1fcd3f796201 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:28.270010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9c0c9-61a9-4ffa-83f2-4c8f2e298d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:28.271417 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-bb023866-6467-4dea-bff7-1fcd3f796201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:28.379711 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-a0f9c0c9-61a9-4ffa-83f2-4c8f2e298d25 None None] MFA Rules not processed for user `10c6abed030346d59758f315d005c361`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:28.384192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a0f9c0c9-61a9-4ffa-83f2-4c8f2e298d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:28.384909 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 832/1674] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:28.385896 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb023866-6467-4dea-bff7-1fcd3f796201 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:28.388601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-bb023866-6467-4dea-bff7-1fcd3f796201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:28.402299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb023866-6467-4dea-bff7-1fcd3f796201 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:28.405377 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:28.412829 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1daeb05-b982-4b4e-9098-397d6c97522a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:28.413503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1daeb05-b982-4b4e-9098-397d6c97522a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:28.421186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1daeb05-b982-4b4e-9098-397d6c97522a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:28.422492 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1daeb05-b982-4b4e-9098-397d6c97522a admin admin] PATH_INFO: `/v3/users/ab4915f0c90f4456aa7ce8ca23617c59` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:28.427747 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1daeb05-b982-4b4e-9098-397d6c97522a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab4915f0c90f4456aa7ce8ca23617c59)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:28.427747 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1daeb05-b982-4b4e-9098-397d6c97522a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:28.582620 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 843/1675] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:45:28.600670 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9c0c9-61a9-4ffa-83f2-4c8f2e298d25 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:28.613995 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9c0c9-61a9-4ffa-83f2-4c8f2e298d25 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:28.620330 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a02449-ac0b-4702-ab63-f95b0a5dee3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:28.623593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a02449-ac0b-4702-ab63-f95b0a5dee3d admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:28.623593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a02449-ac0b-4702-ab63-f95b0a5dee3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:28.623593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a02449-ac0b-4702-ab63-f95b0a5dee3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:28.623593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a02449-ac0b-4702-ab63-f95b0a5dee3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:45:28.623593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a02449-ac0b-4702-ab63-f95b0a5dee3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:28.625360 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a02449-ac0b-4702-ab63-f95b0a5dee3d admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:28.645173 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:28.645921 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 844/1676] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:45:28.647675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a02449-ac0b-4702-ab63-f95b0a5dee3d admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:28.650840 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-d0a02449-ac0b-4702-ab63-f95b0a5dee3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:28.698821 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-f1daeb05-b982-4b4e-9098-397d6c97522a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab4915f0c90f4456aa7ce8ca23617c59'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:28.702631 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-f1daeb05-b982-4b4e-9098-397d6c97522a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab4915f0c90f4456aa7ce8ca23617c59'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:28.794195 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-f1daeb05-b982-4b4e-9098-397d6c97522a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab4915f0c90f4456aa7ce8ca23617c59'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:28.818124 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-f1daeb05-b982-4b4e-9098-397d6c97522a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab4915f0c90f4456aa7ce8ca23617c59'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:28.818977 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-f1daeb05-b982-4b4e-9098-397d6c97522a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab4915f0c90f4456aa7ce8ca23617c59'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:28.827441 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a02449-ac0b-4702-ab63-f95b0a5dee3d admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:28.851003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a807684-0098-4620-9c7c-248eb279f522 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:28.851803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a807684-0098-4620-9c7c-248eb279f522 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:28.852155 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a807684-0098-4620-9c7c-248eb279f522 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:28.852495 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a807684-0098-4620-9c7c-248eb279f522 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:28.859088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-6a807684-0098-4620-9c7c-248eb279f522 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:28.907362 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 833/1677] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:45:28 2022] DELETE /identity/v3/users/ab4915f0c90f4456aa7ce8ca23617c59 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:28.908371 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1daeb05-b982-4b4e-9098-397d6c97522a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:28.916049 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f1daeb05-b982-4b4e-9098-397d6c97522a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:29.080397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1daeb05-b982-4b4e-9098-397d6c97522a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:29.083981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a807684-0098-4620-9c7c-248eb279f522 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:29.086242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb27763-fcb6-472a-b134-7741898697b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:29.086960 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a807684-0098-4620-9c7c-248eb279f522 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:29.095074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb27763-fcb6-472a-b134-7741898697b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:29.095074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb27763-fcb6-472a-b134-7741898697b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:29.095074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb27763-fcb6-472a-b134-7741898697b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:29.095074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb27763-fcb6-472a-b134-7741898697b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:29.100104 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb27763-fcb6-472a-b134-7741898697b1 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:29.110377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 845/1678] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:29.111853 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f806cc0-4a28-4b65-b8cd-a8c3f84a4c4f None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:29.112163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f806cc0-4a28-4b65-b8cd-a8c3f84a4c4f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:29.112431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f806cc0-4a28-4b65-b8cd-a8c3f84a4c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:29.154214 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-9f806cc0-4a28-4b65-b8cd-a8c3f84a4c4f None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:29.155470 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-9f806cc0-4a28-4b65-b8cd-a8c3f84a4c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:29.180841 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 846/1679] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:29.181939 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f806cc0-4a28-4b65-b8cd-a8c3f84a4c4f None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:29.185822 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-9f806cc0-4a28-4b65-b8cd-a8c3f84a4c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:29.213661 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f806cc0-4a28-4b65-b8cd-a8c3f84a4c4f None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:29.223704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec39a99-3651-4753-a721-2d7d21216090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:29.224369 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec39a99-3651-4753-a721-2d7d21216090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:29.224651 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec39a99-3651-4753-a721-2d7d21216090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:29.224927 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec39a99-3651-4753-a721-2d7d21216090 admin admin] PATH_INFO: `/v3/users/dc4d9a6b24314144a7796948b20a00c3` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:29.228030 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec39a99-3651-4753-a721-2d7d21216090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc4d9a6b24314144a7796948b20a00c3)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:29.232349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 834/1680] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:28 2022] POST /identity/v3/projects => generated 403 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:29.238679 dv-cinder-799871-43-smb devstack@keystone.service[80429]: WARNING py.warnings [None req-4ec39a99-3651-4753-a721-2d7d21216090 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:45:29.238679 dv-cinder-799871-43-smb devstack@keystone.service[80429]: warnings.warn(msg) Jul 27 18:45:29.238679 dv-cinder-799871-43-smb devstack@keystone.service[80429]: Jul 27 18:45:29.238679 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec39a99-3651-4753-a721-2d7d21216090 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:29.238931 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb27763-fcb6-472a-b134-7741898697b1 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:29.447046 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb27763-fcb6-472a-b134-7741898697b1 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:29.462459 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629d94b-a9c9-42bf-aa36-858914008894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:29.462901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629d94b-a9c9-42bf-aa36-858914008894 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:29.463192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629d94b-a9c9-42bf-aa36-858914008894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:29.463494 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629d94b-a9c9-42bf-aa36-858914008894 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:29.464600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629d94b-a9c9-42bf-aa36-858914008894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:29.466557 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629d94b-a9c9-42bf-aa36-858914008894 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:29.600387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4ec39a99-3651-4753-a721-2d7d21216090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc4d9a6b24314144a7796948b20a00c3'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:29.601710 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4ec39a99-3651-4753-a721-2d7d21216090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc4d9a6b24314144a7796948b20a00c3'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:29.603998 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 835/1681] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:29 2022] POST /identity/v3/users => generated 302 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:29.605425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629d94b-a9c9-42bf-aa36-858914008894 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:29.607733 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f629d94b-a9c9-42bf-aa36-858914008894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:29.731308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4ec39a99-3651-4753-a721-2d7d21216090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc4d9a6b24314144a7796948b20a00c3'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:29.793176 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629d94b-a9c9-42bf-aa36-858914008894 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:29.801528 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e59b52-15a4-4b7c-93f8-622dfb7d3f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:29.802779 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e59b52-15a4-4b7c-93f8-622dfb7d3f48 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:29.803231 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e59b52-15a4-4b7c-93f8-622dfb7d3f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:29.803543 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e59b52-15a4-4b7c-93f8-622dfb7d3f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:29.804536 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4ec39a99-3651-4753-a721-2d7d21216090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc4d9a6b24314144a7796948b20a00c3'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:29.830212 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e59b52-15a4-4b7c-93f8-622dfb7d3f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:29.831748 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e59b52-15a4-4b7c-93f8-622dfb7d3f48 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:29.842933 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4ec39a99-3651-4753-a721-2d7d21216090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc4d9a6b24314144a7796948b20a00c3'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:29.856848 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 836/1682] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:29.859220 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b08f4-6019-4189-a9b3-a0cb5c9cf487 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:29.860242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b08f4-6019-4189-a9b3-a0cb5c9cf487 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:29.860649 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b08f4-6019-4189-a9b3-a0cb5c9cf487 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:29.861714 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 847/1683] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:45:29 2022] DELETE /identity/v3/users/dc4d9a6b24314144a7796948b20a00c3 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:29.862821 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec39a99-3651-4753-a721-2d7d21216090 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:29.864617 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4ec39a99-3651-4753-a721-2d7d21216090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:29.867638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 837/1684] 10.222.0.65 () {54 vars in 912 bytes} [Wed Jul 27 18:45:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:45:29.869063 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea081e92-84c6-47d1-a5c5-44fa81c2b15b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:29.869307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea081e92-84c6-47d1-a5c5-44fa81c2b15b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:29.869591 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea081e92-84c6-47d1-a5c5-44fa81c2b15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:29.918407 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-ea081e92-84c6-47d1-a5c5-44fa81c2b15b None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:29.920753 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ea081e92-84c6-47d1-a5c5-44fa81c2b15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:29.933049 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:30.048381 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:30.142691 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec39a99-3651-4753-a721-2d7d21216090 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:30.155353 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 838/1685] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:30.158217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be6a06-0442-4df9-9015-b2495edeac22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:30.161489 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be6a06-0442-4df9-9015-b2495edeac22 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:30.161489 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be6a06-0442-4df9-9015-b2495edeac22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:30.163027 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be6a06-0442-4df9-9015-b2495edeac22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:30.163518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1083200-721d-4797-a3df-6d0dcd4a52d2 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:30.164438 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1083200-721d-4797-a3df-6d0dcd4a52d2 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:30.166308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be6a06-0442-4df9-9015-b2495edeac22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:30.166709 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1083200-721d-4797-a3df-6d0dcd4a52d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:30.171452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be6a06-0442-4df9-9015-b2495edeac22 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:30.204617 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 848/1686] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:30.207637 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be6a06-0442-4df9-9015-b2495edeac22 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:30.218390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-29be6a06-0442-4df9-9015-b2495edeac22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:30.261678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c1083200-721d-4797-a3df-6d0dcd4a52d2 None None] MFA Rules not processed for user `ffee4a13d4fd4f86bd1c79b4535a0c55`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:30.263587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c1083200-721d-4797-a3df-6d0dcd4a52d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:30.394517 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be6a06-0442-4df9-9015-b2495edeac22 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:30.404506 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81826f77-4c6e-401e-9a00-2f90885b31fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:30.405173 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81826f77-4c6e-401e-9a00-2f90885b31fd service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:30.405464 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81826f77-4c6e-401e-9a00-2f90885b31fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:30.405746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81826f77-4c6e-401e-9a00-2f90885b31fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:30.433667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81826f77-4c6e-401e-9a00-2f90885b31fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:30.435297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81826f77-4c6e-401e-9a00-2f90885b31fd service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:30.450297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 849/1687] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:30.451525 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81826f77-4c6e-401e-9a00-2f90885b31fd service neutron] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:30.479015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81826f77-4c6e-401e-9a00-2f90885b31fd service neutron] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:30.485601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 839/1688] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 18:45:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:30.526392 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd42b1-dd21-4db8-9c23-c1375fce5da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:30.529834 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd42b1-dd21-4db8-9c23-c1375fce5da5 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:30.530596 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd42b1-dd21-4db8-9c23-c1375fce5da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:30.530888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd42b1-dd21-4db8-9c23-c1375fce5da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:30.534696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd42b1-dd21-4db8-9c23-c1375fce5da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:30.554458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1083200-721d-4797-a3df-6d0dcd4a52d2 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:30.565060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd42b1-dd21-4db8-9c23-c1375fce5da5 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:30.568238 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1083200-721d-4797-a3df-6d0dcd4a52d2 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:30.579359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 850/1689] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:30.585029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c1a96-5156-4958-b0a6-2df2533e0f3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:30.585727 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c1a96-5156-4958-b0a6-2df2533e0f3f service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:30.586011 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c1a96-5156-4958-b0a6-2df2533e0f3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:30.590549 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd42b1-dd21-4db8-9c23-c1375fce5da5 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:30.595569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c1a96-5156-4958-b0a6-2df2533e0f3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:30.615587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd42b1-dd21-4db8-9c23-c1375fce5da5 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:30.623907 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875327fa-4305-45ae-a42f-66507a0a4b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:30.624624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875327fa-4305-45ae-a42f-66507a0a4b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:30.625005 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875327fa-4305-45ae-a42f-66507a0a4b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:30.625799 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875327fa-4305-45ae-a42f-66507a0a4b53 admin admin] PATH_INFO: `/v3/projects/5bed446180d84ed7bfe4a5ed0eb626f5/users/bcb4fa00f6924331ac79c8d13e6cf39c/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:30.647525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c1a96-5156-4958-b0a6-2df2533e0f3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:30.647525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c1a96-5156-4958-b0a6-2df2533e0f3f service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:30.652337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875327fa-4305-45ae-a42f-66507a0a4b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bed446180d84ed7bfe4a5ed0eb626f5, user_id=bcb4fa00f6924331ac79c8d13e6cf39c, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:30.655770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875327fa-4305-45ae-a42f-66507a0a4b53 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:30.682271 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 840/1690] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:45:30.809583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 851/1691] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:30 2022] PUT /identity/v3/projects/5bed446180d84ed7bfe4a5ed0eb626f5/users/bcb4fa00f6924331ac79c8d13e6cf39c/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:30.812216 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dffe51-d32d-49c5-898d-db08d70b7aaf None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:30.812653 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dffe51-d32d-49c5-898d-db08d70b7aaf None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:30.813028 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dffe51-d32d-49c5-898d-db08d70b7aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:30.899417 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-96dffe51-d32d-49c5-898d-db08d70b7aaf None None] MFA Rules not processed for user `bcb4fa00f6924331ac79c8d13e6cf39c`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:30.909378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-96dffe51-d32d-49c5-898d-db08d70b7aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:31.106262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 841/1692] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:31.108358 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea0cd3-b556-4558-8c97-b5e1b23766a6 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:31.109752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea0cd3-b556-4558-8c97-b5e1b23766a6 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:31.112234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea0cd3-b556-4558-8c97-b5e1b23766a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:31.113455 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dffe51-d32d-49c5-898d-db08d70b7aaf None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:31.193445 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:31.194701 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-e3ea0cd3-b556-4558-8c97-b5e1b23766a6 None None] MFA Rules not processed for user `b25caac30f7641f0b0d746ebff0b54b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:31.196383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e3ea0cd3-b556-4558-8c97-b5e1b23766a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:31.356211 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dffe51-d32d-49c5-898d-db08d70b7aaf None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:31.377153 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82f0e4-01d7-4bf2-afdb-567a222031a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:31.377852 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82f0e4-01d7-4bf2-afdb-567a222031a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:31.378142 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82f0e4-01d7-4bf2-afdb-567a222031a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:31.378424 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82f0e4-01d7-4bf2-afdb-567a222031a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:31.379120 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82f0e4-01d7-4bf2-afdb-567a222031a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:31.379658 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 852/1693] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:31.381730 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82f0e4-01d7-4bf2-afdb-567a222031a1 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:31.389413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea0cd3-b556-4558-8c97-b5e1b23766a6 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:31.396951 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e3ea0cd3-b556-4558-8c97-b5e1b23766a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:31.569038 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 842/1694] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:31 2022] POST /identity/v3/projects => generated 403 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:31.580623 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82f0e4-01d7-4bf2-afdb-567a222031a1 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:31.633047 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea0cd3-b556-4558-8c97-b5e1b23766a6 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:31.699033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82f0e4-01d7-4bf2-afdb-567a222031a1 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:31.708410 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f2620-5b30-4f6b-be82-6c5d1662c822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:31.709001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f2620-5b30-4f6b-be82-6c5d1662c822 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:31.709290 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f2620-5b30-4f6b-be82-6c5d1662c822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:31.709574 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f2620-5b30-4f6b-be82-6c5d1662c822 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:31.710357 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f2620-5b30-4f6b-be82-6c5d1662c822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:31.713829 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f2620-5b30-4f6b-be82-6c5d1662c822 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:31.795710 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93fb00-8b64-4bac-bf9c-0bf4fb1fa9f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:31.797930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93fb00-8b64-4bac-bf9c-0bf4fb1fa9f9 service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:31.798381 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93fb00-8b64-4bac-bf9c-0bf4fb1fa9f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:31.801386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93fb00-8b64-4bac-bf9c-0bf4fb1fa9f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:31.817291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 843/1695] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:31 2022] POST /identity/v3/users => generated 308 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:31.821439 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f2620-5b30-4f6b-be82-6c5d1662c822 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:31.869362 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f2620-5b30-4f6b-be82-6c5d1662c822 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:31.886524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3520f6-6a00-44ff-beac-21107fa35f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:31.887177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3520f6-6a00-44ff-beac-21107fa35f89 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:31.887488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3520f6-6a00-44ff-beac-21107fa35f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:31.887769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3520f6-6a00-44ff-beac-21107fa35f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:31.888494 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3520f6-6a00-44ff-beac-21107fa35f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:31.896292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3520f6-6a00-44ff-beac-21107fa35f89 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:31.954948 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 844/1696] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:45:31.956235 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3520f6-6a00-44ff-beac-21107fa35f89 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:31.989411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:32.016655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3520f6-6a00-44ff-beac-21107fa35f89 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:32.062257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061ed26-a4ff-48e6-a1e6-1a90a45f3b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:32.063546 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061ed26-a4ff-48e6-a1e6-1a90a45f3b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:32.068118 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061ed26-a4ff-48e6-a1e6-1a90a45f3b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:32.071819 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061ed26-a4ff-48e6-a1e6-1a90a45f3b79 admin admin] PATH_INFO: `/v3/projects/b233821387fe41c4af77f59a708e58be/users/ad78b0df503a490fb31ff3a74ee06696/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:32.124731 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93fb00-8b64-4bac-bf9c-0bf4fb1fa9f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:32.126997 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93fb00-8b64-4bac-bf9c-0bf4fb1fa9f9 service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:32.144095 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061ed26-a4ff-48e6-a1e6-1a90a45f3b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b233821387fe41c4af77f59a708e58be, user_id=ad78b0df503a490fb31ff3a74ee06696, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:32.147137 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061ed26-a4ff-48e6-a1e6-1a90a45f3b79 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:32.158807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 853/1697] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 770 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:32.233821 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:32.262446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93fb00-8b64-4bac-bf9c-0bf4fb1fa9f9 service nova] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:32.264173 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-cb93fb00-8b64-4bac-bf9c-0bf4fb1fa9f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:32.279386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 845/1698] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:31 2022] PUT /identity/v3/projects/b233821387fe41c4af77f59a708e58be/users/ad78b0df503a490fb31ff3a74ee06696/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:32.284858 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061ed26-a4ff-48e6-a1e6-1a90a45f3b79 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:32.306832 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93fb00-8b64-4bac-bf9c-0bf4fb1fa9f9 service nova] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:32.478084 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061ed26-a4ff-48e6-a1e6-1a90a45f3b79 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:32.480918 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dbfaf-b84f-426d-872d-329a0899c4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:32.482628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dbfaf-b84f-426d-872d-329a0899c4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:32.483152 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dbfaf-b84f-426d-872d-329a0899c4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:32.483747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dbfaf-b84f-426d-872d-329a0899c4f6 admin admin] PATH_INFO: `/v3/projects/35bec2ebe17e440fad2ebf1b1022993c` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:32.484281 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7bbe5-bc7b-4fc8-a92e-96294fb0ef96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:32.485611 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7bbe5-bc7b-4fc8-a92e-96294fb0ef96 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:32.485810 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7bbe5-bc7b-4fc8-a92e-96294fb0ef96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:32.486041 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7bbe5-bc7b-4fc8-a92e-96294fb0ef96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:32.487405 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dbfaf-b84f-426d-872d-329a0899c4f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35bec2ebe17e440fad2ebf1b1022993c)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:32.487535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7bbe5-bc7b-4fc8-a92e-96294fb0ef96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:32.489193 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7bbe5-bc7b-4fc8-a92e-96294fb0ef96 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:32.491325 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dbfaf-b84f-426d-872d-329a0899c4f6 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:32.516802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 846/1699] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:45:32.518070 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7bbe5-bc7b-4fc8-a92e-96294fb0ef96 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:32.519988 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b6c7bbe5-bc7b-4fc8-a92e-96294fb0ef96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:32.573098 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7bbe5-bc7b-4fc8-a92e-96294fb0ef96 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:32.596692 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d9d8b-af85-446d-9f21-326afebbc2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:32.597365 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d9d8b-af85-446d-9f21-326afebbc2c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:32.597641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d9d8b-af85-446d-9f21-326afebbc2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:32.598495 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d9d8b-af85-446d-9f21-326afebbc2c3 admin admin] PATH_INFO: `/v3/projects/4ef495c50e0344f78074eb53e76b1d7b` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:32.599350 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d9d8b-af85-446d-9f21-326afebbc2c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ef495c50e0344f78074eb53e76b1d7b)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:32.601393 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d9d8b-af85-446d-9f21-326afebbc2c3 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:32.747610 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-845dbfaf-b84f-426d-872d-329a0899c4f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35bec2ebe17e440fad2ebf1b1022993c', 'request_id': 'req-845dbfaf-b84f-426d-872d-329a0899c4f6'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:32.768411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-845dbfaf-b84f-426d-872d-329a0899c4f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35bec2ebe17e440fad2ebf1b1022993c', 'request_id': 'req-845dbfaf-b84f-426d-872d-329a0899c4f6'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:32.848682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b20d9d8b-af85-446d-9f21-326afebbc2c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ef495c50e0344f78074eb53e76b1d7b', 'request_id': 'req-b20d9d8b-af85-446d-9f21-326afebbc2c3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:32.889827 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b20d9d8b-af85-446d-9f21-326afebbc2c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ef495c50e0344f78074eb53e76b1d7b', 'request_id': 'req-b20d9d8b-af85-446d-9f21-326afebbc2c3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:32.899733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-845dbfaf-b84f-426d-872d-329a0899c4f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35bec2ebe17e440fad2ebf1b1022993c', 'request_id': 'req-845dbfaf-b84f-426d-872d-329a0899c4f6'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:32.936774 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-845dbfaf-b84f-426d-872d-329a0899c4f6 admin admin] The token cache is being invalidate because project 35bec2ebe17e440fad2ebf1b1022993c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:45:32.937002 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-845dbfaf-b84f-426d-872d-329a0899c4f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:32.938727 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-845dbfaf-b84f-426d-872d-329a0899c4f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:32.941075 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 854/1700] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:45:32 2022] DELETE /identity/v3/projects/35bec2ebe17e440fad2ebf1b1022993c => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:32.942000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dbfaf-b84f-426d-872d-329a0899c4f6 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:32.947315 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-845dbfaf-b84f-426d-872d-329a0899c4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:33.045239 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b20d9d8b-af85-446d-9f21-326afebbc2c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ef495c50e0344f78074eb53e76b1d7b', 'request_id': 'req-b20d9d8b-af85-446d-9f21-326afebbc2c3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:33.068717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b20d9d8b-af85-446d-9f21-326afebbc2c3 admin admin] The token cache is being invalidate because project 4ef495c50e0344f78074eb53e76b1d7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:45:33.069263 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b20d9d8b-af85-446d-9f21-326afebbc2c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:33.070726 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b20d9d8b-af85-446d-9f21-326afebbc2c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:33.073943 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 847/1701] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:45:32 2022] DELETE /identity/v3/projects/4ef495c50e0344f78074eb53e76b1d7b => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:33.075643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51017c2e-3c43-4cca-9dd0-5ccc63a0d33c None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:33.077450 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51017c2e-3c43-4cca-9dd0-5ccc63a0d33c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:33.080661 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51017c2e-3c43-4cca-9dd0-5ccc63a0d33c None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:33.082461 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 848/1702] 10.222.0.65 () {54 vars in 961 bytes} [Wed Jul 27 18:45:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:45:33.085715 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51017c2e-3c43-4cca-9dd0-5ccc63a0d33c None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:33.102303 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-51017c2e-3c43-4cca-9dd0-5ccc63a0d33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:33.152394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dbfaf-b84f-426d-872d-329a0899c4f6 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:33.252811 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51017c2e-3c43-4cca-9dd0-5ccc63a0d33c None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:33.262164 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5a516-68f7-42ee-a3e2-2cb20fb40c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:33.263182 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5a516-68f7-42ee-a3e2-2cb20fb40c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:33.263797 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5a516-68f7-42ee-a3e2-2cb20fb40c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:33.264225 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5a516-68f7-42ee-a3e2-2cb20fb40c57 admin admin] PATH_INFO: `/v3/users/956c2e68acb344f2be9b9e9cbcab9f69` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:33.270981 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5a516-68f7-42ee-a3e2-2cb20fb40c57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=956c2e68acb344f2be9b9e9cbcab9f69)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:33.270981 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5a516-68f7-42ee-a3e2-2cb20fb40c57 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:33.324149 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcc844-9f05-4d09-9724-a1f830a120cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:33.325301 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcc844-9f05-4d09-9724-a1f830a120cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:33.326425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcc844-9f05-4d09-9724-a1f830a120cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:33.326915 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcc844-9f05-4d09-9724-a1f830a120cb admin admin] PATH_INFO: `/v3/projects/b233821387fe41c4af77f59a708e58be/users/ad78b0df503a490fb31ff3a74ee06696/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:33.334763 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcc844-9f05-4d09-9724-a1f830a120cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b233821387fe41c4af77f59a708e58be, user_id=ad78b0df503a490fb31ff3a74ee06696, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:33.339147 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcc844-9f05-4d09-9724-a1f830a120cb admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:33.355669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 855/1703] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:32 2022] PUT /identity/v3/projects/b233821387fe41c4af77f59a708e58be/users/ad78b0df503a490fb31ff3a74ee06696/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:33.357355 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551499f-aa3b-4606-ba4e-933a0da33299 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:33.357852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551499f-aa3b-4606-ba4e-933a0da33299 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:33.358328 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551499f-aa3b-4606-ba4e-933a0da33299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:33.397925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-7551499f-aa3b-4606-ba4e-933a0da33299 None None] MFA Rules not processed for user `fa24cdd15afd4c9e8b34dbfa05a5db24`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:33.399362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-7551499f-aa3b-4606-ba4e-933a0da33299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:33.542633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 856/1704] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:33.550346 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0261a5-b00c-4775-9bc9-092b2fedca17 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:33.550682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0261a5-b00c-4775-9bc9-092b2fedca17 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:33.551013 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0261a5-b00c-4775-9bc9-092b2fedca17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:33.572708 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-efb5a516-68f7-42ee-a3e2-2cb20fb40c57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '956c2e68acb344f2be9b9e9cbcab9f69'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:33.574105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-efb5a516-68f7-42ee-a3e2-2cb20fb40c57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '956c2e68acb344f2be9b9e9cbcab9f69'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:33.598750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:33.604132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-fd0261a5-b00c-4775-9bc9-092b2fedca17 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:33.605439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-fd0261a5-b00c-4775-9bc9-092b2fedca17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:33.642514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-efb5a516-68f7-42ee-a3e2-2cb20fb40c57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '956c2e68acb344f2be9b9e9cbcab9f69'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:33.675276 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-efb5a516-68f7-42ee-a3e2-2cb20fb40c57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '956c2e68acb344f2be9b9e9cbcab9f69'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:33.677597 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-efb5a516-68f7-42ee-a3e2-2cb20fb40c57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '956c2e68acb344f2be9b9e9cbcab9f69'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:33.710710 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 849/1705] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:45:33 2022] DELETE /identity/v3/users/956c2e68acb344f2be9b9e9cbcab9f69 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:33.712471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08c83a-593a-4a97-afe9-9692eecb22d4 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:33.732149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08c83a-593a-4a97-afe9-9692eecb22d4 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:33.732485 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08c83a-593a-4a97-afe9-9692eecb22d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:33.793909 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 857/1706] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:33.806527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406a6e9-5436-4b8b-b67d-3f098f09e817 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:33.807140 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406a6e9-5436-4b8b-b67d-3f098f09e817 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:33.807453 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406a6e9-5436-4b8b-b67d-3f098f09e817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:33.810075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-2c08c83a-593a-4a97-afe9-9692eecb22d4 None None] MFA Rules not processed for user `aa971da983ea48c3b6d4c68a5d454bde`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:33.816746 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2c08c83a-593a-4a97-afe9-9692eecb22d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:33.874430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-9406a6e9-5436-4b8b-b67d-3f098f09e817 None None] MFA Rules not processed for user `b05240b3f0bf40789d476e4bdad8bea0`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:33.875847 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-9406a6e9-5436-4b8b-b67d-3f098f09e817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:33.979180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 850/1707] 10.222.0.65 () {58 vars in 1058 bytes} [Wed Jul 27 18:45:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:33.983728 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb364f-b7d7-46b3-8e9a-62f01f4a39dc None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:33.986734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb364f-b7d7-46b3-8e9a-62f01f4a39dc None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:33.988027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb364f-b7d7-46b3-8e9a-62f01f4a39dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:34.023995 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 858/1708] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:34.023995 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd168d-50c2-43c1-9c7a-30447e29e586 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:34.024478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd168d-50c2-43c1-9c7a-30447e29e586 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:34.024478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd168d-50c2-43c1-9c7a-30447e29e586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:34.066581 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-99bd168d-50c2-43c1-9c7a-30447e29e586 None None] MFA Rules not processed for user `fa24cdd15afd4c9e8b34dbfa05a5db24`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:34.068080 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-99bd168d-50c2-43c1-9c7a-30447e29e586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:34.081226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0ceb364f-b7d7-46b3-8e9a-62f01f4a39dc None None] MFA Rules not processed for user `ad78b0df503a490fb31ff3a74ee06696`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:34.082812 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0ceb364f-b7d7-46b3-8e9a-62f01f4a39dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:34.211883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 859/1709] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:34.216522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917c001-1793-4631-b1ab-3307a55019f6 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:34.216522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917c001-1793-4631-b1ab-3307a55019f6 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:34.216522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917c001-1793-4631-b1ab-3307a55019f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:34.244377 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 851/1710] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:33 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:34.246075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbc82f-e630-4445-92c5-b7f15e5eed82 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:34.247114 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbc82f-e630-4445-92c5-b7f15e5eed82 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:34.247786 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbc82f-e630-4445-92c5-b7f15e5eed82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:34.260423 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:34.262698 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-f917c001-1793-4631-b1ab-3307a55019f6 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:34.264418 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-f917c001-1793-4631-b1ab-3307a55019f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:34.320531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-52dbc82f-e630-4445-92c5-b7f15e5eed82 None None] MFA Rules not processed for user `91402fce003f49cf9b3cb3c170fbed71`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:34.322132 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-52dbc82f-e630-4445-92c5-b7f15e5eed82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:34.368418 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 860/1711] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:34.369141 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917c001-1793-4631-b1ab-3307a55019f6 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:34.385498 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917c001-1793-4631-b1ab-3307a55019f6 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:34.392495 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f84d5-9a7d-4c8c-8419-afbc12fdec91 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa971da983ea48c3b6d4c68a5d454bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:34.393378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f84d5-9a7d-4c8c-8419-afbc12fdec91 service placement] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:34.393712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f84d5-9a7d-4c8c-8419-afbc12fdec91 service placement] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:34.393996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f84d5-9a7d-4c8c-8419-afbc12fdec91 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:34.396067 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-941f84d5-9a7d-4c8c-8419-afbc12fdec91 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:34.413332 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f84d5-9a7d-4c8c-8419-afbc12fdec91 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:34.415855 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f84d5-9a7d-4c8c-8419-afbc12fdec91 service placement] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:34.432438 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 861/1712] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:34.435742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f84d5-9a7d-4c8c-8419-afbc12fdec91 service placement] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:34.439358 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-941f84d5-9a7d-4c8c-8419-afbc12fdec91 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:34.506805 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 852/1713] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:34.507867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbc82f-e630-4445-92c5-b7f15e5eed82 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:34.515328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-52dbc82f-e630-4445-92c5-b7f15e5eed82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:34.641121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f84d5-9a7d-4c8c-8419-afbc12fdec91 service placement] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:34.670096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c645e-c17f-417a-8a08-d5ff1006b1c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:34.672920 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c645e-c17f-417a-8a08-d5ff1006b1c3 service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:34.675615 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c645e-c17f-417a-8a08-d5ff1006b1c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:34.676064 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c645e-c17f-417a-8a08-d5ff1006b1c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:34.682318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ba5c645e-c17f-417a-8a08-d5ff1006b1c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:34.699546 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbc82f-e630-4445-92c5-b7f15e5eed82 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:34.704591 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafaee9-68f6-44d8-9f6d-0dcf013cfef8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:34.705366 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafaee9-68f6-44d8-9f6d-0dcf013cfef8 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:34.705730 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafaee9-68f6-44d8-9f6d-0dcf013cfef8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:34.706085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafaee9-68f6-44d8-9f6d-0dcf013cfef8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:34.715329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c645e-c17f-417a-8a08-d5ff1006b1c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:34.717255 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c645e-c17f-417a-8a08-d5ff1006b1c3 service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:34.746815 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaafaee9-68f6-44d8-9f6d-0dcf013cfef8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:34.747189 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 862/1714] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:34.752605 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c645e-c17f-417a-8a08-d5ff1006b1c3 service nova] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:34.756430 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaafaee9-68f6-44d8-9f6d-0dcf013cfef8 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:34.766893 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c645e-c17f-417a-8a08-d5ff1006b1c3 service nova] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:34.774925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad5d4f-ff10-41e9-b252-d0fa4cab5878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:34.775928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad5d4f-ff10-41e9-b252-d0fa4cab5878 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:34.776199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad5d4f-ff10-41e9-b252-d0fa4cab5878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:34.776481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad5d4f-ff10-41e9-b252-d0fa4cab5878 admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:34.777374 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad5d4f-ff10-41e9-b252-d0fa4cab5878 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:45:34.777647 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad5d4f-ff10-41e9-b252-d0fa4cab5878 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:34.779684 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad5d4f-ff10-41e9-b252-d0fa4cab5878 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:34.790713 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 853/1715] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:34 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:34.808687 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 863/1716] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:45:34.810316 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafaee9-68f6-44d8-9f6d-0dcf013cfef8 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:34.837263 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:34.842382 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafaee9-68f6-44d8-9f6d-0dcf013cfef8 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:34.878869 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad5d4f-ff10-41e9-b252-d0fa4cab5878 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:34.880754 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-0cad5d4f-ff10-41e9-b252-d0fa4cab5878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:34.886873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f66ba3-b33b-4ff2-aeb5-cbe28c60595a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:34.888208 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f66ba3-b33b-4ff2-aeb5-cbe28c60595a admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:34.890620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f66ba3-b33b-4ff2-aeb5-cbe28c60595a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:34.891608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f66ba3-b33b-4ff2-aeb5-cbe28c60595a admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:34.892425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f66ba3-b33b-4ff2-aeb5-cbe28c60595a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:34.894889 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f66ba3-b33b-4ff2-aeb5-cbe28c60595a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:34.904749 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad5d4f-ff10-41e9-b252-d0fa4cab5878 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:34.922732 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5c178-14c1-4af6-8392-282c5b05abe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:34.923434 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5c178-14c1-4af6-8392-282c5b05abe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:34.923718 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5c178-14c1-4af6-8392-282c5b05abe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:34.924079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5c178-14c1-4af6-8392-282c5b05abe3 admin admin] PATH_INFO: `/v3/projects/f8e9820b17de4731a880415d5bca6f72` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:34.928337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5c178-14c1-4af6-8392-282c5b05abe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8e9820b17de4731a880415d5bca6f72)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:34.933728 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5c178-14c1-4af6-8392-282c5b05abe3 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:34.953994 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:35.114888 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 854/1717] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:34 2022] POST /identity/v3/projects => generated 371 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:35.116340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f66ba3-b33b-4ff2-aeb5-cbe28c60595a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:35.122895 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-95f66ba3-b33b-4ff2-aeb5-cbe28c60595a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:35.146038 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0ac5c178-14c1-4af6-8392-282c5b05abe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8e9820b17de4731a880415d5bca6f72', 'request_id': 'req-0ac5c178-14c1-4af6-8392-282c5b05abe3'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:35.148194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0ac5c178-14c1-4af6-8392-282c5b05abe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8e9820b17de4731a880415d5bca6f72', 'request_id': 'req-0ac5c178-14c1-4af6-8392-282c5b05abe3'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:35.233127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f66ba3-b33b-4ff2-aeb5-cbe28c60595a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:35.242340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82602f39-e585-4483-baac-d99dbb1f00cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:35.243334 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82602f39-e585-4483-baac-d99dbb1f00cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:35.243856 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82602f39-e585-4483-baac-d99dbb1f00cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:35.244333 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82602f39-e585-4483-baac-d99dbb1f00cf admin admin] PATH_INFO: `/v3/users/bcb4fa00f6924331ac79c8d13e6cf39c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:35.246423 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82602f39-e585-4483-baac-d99dbb1f00cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcb4fa00f6924331ac79c8d13e6cf39c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:35.247610 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0ac5c178-14c1-4af6-8392-282c5b05abe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8e9820b17de4731a880415d5bca6f72', 'request_id': 'req-0ac5c178-14c1-4af6-8392-282c5b05abe3'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:35.249795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82602f39-e585-4483-baac-d99dbb1f00cf admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:35.271132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0ac5c178-14c1-4af6-8392-282c5b05abe3 admin admin] The token cache is being invalidate because project f8e9820b17de4731a880415d5bca6f72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:45:35.271454 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0ac5c178-14c1-4af6-8392-282c5b05abe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:35.276437 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0ac5c178-14c1-4af6-8392-282c5b05abe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:35.278830 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 864/1718] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:45:34 2022] DELETE /identity/v3/projects/f8e9820b17de4731a880415d5bca6f72 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:45:35.279953 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5c178-14c1-4af6-8392-282c5b05abe3 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:35.282469 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-0ac5c178-14c1-4af6-8392-282c5b05abe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:35.376452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5c178-14c1-4af6-8392-282c5b05abe3 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:35.389503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89221fcc-2726-4f20-8ddf-3c50731f44c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:35.390160 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89221fcc-2726-4f20-8ddf-3c50731f44c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:35.391152 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89221fcc-2726-4f20-8ddf-3c50731f44c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:35.391580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89221fcc-2726-4f20-8ddf-3c50731f44c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:35.392940 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89221fcc-2726-4f20-8ddf-3c50731f44c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:35.397001 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89221fcc-2726-4f20-8ddf-3c50731f44c0 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:35.558831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 865/1719] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:35 2022] POST /identity/v3/users => generated 286 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:35.564834 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90c8ba-bbf3-4819-8469-7c503a188c83 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:35.565512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90c8ba-bbf3-4819-8469-7c503a188c83 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:35.566162 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90c8ba-bbf3-4819-8469-7c503a188c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:35.604027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-82602f39-e585-4483-baac-d99dbb1f00cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcb4fa00f6924331ac79c8d13e6cf39c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:35.604753 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-82602f39-e585-4483-baac-d99dbb1f00cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcb4fa00f6924331ac79c8d13e6cf39c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:35.660158 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-7f90c8ba-bbf3-4819-8469-7c503a188c83 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:35.662018 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-7f90c8ba-bbf3-4819-8469-7c503a188c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:35.683544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 866/1720] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:35.683544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90c8ba-bbf3-4819-8469-7c503a188c83 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:35.684435 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-82602f39-e585-4483-baac-d99dbb1f00cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcb4fa00f6924331ac79c8d13e6cf39c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:35.696954 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90c8ba-bbf3-4819-8469-7c503a188c83 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:35.703625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-82602f39-e585-4483-baac-d99dbb1f00cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcb4fa00f6924331ac79c8d13e6cf39c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:35.705616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-82602f39-e585-4483-baac-d99dbb1f00cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcb4fa00f6924331ac79c8d13e6cf39c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:35.710150 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324670b7-5fa6-4fbf-9a20-9dfd3585a1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:35.710869 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324670b7-5fa6-4fbf-9a20-9dfd3585a1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:35.711119 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324670b7-5fa6-4fbf-9a20-9dfd3585a1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:35.711440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324670b7-5fa6-4fbf-9a20-9dfd3585a1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:35.712468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324670b7-5fa6-4fbf-9a20-9dfd3585a1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:35.716270 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324670b7-5fa6-4fbf-9a20-9dfd3585a1e2 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:35.724478 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 855/1721] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:45:35 2022] DELETE /identity/v3/users/bcb4fa00f6924331ac79c8d13e6cf39c => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:35.727574 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63812277-85b3-481d-985d-972401893622 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:35.728273 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63812277-85b3-481d-985d-972401893622 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:35.728710 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63812277-85b3-481d-985d-972401893622 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:35.731342 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 856/1722] 10.222.0.65 () {54 vars in 912 bytes} [Wed Jul 27 18:45:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:45:35.732875 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbab8ab-2c6c-4aa3-bf5c-6669542bae44 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:35.733383 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbab8ab-2c6c-4aa3-bf5c-6669542bae44 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:35.733840 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbab8ab-2c6c-4aa3-bf5c-6669542bae44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:35.747191 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 867/1723] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:35.749129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84074c1-9243-4579-a37b-5848f7a80545 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:35.749432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84074c1-9243-4579-a37b-5848f7a80545 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:35.749711 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84074c1-9243-4579-a37b-5848f7a80545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:35.759743 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-2cbab8ab-2c6c-4aa3-bf5c-6669542bae44 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:35.761112 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2cbab8ab-2c6c-4aa3-bf5c-6669542bae44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:35.779695 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-b84074c1-9243-4579-a37b-5848f7a80545 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:35.785399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b84074c1-9243-4579-a37b-5848f7a80545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:35.946852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 868/1724] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:35.950982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a3267-cd7c-4ccd-8ff4-b648d25d59b1 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:35.954271 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a3267-cd7c-4ccd-8ff4-b648d25d59b1 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:35.955422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a3267-cd7c-4ccd-8ff4-b648d25d59b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:35.975566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 857/1725] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:35.979551 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbab8ab-2c6c-4aa3-bf5c-6669542bae44 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:35.982072 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2cbab8ab-2c6c-4aa3-bf5c-6669542bae44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:36.006762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-813a3267-cd7c-4ccd-8ff4-b648d25d59b1 None None] MFA Rules not processed for user `ffee4a13d4fd4f86bd1c79b4535a0c55`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:36.009426 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-813a3267-cd7c-4ccd-8ff4-b648d25d59b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:36.016172 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbab8ab-2c6c-4aa3-bf5c-6669542bae44 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:36.049181 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa20a0-5bf2-447f-9c0e-9bd18e49ab6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:36.052821 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa20a0-5bf2-447f-9c0e-9bd18e49ab6e admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:36.053177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa20a0-5bf2-447f-9c0e-9bd18e49ab6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:36.058798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa20a0-5bf2-447f-9c0e-9bd18e49ab6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:36.058798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa20a0-5bf2-447f-9c0e-9bd18e49ab6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:36.058798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa20a0-5bf2-447f-9c0e-9bd18e49ab6e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:36.087672 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 858/1726] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:36.094411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa20a0-5bf2-447f-9c0e-9bd18e49ab6e admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:36.096191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b6fa20a0-5bf2-447f-9c0e-9bd18e49ab6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:36.133301 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 869/1727] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 18:45:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:36.133301 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a3267-cd7c-4ccd-8ff4-b648d25d59b1 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:36.153390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-813a3267-cd7c-4ccd-8ff4-b648d25d59b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:36.178708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a3267-cd7c-4ccd-8ff4-b648d25d59b1 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:36.196171 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792c262-1550-4c2f-a8cd-9711d8e74550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:36.196941 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792c262-1550-4c2f-a8cd-9711d8e74550 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:36.206128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792c262-1550-4c2f-a8cd-9711d8e74550 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:36.206591 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792c262-1550-4c2f-a8cd-9711d8e74550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:36.249311 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792c262-1550-4c2f-a8cd-9711d8e74550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:36.257583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792c262-1550-4c2f-a8cd-9711d8e74550 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:36.302292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 870/1728] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:36.309551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792c262-1550-4c2f-a8cd-9711d8e74550 service neutron] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:36.335710 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa20a0-5bf2-447f-9c0e-9bd18e49ab6e admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:36.349653 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792c262-1550-4c2f-a8cd-9711d8e74550 service neutron] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:36.358884 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e7a1a-c3db-4e59-97bb-ce8f7fc50fd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:36.359615 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e7a1a-c3db-4e59-97bb-ce8f7fc50fd4 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:36.361892 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e7a1a-c3db-4e59-97bb-ce8f7fc50fd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:36.361892 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e7a1a-c3db-4e59-97bb-ce8f7fc50fd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:36.369778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0b4e7a1a-c3db-4e59-97bb-ce8f7fc50fd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:36.376733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862507ee-c697-43ad-9673-2dcd8d9ed1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:36.377379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862507ee-c697-43ad-9673-2dcd8d9ed1ec admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:36.377666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862507ee-c697-43ad-9673-2dcd8d9ed1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:36.377947 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862507ee-c697-43ad-9673-2dcd8d9ed1ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:36.378659 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862507ee-c697-43ad-9673-2dcd8d9ed1ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:45:36.388648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862507ee-c697-43ad-9673-2dcd8d9ed1ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:36.388648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862507ee-c697-43ad-9673-2dcd8d9ed1ec admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:36.443387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 871/1729] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:45:36.443387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862507ee-c697-43ad-9673-2dcd8d9ed1ec admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:36.495814 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862507ee-c697-43ad-9673-2dcd8d9ed1ec admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:36.516386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821e630-324b-42e9-b628-a8d2ceea09a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:36.522066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821e630-324b-42e9-b628-a8d2ceea09a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:36.522066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821e630-324b-42e9-b628-a8d2ceea09a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:36.522066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821e630-324b-42e9-b628-a8d2ceea09a1 admin admin] PATH_INFO: `/v3/projects/8f3d26c456ee4b8a9c7264d0fd06e2c6/users/f21fdf522efe4ac6ae97e612a8132b22/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:36.595313 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e7a1a-c3db-4e59-97bb-ce8f7fc50fd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:36.595313 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e7a1a-c3db-4e59-97bb-ce8f7fc50fd4 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:36.600468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821e630-324b-42e9-b628-a8d2ceea09a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3d26c456ee4b8a9c7264d0fd06e2c6, user_id=f21fdf522efe4ac6ae97e612a8132b22, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:36.611419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821e630-324b-42e9-b628-a8d2ceea09a1 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:36.624052 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 859/1730] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:36.636358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e7a1a-c3db-4e59-97bb-ce8f7fc50fd4 service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:36.662253 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e7a1a-c3db-4e59-97bb-ce8f7fc50fd4 service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:36.673358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519739e-51c3-4ca0-8f79-e0b804997c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:36.674010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519739e-51c3-4ca0-8f79-e0b804997c59 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:36.674293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519739e-51c3-4ca0-8f79-e0b804997c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:36.674567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519739e-51c3-4ca0-8f79-e0b804997c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:36.694445 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519739e-51c3-4ca0-8f79-e0b804997c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:36.696029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519739e-51c3-4ca0-8f79-e0b804997c59 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:36.714629 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 872/1731] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:36 2022] PUT /identity/v3/projects/8f3d26c456ee4b8a9c7264d0fd06e2c6/users/f21fdf522efe4ac6ae97e612a8132b22/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:36.717279 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821e630-324b-42e9-b628-a8d2ceea09a1 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:36.724533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 860/1732] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:36.733377 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519739e-51c3-4ca0-8f79-e0b804997c59 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:36.740060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-f821e630-324b-42e9-b628-a8d2ceea09a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:36.749146 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519739e-51c3-4ca0-8f79-e0b804997c59 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:36.985650 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821e630-324b-42e9-b628-a8d2ceea09a1 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:36.986952 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acbef5-a323-45cf-8ae3-80276cc1f98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:36.987626 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acbef5-a323-45cf-8ae3-80276cc1f98c admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:36.987911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acbef5-a323-45cf-8ae3-80276cc1f98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:36.988191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acbef5-a323-45cf-8ae3-80276cc1f98c admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:36.988866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0acbef5-a323-45cf-8ae3-80276cc1f98c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:36.990819 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0acbef5-a323-45cf-8ae3-80276cc1f98c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:37.004082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711f82b-dec6-4f39-aa84-6593a56c86aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:37.004664 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711f82b-dec6-4f39-aa84-6593a56c86aa service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:37.004947 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711f82b-dec6-4f39-aa84-6593a56c86aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:37.005226 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711f82b-dec6-4f39-aa84-6593a56c86aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:37.016881 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-7711f82b-dec6-4f39-aa84-6593a56c86aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:37.178292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 861/1733] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:36 2022] POST /identity/v3/projects => generated 399 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:37.182023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32558d-b19e-423e-ae59-9e3c9f64fcff None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:37.182328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32558d-b19e-423e-ae59-9e3c9f64fcff None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:37.186306 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32558d-b19e-423e-ae59-9e3c9f64fcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:37.204553 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:37.263417 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711f82b-dec6-4f39-aa84-6593a56c86aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:37.266628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711f82b-dec6-4f39-aa84-6593a56c86aa service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:37.269842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-6e32558d-b19e-423e-ae59-9e3c9f64fcff None None] MFA Rules not processed for user `f21fdf522efe4ac6ae97e612a8132b22`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:37.275190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6e32558d-b19e-423e-ae59-9e3c9f64fcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:37.294814 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 873/1734] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:37.296963 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711f82b-dec6-4f39-aa84-6593a56c86aa service cinder] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:37.321782 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:37.351172 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711f82b-dec6-4f39-aa84-6593a56c86aa service cinder] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:37.504072 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 862/1735] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:37.505711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32558d-b19e-423e-ae59-9e3c9f64fcff None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:37.566657 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c5081-5c08-41c3-b559-9770dde356eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:37.567456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c5081-5c08-41c3-b559-9770dde356eb admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:37.567785 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c5081-5c08-41c3-b559-9770dde356eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:37.568111 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c5081-5c08-41c3-b559-9770dde356eb admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:37.569202 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c5081-5c08-41c3-b559-9770dde356eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:37.571398 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c5081-5c08-41c3-b559-9770dde356eb admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:37.741851 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32558d-b19e-423e-ae59-9e3c9f64fcff None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:37.757886 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9df61-0db9-4539-8e5b-a845b3e859ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:37.758572 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9df61-0db9-4539-8e5b-a845b3e859ae admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:37.758814 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9df61-0db9-4539-8e5b-a845b3e859ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:37.762279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9df61-0db9-4539-8e5b-a845b3e859ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:37.762403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 874/1736] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:37 2022] POST /identity/v3/users => generated 300 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:37.762403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c5081-5c08-41c3-b559-9770dde356eb admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:37.767786 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-dd1c5081-5c08-41c3-b559-9770dde356eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:37.774095 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9df61-0db9-4539-8e5b-a845b3e859ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:37.778408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9df61-0db9-4539-8e5b-a845b3e859ae admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:37.813641 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c5081-5c08-41c3-b559-9770dde356eb admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:37.825159 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861fa75-ba3b-42b5-9dc1-ddfa453e2b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:37.826006 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861fa75-ba3b-42b5-9dc1-ddfa453e2b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:37.826386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861fa75-ba3b-42b5-9dc1-ddfa453e2b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:37.826762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861fa75-ba3b-42b5-9dc1-ddfa453e2b37 admin admin] PATH_INFO: `/v3/projects/5bed446180d84ed7bfe4a5ed0eb626f5` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:37.830553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861fa75-ba3b-42b5-9dc1-ddfa453e2b37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bed446180d84ed7bfe4a5ed0eb626f5)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:37.837153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861fa75-ba3b-42b5-9dc1-ddfa453e2b37 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:37.985997 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 863/1737] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:37 2022] POST /identity/v3/projects => generated 371 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:37.986961 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9df61-0db9-4539-8e5b-a845b3e859ae admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:38.150019 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-8861fa75-ba3b-42b5-9dc1-ddfa453e2b37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bed446180d84ed7bfe4a5ed0eb626f5', 'request_id': 'req-8861fa75-ba3b-42b5-9dc1-ddfa453e2b37'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:38.169165 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-8861fa75-ba3b-42b5-9dc1-ddfa453e2b37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bed446180d84ed7bfe4a5ed0eb626f5', 'request_id': 'req-8861fa75-ba3b-42b5-9dc1-ddfa453e2b37'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:38.227368 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9df61-0db9-4539-8e5b-a845b3e859ae admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:38.276027 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-8861fa75-ba3b-42b5-9dc1-ddfa453e2b37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bed446180d84ed7bfe4a5ed0eb626f5', 'request_id': 'req-8861fa75-ba3b-42b5-9dc1-ddfa453e2b37'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:38.305584 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-8861fa75-ba3b-42b5-9dc1-ddfa453e2b37 admin admin] The token cache is being invalidate because project 5bed446180d84ed7bfe4a5ed0eb626f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:45:38.305885 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-8861fa75-ba3b-42b5-9dc1-ddfa453e2b37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:38.308214 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-8861fa75-ba3b-42b5-9dc1-ddfa453e2b37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:38.312736 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 875/1738] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:45:37 2022] DELETE /identity/v3/projects/5bed446180d84ed7bfe4a5ed0eb626f5 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:38.313575 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861fa75-ba3b-42b5-9dc1-ddfa453e2b37 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:38.319377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-8861fa75-ba3b-42b5-9dc1-ddfa453e2b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:38.400023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b5994-520c-43e5-b727-b69fdffef317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:38.403787 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b5994-520c-43e5-b727-b69fdffef317 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:38.404076 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b5994-520c-43e5-b727-b69fdffef317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:38.404353 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b5994-520c-43e5-b727-b69fdffef317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:38.405101 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b5994-520c-43e5-b727-b69fdffef317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:38.407015 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b5994-520c-43e5-b727-b69fdffef317 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:38.433297 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 864/1739] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:38.434399 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b5994-520c-43e5-b727-b69fdffef317 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:38.441517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-649b5994-520c-43e5-b727-b69fdffef317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:38.484615 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b5994-520c-43e5-b727-b69fdffef317 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:38.498864 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec330e5f-75b2-40ee-9e2f-989618825864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:38.499499 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec330e5f-75b2-40ee-9e2f-989618825864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:38.500490 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec330e5f-75b2-40ee-9e2f-989618825864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:38.500919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec330e5f-75b2-40ee-9e2f-989618825864 admin admin] PATH_INFO: `/v3/users/ad78b0df503a490fb31ff3a74ee06696` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:38.505722 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861fa75-ba3b-42b5-9dc1-ddfa453e2b37 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:38.506733 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec330e5f-75b2-40ee-9e2f-989618825864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad78b0df503a490fb31ff3a74ee06696)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:38.508923 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec330e5f-75b2-40ee-9e2f-989618825864 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:38.522395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd3643-9669-4d74-a1b8-fbdc25ae9dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:38.523839 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd3643-9669-4d74-a1b8-fbdc25ae9dfe admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:38.524543 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd3643-9669-4d74-a1b8-fbdc25ae9dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:38.524662 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd3643-9669-4d74-a1b8-fbdc25ae9dfe admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:38.527289 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd3643-9669-4d74-a1b8-fbdc25ae9dfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:38.531972 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd3643-9669-4d74-a1b8-fbdc25ae9dfe admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:38.683934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 876/1740] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:38 2022] POST /identity/v3/users => generated 292 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:38.706338 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd3643-9669-4d74-a1b8-fbdc25ae9dfe admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:38.720886 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4abd3643-9669-4d74-a1b8-fbdc25ae9dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:38.784765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd3643-9669-4d74-a1b8-fbdc25ae9dfe admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:38.804598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce7340-9c1c-4a01-819c-e0200afb3164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:38.804598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce7340-9c1c-4a01-819c-e0200afb3164 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:38.804598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce7340-9c1c-4a01-819c-e0200afb3164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:38.804598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce7340-9c1c-4a01-819c-e0200afb3164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:38.806011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce7340-9c1c-4a01-819c-e0200afb3164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:38.817761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce7340-9c1c-4a01-819c-e0200afb3164 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:38.852855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ec330e5f-75b2-40ee-9e2f-989618825864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad78b0df503a490fb31ff3a74ee06696'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:38.854406 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ec330e5f-75b2-40ee-9e2f-989618825864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad78b0df503a490fb31ff3a74ee06696'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:38.869693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 877/1741] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:38.870815 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce7340-9c1c-4a01-819c-e0200afb3164 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:38.884853 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce7340-9c1c-4a01-819c-e0200afb3164 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:38.891253 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cdd25-e086-4f5d-a62b-da5bb7e654ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:38.891942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cdd25-e086-4f5d-a62b-da5bb7e654ab admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:38.893978 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cdd25-e086-4f5d-a62b-da5bb7e654ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:38.893978 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cdd25-e086-4f5d-a62b-da5bb7e654ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:38.893978 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cdd25-e086-4f5d-a62b-da5bb7e654ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:38.895105 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cdd25-e086-4f5d-a62b-da5bb7e654ab admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:38.908801 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 878/1742] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:38.908801 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cdd25-e086-4f5d-a62b-da5bb7e654ab admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:38.928831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cdd25-e086-4f5d-a62b-da5bb7e654ab admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:38.935309 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb2df6-0a6e-4c4a-96d6-b7f4468b6b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:38.946307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb2df6-0a6e-4c4a-96d6-b7f4468b6b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:38.946307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb2df6-0a6e-4c4a-96d6-b7f4468b6b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:38.946307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb2df6-0a6e-4c4a-96d6-b7f4468b6b2f admin admin] PATH_INFO: `/v3/projects/c56fb6d4296e426faa47777b948afc2d/users/3b8f68b5dd9e46629c63e8bb3c098695/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:38.968297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb2df6-0a6e-4c4a-96d6-b7f4468b6b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c56fb6d4296e426faa47777b948afc2d, user_id=3b8f68b5dd9e46629c63e8bb3c098695, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:38.974020 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ec330e5f-75b2-40ee-9e2f-989618825864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad78b0df503a490fb31ff3a74ee06696'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:38.985758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb2df6-0a6e-4c4a-96d6-b7f4468b6b2f admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:39.010330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ec330e5f-75b2-40ee-9e2f-989618825864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad78b0df503a490fb31ff3a74ee06696'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:39.011196 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ec330e5f-75b2-40ee-9e2f-989618825864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad78b0df503a490fb31ff3a74ee06696'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:39.045890 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 865/1743] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:45:38 2022] DELETE /identity/v3/users/ad78b0df503a490fb31ff3a74ee06696 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:39.047493 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec330e5f-75b2-40ee-9e2f-989618825864 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:39.063046 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ec330e5f-75b2-40ee-9e2f-989618825864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:39.088773 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 879/1744] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:38 2022] PUT /identity/v3/projects/c56fb6d4296e426faa47777b948afc2d/users/3b8f68b5dd9e46629c63e8bb3c098695/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:39.106251 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0312271-a5de-4fb8-b1d5-4759439bc95c None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:39.107467 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0312271-a5de-4fb8-b1d5-4759439bc95c None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:39.108857 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0312271-a5de-4fb8-b1d5-4759439bc95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:39.220293 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-a0312271-a5de-4fb8-b1d5-4759439bc95c None None] MFA Rules not processed for user `3b8f68b5dd9e46629c63e8bb3c098695`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:39.229185 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a0312271-a5de-4fb8-b1d5-4759439bc95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:39.251760 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec330e5f-75b2-40ee-9e2f-989618825864 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:39.352103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bdaf1-00ad-446d-ba02-1ce8e40e4aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:39.353051 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bdaf1-00ad-446d-ba02-1ce8e40e4aa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:39.353504 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bdaf1-00ad-446d-ba02-1ce8e40e4aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:39.353925 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bdaf1-00ad-446d-ba02-1ce8e40e4aa8 admin admin] PATH_INFO: `/v3/projects/70a03f2a0bde4dd386baa58c47b6337d/users/b33cad7cc1434b9f9b7aa41a5d188102/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:39.373367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bdaf1-00ad-446d-ba02-1ce8e40e4aa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a03f2a0bde4dd386baa58c47b6337d, user_id=b33cad7cc1434b9f9b7aa41a5d188102, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:39.377040 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bdaf1-00ad-446d-ba02-1ce8e40e4aa8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:39.394904 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 880/1745] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:39.397393 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f5f2f-4154-41e8-b784-b11f4fa06dd0 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:39.397845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f5f2f-4154-41e8-b784-b11f4fa06dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:39.398272 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f5f2f-4154-41e8-b784-b11f4fa06dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:39.436483 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-f73f5f2f-4154-41e8-b784-b11f4fa06dd0 None None] MFA Rules not processed for user `b25caac30f7641f0b0d746ebff0b54b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:39.438825 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-f73f5f2f-4154-41e8-b784-b11f4fa06dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:39.503987 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 866/1746] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:39 2022] PUT /identity/v3/projects/70a03f2a0bde4dd386baa58c47b6337d/users/b33cad7cc1434b9f9b7aa41a5d188102/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:39.503987 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bdaf1-00ad-446d-ba02-1ce8e40e4aa8 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:39.505889 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-237bdaf1-00ad-446d-ba02-1ce8e40e4aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:39.528423 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:39.627443 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 881/1747] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:39.628562 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f5f2f-4154-41e8-b784-b11f4fa06dd0 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:39.664420 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f5f2f-4154-41e8-b784-b11f4fa06dd0 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:39.723745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bdaf1-00ad-446d-ba02-1ce8e40e4aa8 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:39.739495 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837a7a9-2910-4282-9f4f-4356d2d089a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:39.740231 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837a7a9-2910-4282-9f4f-4356d2d089a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:39.743637 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837a7a9-2910-4282-9f4f-4356d2d089a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:39.743637 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837a7a9-2910-4282-9f4f-4356d2d089a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:39.744064 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837a7a9-2910-4282-9f4f-4356d2d089a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:39.746711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837a7a9-2910-4282-9f4f-4356d2d089a6 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:39.853115 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9ce1d-f1f1-4630-86bb-f5bddc73e0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:39.854023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9ce1d-f1f1-4630-86bb-f5bddc73e0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:39.854458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9ce1d-f1f1-4630-86bb-f5bddc73e0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:39.855022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9ce1d-f1f1-4630-86bb-f5bddc73e0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:39.856047 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9ce1d-f1f1-4630-86bb-f5bddc73e0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:39.857869 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9ce1d-f1f1-4630-86bb-f5bddc73e0d7 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:39.891544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 882/1748] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:39.896999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9ce1d-f1f1-4630-86bb-f5bddc73e0d7 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:39.926078 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9ce1d-f1f1-4630-86bb-f5bddc73e0d7 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:39.938155 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 867/1749] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:39 2022] POST /identity/v3/projects => generated 401 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:39.942430 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837a7a9-2910-4282-9f4f-4356d2d089a6 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:39.948741 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4c832-5050-4c2d-a00b-57907fc16c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:39.949597 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4c832-5050-4c2d-a00b-57907fc16c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:39.949990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4c832-5050-4c2d-a00b-57907fc16c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:39.950469 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4c832-5050-4c2d-a00b-57907fc16c2d admin admin] PATH_INFO: `/v3/projects/70a03f2a0bde4dd386baa58c47b6337d/users/b33cad7cc1434b9f9b7aa41a5d188102/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:39.961337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4c832-5050-4c2d-a00b-57907fc16c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a03f2a0bde4dd386baa58c47b6337d, user_id=b33cad7cc1434b9f9b7aa41a5d188102, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:39.964525 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4c832-5050-4c2d-a00b-57907fc16c2d admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:40.025482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 883/1750] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:39 2022] PUT /identity/v3/projects/70a03f2a0bde4dd386baa58c47b6337d/users/b33cad7cc1434b9f9b7aa41a5d188102/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:45:40.039101 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7fd32-73ba-42b4-a01e-aeeb51802210 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:40.039101 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7fd32-73ba-42b4-a01e-aeeb51802210 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:40.039101 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7fd32-73ba-42b4-a01e-aeeb51802210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:40.059346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:40.128235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-5cd7fd32-73ba-42b4-a01e-aeeb51802210 None None] MFA Rules not processed for user `b33cad7cc1434b9f9b7aa41a5d188102`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:40.141948 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5cd7fd32-73ba-42b4-a01e-aeeb51802210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:40.175755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837a7a9-2910-4282-9f4f-4356d2d089a6 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:40.292351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d533073-de4b-430c-84ed-4d7d69f30878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:40.293490 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d533073-de4b-430c-84ed-4d7d69f30878 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:40.294024 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d533073-de4b-430c-84ed-4d7d69f30878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:40.294664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d533073-de4b-430c-84ed-4d7d69f30878 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:40.295837 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d533073-de4b-430c-84ed-4d7d69f30878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:40.299826 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d533073-de4b-430c-84ed-4d7d69f30878 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:40.302939 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 884/1751] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:40 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:45:40.310935 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7fd32-73ba-42b4-a01e-aeeb51802210 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:40.314331 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5cd7fd32-73ba-42b4-a01e-aeeb51802210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:40.354746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:40.402854 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 868/1752] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:39 2022] POST /identity/v3/users => generated 307 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:45:40.405029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d533073-de4b-430c-84ed-4d7d69f30878 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:40.433836 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d533073-de4b-430c-84ed-4d7d69f30878 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:40.442648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f5a50-82c4-4be4-957e-962169919b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:40.443621 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5a50-82c4-4be4-957e-962169919b2d admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:40.450732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5a50-82c4-4be4-957e-962169919b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:40.450732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5a50-82c4-4be4-957e-962169919b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:40.450732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f5a50-82c4-4be4-957e-962169919b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:40.451665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7fd32-73ba-42b4-a01e-aeeb51802210 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:40.451767 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f5a50-82c4-4be4-957e-962169919b2d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:40.458907 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4836514-f04f-48e9-a147-43bbbe704255 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:40.459834 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4836514-f04f-48e9-a147-43bbbe704255 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:40.460270 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4836514-f04f-48e9-a147-43bbbe704255 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:40.460703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4836514-f04f-48e9-a147-43bbbe704255 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:40.469365 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 869/1753] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:40.472615 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f5a50-82c4-4be4-957e-962169919b2d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:40.486265 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f5a50-82c4-4be4-957e-962169919b2d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:40.487840 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4836514-f04f-48e9-a147-43bbbe704255 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:40.490141 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4836514-f04f-48e9-a147-43bbbe704255 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:40.493245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327759f-86f0-4827-8ca3-1bcf7bdcf80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:40.493945 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327759f-86f0-4827-8ca3-1bcf7bdcf80f admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:40.494231 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327759f-86f0-4827-8ca3-1bcf7bdcf80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:40.494512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327759f-86f0-4827-8ca3-1bcf7bdcf80f admin admin] PATH_INFO: `/v3/projects/82f2a24607244083a1f74f90c3cbd477/users/b2b18ccbb17d43aca0cdab226b122fa6/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:40.503842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 885/1754] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:40 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:40.593168 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327759f-86f0-4827-8ca3-1bcf7bdcf80f admin admin] RBAC: Authorizing `identity:create_grant(project_id=82f2a24607244083a1f74f90c3cbd477, user_id=b2b18ccbb17d43aca0cdab226b122fa6, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:40.598283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327759f-86f0-4827-8ca3-1bcf7bdcf80f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:40.675071 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619af0f1-cfcc-4f8c-9ed4-299f1cc12c95 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:40.675903 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619af0f1-cfcc-4f8c-9ed4-299f1cc12c95 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:40.676296 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619af0f1-cfcc-4f8c-9ed4-299f1cc12c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:40.747610 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 870/1755] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:40 2022] PUT /identity/v3/projects/82f2a24607244083a1f74f90c3cbd477/users/b2b18ccbb17d43aca0cdab226b122fa6/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:40.752327 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327759f-86f0-4827-8ca3-1bcf7bdcf80f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:40.872909 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-619af0f1-cfcc-4f8c-9ed4-299f1cc12c95 None None] MFA Rules not processed for user `5b4c4184e87b4dc5a4047310cd0122ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:40.874153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-619af0f1-cfcc-4f8c-9ed4-299f1cc12c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:41.013628 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327759f-86f0-4827-8ca3-1bcf7bdcf80f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:41.058795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a19eb-0804-44eb-b9a1-a54acb21ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:41.059495 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a19eb-0804-44eb-b9a1-a54acb21ce17 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:41.059802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a19eb-0804-44eb-b9a1-a54acb21ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:41.061630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a19eb-0804-44eb-b9a1-a54acb21ce17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:41.061630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a19eb-0804-44eb-b9a1-a54acb21ce17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:41.079305 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a19eb-0804-44eb-b9a1-a54acb21ce17 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:41.129527 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 871/1756] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:41.147494 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a19eb-0804-44eb-b9a1-a54acb21ce17 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:41.201985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 886/1757] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 18:45:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 528 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:45:41.203768 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619af0f1-cfcc-4f8c-9ed4-299f1cc12c95 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:41.242653 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619af0f1-cfcc-4f8c-9ed4-299f1cc12c95 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:41.260312 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a19eb-0804-44eb-b9a1-a54acb21ce17 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:41.262105 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731f4e8-d033-4ff3-9e2f-99293c28e555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:41.264473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731f4e8-d033-4ff3-9e2f-99293c28e555 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:41.265093 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731f4e8-d033-4ff3-9e2f-99293c28e555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:41.268396 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c08a22-44d4-4c78-85d7-81059c7a5222 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:41.268964 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731f4e8-d033-4ff3-9e2f-99293c28e555 admin admin] PATH_INFO: `/v3/projects/82f2a24607244083a1f74f90c3cbd477/users/b2b18ccbb17d43aca0cdab226b122fa6/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:41.269802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c08a22-44d4-4c78-85d7-81059c7a5222 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:41.270640 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c08a22-44d4-4c78-85d7-81059c7a5222 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:41.271074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c08a22-44d4-4c78-85d7-81059c7a5222 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:41.274158 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731f4e8-d033-4ff3-9e2f-99293c28e555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82f2a24607244083a1f74f90c3cbd477, user_id=b2b18ccbb17d43aca0cdab226b122fa6, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:41.279674 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731f4e8-d033-4ff3-9e2f-99293c28e555 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:41.302135 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b5c08a22-44d4-4c78-85d7-81059c7a5222 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:41.322795 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 887/1758] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:41 2022] PUT /identity/v3/projects/82f2a24607244083a1f74f90c3cbd477/users/b2b18ccbb17d43aca0cdab226b122fa6/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:41.338305 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ae756-8978-47c9-b110-20040658a0a4 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:41.338840 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ae756-8978-47c9-b110-20040658a0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:41.339358 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ae756-8978-47c9-b110-20040658a0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:41.438570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c08a22-44d4-4c78-85d7-81059c7a5222 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:41.441461 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c08a22-44d4-4c78-85d7-81059c7a5222 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:41.442851 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-fd3ae756-8978-47c9-b110-20040658a0a4 None None] MFA Rules not processed for user `b2b18ccbb17d43aca0cdab226b122fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:41.445843 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-fd3ae756-8978-47c9-b110-20040658a0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:41.463956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 872/1759] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:41.470052 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c08a22-44d4-4c78-85d7-81059c7a5222 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:41.474347 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b5c08a22-44d4-4c78-85d7-81059c7a5222 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:41.516238 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c08a22-44d4-4c78-85d7-81059c7a5222 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:41.626933 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 888/1760] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:41 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:41.652445 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ae756-8978-47c9-b110-20040658a0a4 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:41.655659 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-fd3ae756-8978-47c9-b110-20040658a0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:41.695615 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c342e-da5f-470c-b2fc-98a880d50a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:41.696736 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c342e-da5f-470c-b2fc-98a880d50a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:41.697192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c342e-da5f-470c-b2fc-98a880d50a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:41.700085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c342e-da5f-470c-b2fc-98a880d50a67 admin admin] PATH_INFO: `/v3/projects/b233821387fe41c4af77f59a708e58be` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:41.702389 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c342e-da5f-470c-b2fc-98a880d50a67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b233821387fe41c4af77f59a708e58be)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:41.705605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c342e-da5f-470c-b2fc-98a880d50a67 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:41.776696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ae756-8978-47c9-b110-20040658a0a4 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:41.788499 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e614636-90ad-4e02-acb7-e1553b3fcbb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:41.789155 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e614636-90ad-4e02-acb7-e1553b3fcbb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:41.789434 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e614636-90ad-4e02-acb7-e1553b3fcbb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:41.789708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e614636-90ad-4e02-acb7-e1553b3fcbb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:41.810682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e614636-90ad-4e02-acb7-e1553b3fcbb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:41.814540 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e614636-90ad-4e02-acb7-e1553b3fcbb5 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:41.841185 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 889/1761] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:41 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:41.842113 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e614636-90ad-4e02-acb7-e1553b3fcbb5 service cinder] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:41.847460 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2e614636-90ad-4e02-acb7-e1553b3fcbb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:41.902354 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:41.927248 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0e4c342e-da5f-470c-b2fc-98a880d50a67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b233821387fe41c4af77f59a708e58be', 'request_id': 'req-0e4c342e-da5f-470c-b2fc-98a880d50a67'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:41.944864 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0e4c342e-da5f-470c-b2fc-98a880d50a67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b233821387fe41c4af77f59a708e58be', 'request_id': 'req-0e4c342e-da5f-470c-b2fc-98a880d50a67'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:42.116582 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0e4c342e-da5f-470c-b2fc-98a880d50a67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b233821387fe41c4af77f59a708e58be', 'request_id': 'req-0e4c342e-da5f-470c-b2fc-98a880d50a67'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:42.145827 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0e4c342e-da5f-470c-b2fc-98a880d50a67 admin admin] The token cache is being invalidate because project b233821387fe41c4af77f59a708e58be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:45:42.146158 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0e4c342e-da5f-470c-b2fc-98a880d50a67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:42.148644 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0e4c342e-da5f-470c-b2fc-98a880d50a67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:42.161375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 873/1762] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:45:41 2022] DELETE /identity/v3/projects/b233821387fe41c4af77f59a708e58be => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:42.161586 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e614636-90ad-4e02-acb7-e1553b3fcbb5 service cinder] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:42.165440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575be8e6-9c34-4678-aea0-c9e219aec740 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:42.165750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575be8e6-9c34-4678-aea0-c9e219aec740 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:42.166024 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575be8e6-9c34-4678-aea0-c9e219aec740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:42.232408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-575be8e6-9c34-4678-aea0-c9e219aec740 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:42.239101 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-575be8e6-9c34-4678-aea0-c9e219aec740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:42.377046 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffd34d-b518-476c-904d-033d07160c93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7832398e97af4e539e10d1eef49f6d6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:42.382786 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffd34d-b518-476c-904d-033d07160c93 service swift] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:42.383309 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffd34d-b518-476c-904d-033d07160c93 service swift] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:42.383708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffd34d-b518-476c-904d-033d07160c93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:42.390015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c8ffd34d-b518-476c-904d-033d07160c93 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:42.392664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 874/1763] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:42.395297 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575be8e6-9c34-4678-aea0-c9e219aec740 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:42.401625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-575be8e6-9c34-4678-aea0-c9e219aec740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:42.558642 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575be8e6-9c34-4678-aea0-c9e219aec740 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:42.569744 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6d586-d10a-40e5-b546-a288c24fedfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:42.570670 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6d586-d10a-40e5-b546-a288c24fedfe service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:42.570796 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6d586-d10a-40e5-b546-a288c24fedfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:42.571069 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6d586-d10a-40e5-b546-a288c24fedfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:42.576980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d8a6d586-d10a-40e5-b546-a288c24fedfe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:42.679631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffd34d-b518-476c-904d-033d07160c93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:42.684717 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffd34d-b518-476c-904d-033d07160c93 service swift] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:42.712255 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 890/1764] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 18:45:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 870 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:45:42.713799 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2892d-4145-42c7-ae64-2bf5e04e91a2 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:42.716299 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2892d-4145-42c7-ae64-2bf5e04e91a2 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:42.717490 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2892d-4145-42c7-ae64-2bf5e04e91a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:42.727368 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6d586-d10a-40e5-b546-a288c24fedfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:42.729486 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6d586-d10a-40e5-b546-a288c24fedfe service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:42.744040 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 875/1765] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:42.745656 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5a05b-3e27-4ced-97c3-70da7f49e97b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:42.746275 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5a05b-3e27-4ced-97c3-70da7f49e97b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:42.747091 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5a05b-3e27-4ced-97c3-70da7f49e97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:42.772394 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-2bb5a05b-3e27-4ced-97c3-70da7f49e97b None None] MFA Rules not processed for user `ffee4a13d4fd4f86bd1c79b4535a0c55`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:42.773702 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2bb5a05b-3e27-4ced-97c3-70da7f49e97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:42.778857 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-1bd2892d-4145-42c7-ae64-2bf5e04e91a2 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:42.785715 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-1bd2892d-4145-42c7-ae64-2bf5e04e91a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:42.864115 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 891/1766] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:42.873679 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2892d-4145-42c7-ae64-2bf5e04e91a2 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:42.905587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 876/1767] 10.222.0.64 () {58 vars in 1015 bytes} [Wed Jul 27 18:45:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:42.935522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2892d-4145-42c7-ae64-2bf5e04e91a2 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:42.956225 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5a05b-3e27-4ced-97c3-70da7f49e97b None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:42.957724 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2bb5a05b-3e27-4ced-97c3-70da7f49e97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:42.959354 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facd40f-ca56-49d1-a7d3-a974384df061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:42.960691 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facd40f-ca56-49d1-a7d3-a974384df061 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:42.961083 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facd40f-ca56-49d1-a7d3-a974384df061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:42.961729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facd40f-ca56-49d1-a7d3-a974384df061 admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:42.966898 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facd40f-ca56-49d1-a7d3-a974384df061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:45:42.967530 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facd40f-ca56-49d1-a7d3-a974384df061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:42.977849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facd40f-ca56-49d1-a7d3-a974384df061 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:42.993061 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5a05b-3e27-4ced-97c3-70da7f49e97b None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:43.016984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f156adc-cbe5-451d-b85f-9cb83cd982dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:43.017642 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f156adc-cbe5-451d-b85f-9cb83cd982dd service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:43.017928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f156adc-cbe5-451d-b85f-9cb83cd982dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:43.018207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f156adc-cbe5-451d-b85f-9cb83cd982dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:43.052703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f156adc-cbe5-451d-b85f-9cb83cd982dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:43.061081 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 892/1768] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:45:43.061844 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f156adc-cbe5-451d-b85f-9cb83cd982dd service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:43.065701 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facd40f-ca56-49d1-a7d3-a974384df061 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:43.106148 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facd40f-ca56-49d1-a7d3-a974384df061 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:43.107183 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 877/1769] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:43.131391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028351d5-2a80-478c-8be0-b450dcbe1969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:43.138537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028351d5-2a80-478c-8be0-b450dcbe1969 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:43.142605 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028351d5-2a80-478c-8be0-b450dcbe1969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:43.142605 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028351d5-2a80-478c-8be0-b450dcbe1969 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:43.146375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028351d5-2a80-478c-8be0-b450dcbe1969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:43.154414 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028351d5-2a80-478c-8be0-b450dcbe1969 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:43.164653 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:43.346398 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 893/1770] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:43 2022] POST /identity/v3/projects => generated 381 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:43.347731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f156adc-cbe5-451d-b85f-9cb83cd982dd service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:43.385571 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f156adc-cbe5-451d-b85f-9cb83cd982dd service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:43.592379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e905f-61e2-4750-b5e3-c301778163d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:43.593041 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e905f-61e2-4750-b5e3-c301778163d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:43.598689 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e905f-61e2-4750-b5e3-c301778163d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:43.598944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e905f-61e2-4750-b5e3-c301778163d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:43.606664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e905f-61e2-4750-b5e3-c301778163d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:43.608921 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e905f-61e2-4750-b5e3-c301778163d0 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:43.790498 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 878/1771] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:43 2022] POST /identity/v3/users => generated 291 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:43.796379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028351d5-2a80-478c-8be0-b450dcbe1969 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:43.844121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028351d5-2a80-478c-8be0-b450dcbe1969 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:43.883545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f93b12-0712-4afc-8916-17ff6eba650a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:43.911925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f93b12-0712-4afc-8916-17ff6eba650a admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:43.919107 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f93b12-0712-4afc-8916-17ff6eba650a admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:43.930400 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f93b12-0712-4afc-8916-17ff6eba650a admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:43.956952 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f93b12-0712-4afc-8916-17ff6eba650a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:43.973297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f93b12-0712-4afc-8916-17ff6eba650a admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:44.001370 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:44.033987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 894/1772] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:44.038035 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e905f-61e2-4750-b5e3-c301778163d0 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:44.059986 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e905f-61e2-4750-b5e3-c301778163d0 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:44.085711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9c6ee-4e01-4a83-bf67-8f7e10af2d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:44.087745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9c6ee-4e01-4a83-bf67-8f7e10af2d45 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:44.088032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9c6ee-4e01-4a83-bf67-8f7e10af2d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:44.089204 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9c6ee-4e01-4a83-bf67-8f7e10af2d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:44.089204 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9c6ee-4e01-4a83-bf67-8f7e10af2d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:44.090744 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9c6ee-4e01-4a83-bf67-8f7e10af2d45 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:44.129026 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 879/1773] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:44.130350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f93b12-0712-4afc-8916-17ff6eba650a admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:44.151708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f93b12-0712-4afc-8916-17ff6eba650a admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:44.168719 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873ebcd-3b83-41ee-a7cb-aceda405dbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:44.407163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873ebcd-3b83-41ee-a7cb-aceda405dbf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:44.407163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873ebcd-3b83-41ee-a7cb-aceda405dbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:44.407163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873ebcd-3b83-41ee-a7cb-aceda405dbf8 admin admin] PATH_INFO: `/v3/projects/6a3dc3a0f618476aa098e2a96aecaa58/users/116e998b634d46e980f31b1e7fac958d/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:44.407163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873ebcd-3b83-41ee-a7cb-aceda405dbf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a3dc3a0f618476aa098e2a96aecaa58, user_id=116e998b634d46e980f31b1e7fac958d, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:44.407163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873ebcd-3b83-41ee-a7cb-aceda405dbf8 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:44.625333 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 895/1774] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:44 2022] PUT /identity/v3/projects/6a3dc3a0f618476aa098e2a96aecaa58/users/116e998b634d46e980f31b1e7fac958d/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:44.649548 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd3a1b-5dc5-465f-82eb-69c01d7c49b7 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:44.650548 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd3a1b-5dc5-465f-82eb-69c01d7c49b7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:44.650996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd3a1b-5dc5-465f-82eb-69c01d7c49b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:44.693583 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-64cd3a1b-5dc5-465f-82eb-69c01d7c49b7 None None] MFA Rules not processed for user `116e998b634d46e980f31b1e7fac958d`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:44.696380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-64cd3a1b-5dc5-465f-82eb-69c01d7c49b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:44.868148 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 880/1775] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:44.872696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873ebcd-3b83-41ee-a7cb-aceda405dbf8 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:45.178192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873ebcd-3b83-41ee-a7cb-aceda405dbf8 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:45.204486 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98229e63-5230-41f4-8a1d-a15752b4bde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:45.205472 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98229e63-5230-41f4-8a1d-a15752b4bde9 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:45.205949 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98229e63-5230-41f4-8a1d-a15752b4bde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:45.206415 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98229e63-5230-41f4-8a1d-a15752b4bde9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:45.207410 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98229e63-5230-41f4-8a1d-a15752b4bde9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:45.217291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98229e63-5230-41f4-8a1d-a15752b4bde9 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:45.316504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:45.402502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 896/1776] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:44 2022] POST /identity/v3/projects => generated 379 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:45.407607 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd3a1b-5dc5-465f-82eb-69c01d7c49b7 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:45.446617 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd3a1b-5dc5-465f-82eb-69c01d7c49b7 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:45.677679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2027c48-abe0-45e3-997c-5352c5df222d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:45.685237 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2027c48-abe0-45e3-997c-5352c5df222d admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:45.689130 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2027c48-abe0-45e3-997c-5352c5df222d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:45.689807 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2027c48-abe0-45e3-997c-5352c5df222d admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:45.690720 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2027c48-abe0-45e3-997c-5352c5df222d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:45.694757 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2027c48-abe0-45e3-997c-5352c5df222d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:45.888222 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 881/1777] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:45 2022] POST /identity/v3/users => generated 296 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:45.892179 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98229e63-5230-41f4-8a1d-a15752b4bde9 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:45.912618 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98229e63-5230-41f4-8a1d-a15752b4bde9 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:45.930551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc737f-c5b9-48a8-93d1-1f0eed80c434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:45.930551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc737f-c5b9-48a8-93d1-1f0eed80c434 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:45.930551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc737f-c5b9-48a8-93d1-1f0eed80c434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:45.935368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc737f-c5b9-48a8-93d1-1f0eed80c434 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:45.936198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc737f-c5b9-48a8-93d1-1f0eed80c434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:45.942329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc737f-c5b9-48a8-93d1-1f0eed80c434 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:45.949687 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2027c48-abe0-45e3-997c-5352c5df222d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:45.959996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c2027c48-abe0-45e3-997c-5352c5df222d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:45.983291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 897/1778] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:45.983291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc737f-c5b9-48a8-93d1-1f0eed80c434 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:45.991647 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2027c48-abe0-45e3-997c-5352c5df222d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:46.018364 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10dfe4-7bf2-4908-9e86-9b95ec8481a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:46.019391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc737f-c5b9-48a8-93d1-1f0eed80c434 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:46.019720 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10dfe4-7bf2-4908-9e86-9b95ec8481a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:46.020331 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10dfe4-7bf2-4908-9e86-9b95ec8481a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:46.020818 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10dfe4-7bf2-4908-9e86-9b95ec8481a7 admin admin] PATH_INFO: `/v3/users/f352a6f14c0f4975a017d37f92578940` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:46.022374 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10dfe4-7bf2-4908-9e86-9b95ec8481a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f352a6f14c0f4975a017d37f92578940)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:46.025074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10dfe4-7bf2-4908-9e86-9b95ec8481a7 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:46.037052 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106ac96-6b57-4608-b657-7f04bed0ba34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:46.037052 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106ac96-6b57-4608-b657-7f04bed0ba34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:46.037052 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106ac96-6b57-4608-b657-7f04bed0ba34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:46.037052 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106ac96-6b57-4608-b657-7f04bed0ba34 admin admin] PATH_INFO: `/v3/projects/c7a0da3b609e4f6a892d5a4a42c60a8a/users/08b909a96fb14f209899149719cf2667/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:46.081995 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1106ac96-6b57-4608-b657-7f04bed0ba34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a0da3b609e4f6a892d5a4a42c60a8a, user_id=08b909a96fb14f209899149719cf2667, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:46.087721 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1106ac96-6b57-4608-b657-7f04bed0ba34 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:46.222649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 898/1779] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:45 2022] PUT /identity/v3/projects/c7a0da3b609e4f6a892d5a4a42c60a8a/users/08b909a96fb14f209899149719cf2667/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:46.227314 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106ac96-6b57-4608-b657-7f04bed0ba34 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:46.377497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:46.419690 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ec10dfe4-7bf2-4908-9e86-9b95ec8481a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f352a6f14c0f4975a017d37f92578940'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:46.419690 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ec10dfe4-7bf2-4908-9e86-9b95ec8481a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f352a6f14c0f4975a017d37f92578940'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:46.431220 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106ac96-6b57-4608-b657-7f04bed0ba34 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:46.461567 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403792c-ab76-4e4b-9072-b808c4d11e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:46.462328 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403792c-ab76-4e4b-9072-b808c4d11e61 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:46.462501 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403792c-ab76-4e4b-9072-b808c4d11e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:46.462970 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403792c-ab76-4e4b-9072-b808c4d11e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:46.463730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403792c-ab76-4e4b-9072-b808c4d11e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:46.472586 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403792c-ab76-4e4b-9072-b808c4d11e61 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:46.511053 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ec10dfe4-7bf2-4908-9e86-9b95ec8481a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f352a6f14c0f4975a017d37f92578940'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:46.518463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 899/1780] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:46.519813 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638615e-eee9-43f4-a5f6-304780e4a9cc None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:46.520111 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638615e-eee9-43f4-a5f6-304780e4a9cc None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:46.520396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638615e-eee9-43f4-a5f6-304780e4a9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:46.572659 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-2638615e-eee9-43f4-a5f6-304780e4a9cc None None] MFA Rules not processed for user `91402fce003f49cf9b3cb3c170fbed71`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:46.573923 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2638615e-eee9-43f4-a5f6-304780e4a9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:46.580135 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ec10dfe4-7bf2-4908-9e86-9b95ec8481a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f352a6f14c0f4975a017d37f92578940'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:46.581048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ec10dfe4-7bf2-4908-9e86-9b95ec8481a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f352a6f14c0f4975a017d37f92578940'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:46.614397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 882/1781] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:45:45 2022] DELETE /identity/v3/users/f352a6f14c0f4975a017d37f92578940 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:45:46.614397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10dfe4-7bf2-4908-9e86-9b95ec8481a7 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:46.619783 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ec10dfe4-7bf2-4908-9e86-9b95ec8481a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:46.934199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 900/1782] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:46.947892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ad196-dbc3-43ba-b4a5-5d50c31d637b None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:46.948351 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ad196-dbc3-43ba-b4a5-5d50c31d637b None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:46.948471 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ad196-dbc3-43ba-b4a5-5d50c31d637b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:46.986295 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10dfe4-7bf2-4908-9e86-9b95ec8481a7 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:47.009522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-415ad196-dbc3-43ba-b4a5-5d50c31d637b None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:47.010864 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-415ad196-dbc3-43ba-b4a5-5d50c31d637b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:47.030549 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64600d53-4b2d-4163-b3de-39817ea6ee8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:47.034801 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64600d53-4b2d-4163-b3de-39817ea6ee8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:47.034801 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64600d53-4b2d-4163-b3de-39817ea6ee8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:47.034801 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64600d53-4b2d-4163-b3de-39817ea6ee8e admin admin] PATH_INFO: `/v3/projects/c7a0da3b609e4f6a892d5a4a42c60a8a/users/08b909a96fb14f209899149719cf2667/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:47.047597 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64600d53-4b2d-4163-b3de-39817ea6ee8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a0da3b609e4f6a892d5a4a42c60a8a, user_id=08b909a96fb14f209899149719cf2667, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:47.055699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 901/1783] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:47.059415 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64600d53-4b2d-4163-b3de-39817ea6ee8e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:47.136494 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 883/1784] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:46 2022] PUT /identity/v3/projects/c7a0da3b609e4f6a892d5a4a42c60a8a/users/08b909a96fb14f209899149719cf2667/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:47.148529 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee44db9-b857-404a-a593-ef3db2837310 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:47.148788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee44db9-b857-404a-a593-ef3db2837310 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:47.149258 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee44db9-b857-404a-a593-ef3db2837310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:47.225182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-9ee44db9-b857-404a-a593-ef3db2837310 None None] MFA Rules not processed for user `08b909a96fb14f209899149719cf2667`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:47.226704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-9ee44db9-b857-404a-a593-ef3db2837310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:47.267543 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a9974-81a0-403e-a848-bd08fbd4df99 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:47.268141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a9974-81a0-403e-a848-bd08fbd4df99 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:47.268565 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a9974-81a0-403e-a848-bd08fbd4df99 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:47.270617 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 884/1785] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 18:45:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:45:47.289291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a9974-81a0-403e-a848-bd08fbd4df99 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:47.291989 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ba4a9974-81a0-403e-a848-bd08fbd4df99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:47.440454 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 902/1786] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:47.440454 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3ebd9-e03b-409c-a7a4-17b530851fdf None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:47.440886 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3ebd9-e03b-409c-a7a4-17b530851fdf None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:47.441354 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3ebd9-e03b-409c-a7a4-17b530851fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:47.468232 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-19c3ebd9-e03b-409c-a7a4-17b530851fdf None None] MFA Rules not processed for user `be769d4dd016466f9174e7d5e47a2a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:47.469883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-19c3ebd9-e03b-409c-a7a4-17b530851fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:47.488790 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a9974-81a0-403e-a848-bd08fbd4df99 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:47.488790 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586346e-1c05-4ef0-8cde-7b6f0d064fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:47.488790 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586346e-1c05-4ef0-8cde-7b6f0d064fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:47.507934 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586346e-1c05-4ef0-8cde-7b6f0d064fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:47.509166 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586346e-1c05-4ef0-8cde-7b6f0d064fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:47.712820 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586346e-1c05-4ef0-8cde-7b6f0d064fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:47.716490 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586346e-1c05-4ef0-8cde-7b6f0d064fa1 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:47.741122 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 885/1787] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:45:47.745845 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586346e-1c05-4ef0-8cde-7b6f0d064fa1 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:47.753363 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4586346e-1c05-4ef0-8cde-7b6f0d064fa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:47.789115 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 903/1788] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 18:45:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:47.808125 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:47.878531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586346e-1c05-4ef0-8cde-7b6f0d064fa1 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:47.895320 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ac5f5-139c-4242-b5f2-5c4f372ccfdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:47.896831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ac5f5-139c-4242-b5f2-5c4f372ccfdd service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:47.897233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ac5f5-139c-4242-b5f2-5c4f372ccfdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:47.897617 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ac5f5-139c-4242-b5f2-5c4f372ccfdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:47.952256 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ac5f5-139c-4242-b5f2-5c4f372ccfdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:47.955129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ac5f5-139c-4242-b5f2-5c4f372ccfdd service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:47.989957 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 886/1789] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:48.016442 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:49.325561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3ebd9-e03b-409c-a7a4-17b530851fdf None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:49.328954 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-19c3ebd9-e03b-409c-a7a4-17b530851fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:49.364829 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3ebd9-e03b-409c-a7a4-17b530851fdf None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:49.377189 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6a475-6534-4e33-84e0-320adf763b90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:49.379088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6a475-6534-4e33-84e0-320adf763b90 service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:49.379951 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6a475-6534-4e33-84e0-320adf763b90 service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:49.380603 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6a475-6534-4e33-84e0-320adf763b90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:49.401769 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6a475-6534-4e33-84e0-320adf763b90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:49.404955 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6a475-6534-4e33-84e0-320adf763b90 service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:49.438261 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 904/1790] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:49.554759 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ac5f5-139c-4242-b5f2-5c4f372ccfdd service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:49.568009 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:49.577464 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ac5f5-139c-4242-b5f2-5c4f372ccfdd service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:49.595616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9eb550-7290-4b42-af7c-e3851d561a4b tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b909a96fb14f209899149719cf2667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a0da3b609e4f6a892d5a4a42c60a8a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:49.597862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9eb550-7290-4b42-af7c-e3851d561a4b tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:49.598740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9eb550-7290-4b42-af7c-e3851d561a4b tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:49.601018 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9eb550-7290-4b42-af7c-e3851d561a4b tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:49.604615 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9eb550-7290-4b42-af7c-e3851d561a4b tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:45:49.605229 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9eb550-7290-4b42-af7c-e3851d561a4b tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:49.610235 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9eb550-7290-4b42-af7c-e3851d561a4b tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:49.663112 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 887/1791] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:45:49.665535 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6a475-6534-4e33-84e0-320adf763b90 service nova] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:49.695717 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6a475-6534-4e33-84e0-320adf763b90 service nova] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:49.741359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc748b8-5793-40f4-bd12-912040404e69 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b909a96fb14f209899149719cf2667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a0da3b609e4f6a892d5a4a42c60a8a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:49.742022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc748b8-5793-40f4-bd12-912040404e69 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:49.742390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc748b8-5793-40f4-bd12-912040404e69 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:49.742679 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc748b8-5793-40f4-bd12-912040404e69 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:49.743398 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc748b8-5793-40f4-bd12-912040404e69 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:49.745348 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc748b8-5793-40f4-bd12-912040404e69 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:49.988415 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 905/1792] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:49 2022] POST /identity/v3/projects => generated 355 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:49.992238 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9eb550-7290-4b42-af7c-e3851d561a4b tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:50.017172 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9eb550-7290-4b42-af7c-e3851d561a4b tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:50.138473 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:50.237624 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b07683-f4b2-4eca-902b-2926dbda7c77 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b909a96fb14f209899149719cf2667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a0da3b609e4f6a892d5a4a42c60a8a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:50.244272 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b07683-f4b2-4eca-902b-2926dbda7c77 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:50.245081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b07683-f4b2-4eca-902b-2926dbda7c77 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:50.247249 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b07683-f4b2-4eca-902b-2926dbda7c77 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:50.249707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b07683-f4b2-4eca-902b-2926dbda7c77 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:45:50.254224 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b07683-f4b2-4eca-902b-2926dbda7c77 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:50.257861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b07683-f4b2-4eca-902b-2926dbda7c77 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:50.306774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 888/1793] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:45:50.456021 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc748b8-5793-40f4-bd12-912040404e69 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:50.465743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc748b8-5793-40f4-bd12-912040404e69 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:50.487953 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b07683-f4b2-4eca-902b-2926dbda7c77 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:50.491368 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-96b07683-f4b2-4eca-902b-2926dbda7c77 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:50.493498 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf9492-21ac-44d0-8f05-22c4866b5681 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b909a96fb14f209899149719cf2667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a0da3b609e4f6a892d5a4a42c60a8a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:50.494164 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf9492-21ac-44d0-8f05-22c4866b5681 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:50.494444 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf9492-21ac-44d0-8f05-22c4866b5681 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:50.495444 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf9492-21ac-44d0-8f05-22c4866b5681 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] PATH_INFO: `/v3/projects/9e2c50783e3b445db0efb6c4d7f2d45a` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:50.506370 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf9492-21ac-44d0-8f05-22c4866b5681 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9e2c50783e3b445db0efb6c4d7f2d45a)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:50.518690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf9492-21ac-44d0-8f05-22c4866b5681 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:50.656228 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b07683-f4b2-4eca-902b-2926dbda7c77 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:50.663514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1388d43-3081-403c-8626-30abb3879fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:50.665348 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1388d43-3081-403c-8626-30abb3879fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:50.665635 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1388d43-3081-403c-8626-30abb3879fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:50.665998 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1388d43-3081-403c-8626-30abb3879fb5 admin admin] PATH_INFO: `/v3/users/3b8f68b5dd9e46629c63e8bb3c098695` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:50.667740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1388d43-3081-403c-8626-30abb3879fb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b8f68b5dd9e46629c63e8bb3c098695)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:50.673929 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1388d43-3081-403c-8626-30abb3879fb5 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:50.725858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4ebf9492-21ac-44d0-8f05-22c4866b5681 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e2c50783e3b445db0efb6c4d7f2d45a', 'request_id': 'req-4ebf9492-21ac-44d0-8f05-22c4866b5681'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:50.741598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4ebf9492-21ac-44d0-8f05-22c4866b5681 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e2c50783e3b445db0efb6c4d7f2d45a', 'request_id': 'req-4ebf9492-21ac-44d0-8f05-22c4866b5681'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:50.913439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4ebf9492-21ac-44d0-8f05-22c4866b5681 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e2c50783e3b445db0efb6c4d7f2d45a', 'request_id': 'req-4ebf9492-21ac-44d0-8f05-22c4866b5681'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:50.949021 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4ebf9492-21ac-44d0-8f05-22c4866b5681 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] The token cache is being invalidate because project 9e2c50783e3b445db0efb6c4d7f2d45a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:45:50.949315 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4ebf9492-21ac-44d0-8f05-22c4866b5681 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:50.950244 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4ebf9492-21ac-44d0-8f05-22c4866b5681 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:50.953900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 906/1794] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:45:50 2022] DELETE /identity/v3/projects/9e2c50783e3b445db0efb6c4d7f2d45a => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:50.955032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf9492-21ac-44d0-8f05-22c4866b5681 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:50.958500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4ebf9492-21ac-44d0-8f05-22c4866b5681 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:51.113117 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c1388d43-3081-403c-8626-30abb3879fb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b8f68b5dd9e46629c63e8bb3c098695'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:51.117544 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c1388d43-3081-403c-8626-30abb3879fb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b8f68b5dd9e46629c63e8bb3c098695'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:51.147497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf9492-21ac-44d0-8f05-22c4866b5681 tempest-VolumeQuotaClassesTest-436907687 tempest-VolumeQuotaClassesTest-436907687-project-admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:51.167622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcd8ae-cb83-4b4b-81f2-af65120815f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:51.180070 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcd8ae-cb83-4b4b-81f2-af65120815f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:51.180070 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcd8ae-cb83-4b4b-81f2-af65120815f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:51.180070 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcd8ae-cb83-4b4b-81f2-af65120815f6 admin admin] PATH_INFO: `/v3/projects/d816e21ffa944ca28ce5f228b4210422` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:51.180070 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcd8ae-cb83-4b4b-81f2-af65120815f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d816e21ffa944ca28ce5f228b4210422)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:51.180070 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcd8ae-cb83-4b4b-81f2-af65120815f6 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:51.290928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c1388d43-3081-403c-8626-30abb3879fb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b8f68b5dd9e46629c63e8bb3c098695'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:51.339567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c1388d43-3081-403c-8626-30abb3879fb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b8f68b5dd9e46629c63e8bb3c098695'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:51.340776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c1388d43-3081-403c-8626-30abb3879fb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b8f68b5dd9e46629c63e8bb3c098695'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:51.350699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:51.372886 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 889/1795] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:45:50 2022] DELETE /identity/v3/users/3b8f68b5dd9e46629c63e8bb3c098695 => generated 0 bytes in 882 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:51.376897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd1fec-4437-4919-a894-9584162aaab8 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:51.377267 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd1fec-4437-4919-a894-9584162aaab8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:51.377650 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd1fec-4437-4919-a894-9584162aaab8 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:51.379687 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 890/1796] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 18:45:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:45:51.381878 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bf104-5267-4de9-8d24-747c91cd3c26 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:51.382424 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bf104-5267-4de9-8d24-747c91cd3c26 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:51.382996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bf104-5267-4de9-8d24-747c91cd3c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:51.421151 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-700bf104-5267-4de9-8d24-747c91cd3c26 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:51.424629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-700bf104-5267-4de9-8d24-747c91cd3c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:51.490004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-cadcd8ae-cb83-4b4b-81f2-af65120815f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd816e21ffa944ca28ce5f228b4210422', 'request_id': 'req-cadcd8ae-cb83-4b4b-81f2-af65120815f6'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:51.510260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-cadcd8ae-cb83-4b4b-81f2-af65120815f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd816e21ffa944ca28ce5f228b4210422', 'request_id': 'req-cadcd8ae-cb83-4b4b-81f2-af65120815f6'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:51.604323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 891/1797] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:51.607311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f76885-08d7-4f7a-8757-5ea1d9cb85af None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:51.607916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f76885-08d7-4f7a-8757-5ea1d9cb85af None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:51.608517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f76885-08d7-4f7a-8757-5ea1d9cb85af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:51.621188 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-cadcd8ae-cb83-4b4b-81f2-af65120815f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd816e21ffa944ca28ce5f228b4210422', 'request_id': 'req-cadcd8ae-cb83-4b4b-81f2-af65120815f6'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:51.645198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-cadcd8ae-cb83-4b4b-81f2-af65120815f6 admin admin] The token cache is being invalidate because project d816e21ffa944ca28ce5f228b4210422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:45:51.645626 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-cadcd8ae-cb83-4b4b-81f2-af65120815f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:51.647896 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a8f76885-08d7-4f7a-8757-5ea1d9cb85af None None] MFA Rules not processed for user `be769d4dd016466f9174e7d5e47a2a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:51.648666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-cadcd8ae-cb83-4b4b-81f2-af65120815f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:51.649286 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a8f76885-08d7-4f7a-8757-5ea1d9cb85af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:51.656574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 907/1798] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:45:50 2022] DELETE /identity/v3/projects/d816e21ffa944ca28ce5f228b4210422 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:51.658305 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcd8ae-cb83-4b4b-81f2-af65120815f6 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:51.660820 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-cadcd8ae-cb83-4b4b-81f2-af65120815f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:51.903374 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 892/1799] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 18:45:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:51.904293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f76885-08d7-4f7a-8757-5ea1d9cb85af None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:51.907129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a8f76885-08d7-4f7a-8757-5ea1d9cb85af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:51.925566 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcd8ae-cb83-4b4b-81f2-af65120815f6 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:51.959809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4effb1-712b-474d-8ac3-d58023d14ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:51.961922 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4effb1-712b-474d-8ac3-d58023d14ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:51.963698 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4effb1-712b-474d-8ac3-d58023d14ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:51.965088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4effb1-712b-474d-8ac3-d58023d14ce2 admin admin] PATH_INFO: `/v3/users/10c6abed030346d59758f315d005c361` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:51.977548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4effb1-712b-474d-8ac3-d58023d14ce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c6abed030346d59758f315d005c361)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:51.980065 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4effb1-712b-474d-8ac3-d58023d14ce2 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:52.049865 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f76885-08d7-4f7a-8757-5ea1d9cb85af None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:52.054323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f69a30-0322-401a-93ce-9e82fd18e0a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:52.054967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f69a30-0322-401a-93ce-9e82fd18e0a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:52.055314 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f69a30-0322-401a-93ce-9e82fd18e0a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:52.055704 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f69a30-0322-401a-93ce-9e82fd18e0a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:52.058794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-42f69a30-0322-401a-93ce-9e82fd18e0a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:52.090073 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f69a30-0322-401a-93ce-9e82fd18e0a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:52.090073 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f69a30-0322-401a-93ce-9e82fd18e0a3 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:52.100673 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 893/1800] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:52.102753 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f69a30-0322-401a-93ce-9e82fd18e0a3 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:52.106792 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-42f69a30-0322-401a-93ce-9e82fd18e0a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:52.138120 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f69a30-0322-401a-93ce-9e82fd18e0a3 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:52.145679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765870c-d179-4628-af0a-60389c83c704 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:52.146361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765870c-d179-4628-af0a-60389c83c704 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:52.146652 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765870c-d179-4628-af0a-60389c83c704 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:52.147223 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765870c-d179-4628-af0a-60389c83c704 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:52.166061 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765870c-d179-4628-af0a-60389c83c704 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:52.169397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765870c-d179-4628-af0a-60389c83c704 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:52.199545 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 894/1801] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:52.209784 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765870c-d179-4628-af0a-60389c83c704 service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:52.209784 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4765870c-d179-4628-af0a-60389c83c704 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:52.246396 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765870c-d179-4628-af0a-60389c83c704 service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:52.261632 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3d68b-9e5a-468c-b647-3293fe9fabfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:52.261632 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3d68b-9e5a-468c-b647-3293fe9fabfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:52.261632 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3d68b-9e5a-468c-b647-3293fe9fabfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:52.261632 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3d68b-9e5a-468c-b647-3293fe9fabfc admin admin] PATH_INFO: `/v3/users/116e998b634d46e980f31b1e7fac958d` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:52.262971 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3d68b-9e5a-468c-b647-3293fe9fabfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=116e998b634d46e980f31b1e7fac958d)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:52.266606 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3d68b-9e5a-468c-b647-3293fe9fabfc admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:52.342341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ae4effb1-712b-474d-8ac3-d58023d14ce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c6abed030346d59758f315d005c361'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:52.351905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ae4effb1-712b-474d-8ac3-d58023d14ce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c6abed030346d59758f315d005c361'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:52.464177 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ae4effb1-712b-474d-8ac3-d58023d14ce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c6abed030346d59758f315d005c361'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:52.551090 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ae4effb1-712b-474d-8ac3-d58023d14ce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c6abed030346d59758f315d005c361'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:52.565206 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ae4effb1-712b-474d-8ac3-d58023d14ce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c6abed030346d59758f315d005c361'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:52.572546 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 908/1802] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:45:51 2022] DELETE /identity/v3/users/10c6abed030346d59758f315d005c361 => generated 0 bytes in 915 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:52.579539 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:52.580388 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-40b3d68b-9e5a-468c-b647-3293fe9fabfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '116e998b634d46e980f31b1e7fac958d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:52.581682 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-40b3d68b-9e5a-468c-b647-3293fe9fabfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '116e998b634d46e980f31b1e7fac958d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:52.684598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-40b3d68b-9e5a-468c-b647-3293fe9fabfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '116e998b634d46e980f31b1e7fac958d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:52.709236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-40b3d68b-9e5a-468c-b647-3293fe9fabfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '116e998b634d46e980f31b1e7fac958d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:52.711936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-40b3d68b-9e5a-468c-b647-3293fe9fabfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '116e998b634d46e980f31b1e7fac958d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:52.766802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 895/1803] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:45:52 2022] DELETE /identity/v3/users/116e998b634d46e980f31b1e7fac958d => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:52.769925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fa7f1-e33a-4445-90c1-ab28d47f3f43 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:52.770713 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fa7f1-e33a-4445-90c1-ab28d47f3f43 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:52.771419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fa7f1-e33a-4445-90c1-ab28d47f3f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:52.815659 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-c68fa7f1-e33a-4445-90c1-ab28d47f3f43 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:52.817368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c68fa7f1-e33a-4445-90c1-ab28d47f3f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:52.941216 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 909/1804] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:53.009123 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3d68b-9e5a-468c-b647-3293fe9fabfc admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:53.011741 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-40b3d68b-9e5a-468c-b647-3293fe9fabfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:53.225814 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3d68b-9e5a-468c-b647-3293fe9fabfc admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:53.250606 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda416a-2704-4b27-933f-1a0ff8a7b312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:53.254035 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda416a-2704-4b27-933f-1a0ff8a7b312 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:53.254035 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda416a-2704-4b27-933f-1a0ff8a7b312 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:53.254035 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda416a-2704-4b27-933f-1a0ff8a7b312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:53.278303 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda416a-2704-4b27-933f-1a0ff8a7b312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:53.280185 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda416a-2704-4b27-933f-1a0ff8a7b312 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:53.308098 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 896/1805] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:53.802320 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:53.894051 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fa7f1-e33a-4445-90c1-ab28d47f3f43 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:53.895667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c68fa7f1-e33a-4445-90c1-ab28d47f3f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:53.916880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fa7f1-e33a-4445-90c1-ab28d47f3f43 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:53.924683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d3dd4-f09f-4295-9f05-817d6a0360c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:53.925489 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d3dd4-f09f-4295-9f05-817d6a0360c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:53.925874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d3dd4-f09f-4295-9f05-817d6a0360c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:53.926251 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d3dd4-f09f-4295-9f05-817d6a0360c8 admin admin] PATH_INFO: `/v3/projects/88970991f2b14188b0cad25ac3abd588` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:53.927799 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d3dd4-f09f-4295-9f05-817d6a0360c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88970991f2b14188b0cad25ac3abd588)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:53.929878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d3dd4-f09f-4295-9f05-817d6a0360c8 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:54.016202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda416a-2704-4b27-933f-1a0ff8a7b312 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:54.018049 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7eda416a-2704-4b27-933f-1a0ff8a7b312 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:54.047311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda416a-2704-4b27-933f-1a0ff8a7b312 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:54.071771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acfc61-5b7c-4599-8825-b8c197a91365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:54.072642 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acfc61-5b7c-4599-8825-b8c197a91365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:54.076158 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acfc61-5b7c-4599-8825-b8c197a91365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:54.076158 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acfc61-5b7c-4599-8825-b8c197a91365 admin admin] PATH_INFO: `/v3/projects/c56fb6d4296e426faa47777b948afc2d` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:54.081842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acfc61-5b7c-4599-8825-b8c197a91365 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c56fb6d4296e426faa47777b948afc2d)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:54.084729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acfc61-5b7c-4599-8825-b8c197a91365 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:54.088921 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-964d3dd4-f09f-4295-9f05-817d6a0360c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88970991f2b14188b0cad25ac3abd588', 'request_id': 'req-964d3dd4-f09f-4295-9f05-817d6a0360c8'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:54.097316 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-964d3dd4-f09f-4295-9f05-817d6a0360c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88970991f2b14188b0cad25ac3abd588', 'request_id': 'req-964d3dd4-f09f-4295-9f05-817d6a0360c8'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:54.188302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-964d3dd4-f09f-4295-9f05-817d6a0360c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88970991f2b14188b0cad25ac3abd588', 'request_id': 'req-964d3dd4-f09f-4295-9f05-817d6a0360c8'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:54.227108 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-964d3dd4-f09f-4295-9f05-817d6a0360c8 admin admin] The token cache is being invalidate because project 88970991f2b14188b0cad25ac3abd588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:45:54.227415 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-964d3dd4-f09f-4295-9f05-817d6a0360c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:54.238068 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-964d3dd4-f09f-4295-9f05-817d6a0360c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:54.241673 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 910/1806] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:45:53 2022] DELETE /identity/v3/projects/88970991f2b14188b0cad25ac3abd588 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:54.247719 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33beb4-f2f4-4062-bb33-bce5e950f4b1 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:54.248088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33beb4-f2f4-4062-bb33-bce5e950f4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:54.248439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33beb4-f2f4-4062-bb33-bce5e950f4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:54.290408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c8acfc61-5b7c-4599-8825-b8c197a91365 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c56fb6d4296e426faa47777b948afc2d', 'request_id': 'req-c8acfc61-5b7c-4599-8825-b8c197a91365'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:54.300296 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-2e33beb4-f2f4-4062-bb33-bce5e950f4b1 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:54.301750 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2e33beb4-f2f4-4062-bb33-bce5e950f4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:54.327009 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c8acfc61-5b7c-4599-8825-b8c197a91365 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c56fb6d4296e426faa47777b948afc2d', 'request_id': 'req-c8acfc61-5b7c-4599-8825-b8c197a91365'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:54.432784 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c8acfc61-5b7c-4599-8825-b8c197a91365 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c56fb6d4296e426faa47777b948afc2d', 'request_id': 'req-c8acfc61-5b7c-4599-8825-b8c197a91365'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:54.456968 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c8acfc61-5b7c-4599-8825-b8c197a91365 admin admin] The token cache is being invalidate because project c56fb6d4296e426faa47777b948afc2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:45:54.457329 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c8acfc61-5b7c-4599-8825-b8c197a91365 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:54.458097 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-c8acfc61-5b7c-4599-8825-b8c197a91365 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:54.460759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 911/1808] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:54.465637 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33beb4-f2f4-4062-bb33-bce5e950f4b1 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:54.465925 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 897/1808] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:45:54 2022] DELETE /identity/v3/projects/c56fb6d4296e426faa47777b948afc2d => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:54.466014 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2e33beb4-f2f4-4062-bb33-bce5e950f4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:54.466087 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acfc61-5b7c-4599-8825-b8c197a91365 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:54.467252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c8acfc61-5b7c-4599-8825-b8c197a91365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:54.486958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33beb4-f2f4-4062-bb33-bce5e950f4b1 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:54.493490 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ae200-4091-4c5c-83b9-d287e7990717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:54.494310 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ae200-4091-4c5c-83b9-d287e7990717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:54.494756 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acfc61-5b7c-4599-8825-b8c197a91365 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:54.501124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ae200-4091-4c5c-83b9-d287e7990717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:54.501529 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ae200-4091-4c5c-83b9-d287e7990717 admin admin] PATH_INFO: `/v3/projects/6a3dc3a0f618476aa098e2a96aecaa58` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:54.502864 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ae200-4091-4c5c-83b9-d287e7990717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a3dc3a0f618476aa098e2a96aecaa58)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:54.503811 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2a643-e9f8-483f-bbd2-5effd2d5a149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:54.504638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2a643-e9f8-483f-bbd2-5effd2d5a149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:54.504867 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ae200-4091-4c5c-83b9-d287e7990717 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:54.505237 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2a643-e9f8-483f-bbd2-5effd2d5a149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:54.505731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2a643-e9f8-483f-bbd2-5effd2d5a149 admin admin] PATH_INFO: `/v3/users/b2b18ccbb17d43aca0cdab226b122fa6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:54.511667 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2a643-e9f8-483f-bbd2-5effd2d5a149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2b18ccbb17d43aca0cdab226b122fa6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:54.515864 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2a643-e9f8-483f-bbd2-5effd2d5a149 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:54.751393 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2fc2a643-e9f8-483f-bbd2-5effd2d5a149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2b18ccbb17d43aca0cdab226b122fa6'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:54.751582 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-327ae200-4091-4c5c-83b9-d287e7990717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a3dc3a0f618476aa098e2a96aecaa58', 'request_id': 'req-327ae200-4091-4c5c-83b9-d287e7990717'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:54.756451 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2fc2a643-e9f8-483f-bbd2-5effd2d5a149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2b18ccbb17d43aca0cdab226b122fa6'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:54.760492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-327ae200-4091-4c5c-83b9-d287e7990717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a3dc3a0f618476aa098e2a96aecaa58', 'request_id': 'req-327ae200-4091-4c5c-83b9-d287e7990717'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:54.853183 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-327ae200-4091-4c5c-83b9-d287e7990717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a3dc3a0f618476aa098e2a96aecaa58', 'request_id': 'req-327ae200-4091-4c5c-83b9-d287e7990717'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:54.875140 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-327ae200-4091-4c5c-83b9-d287e7990717 admin admin] The token cache is being invalidate because project 6a3dc3a0f618476aa098e2a96aecaa58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:45:54.876391 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:54.877089 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-327ae200-4091-4c5c-83b9-d287e7990717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:54.878756 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-327ae200-4091-4c5c-83b9-d287e7990717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:54.881317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 912/1809] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:45:54 2022] DELETE /identity/v3/projects/6a3dc3a0f618476aa098e2a96aecaa58 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:54.882823 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4090f1-ad52-43a9-803c-9ed1cd96624f None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:54.883299 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4090f1-ad52-43a9-803c-9ed1cd96624f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:54.883725 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4090f1-ad52-43a9-803c-9ed1cd96624f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:54.910912 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-9e4090f1-ad52-43a9-803c-9ed1cd96624f None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:54.912505 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-9e4090f1-ad52-43a9-803c-9ed1cd96624f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:54.915565 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2fc2a643-e9f8-483f-bbd2-5effd2d5a149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2b18ccbb17d43aca0cdab226b122fa6'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:54.934001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2fc2a643-e9f8-483f-bbd2-5effd2d5a149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2b18ccbb17d43aca0cdab226b122fa6'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:54.934958 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2fc2a643-e9f8-483f-bbd2-5effd2d5a149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2b18ccbb17d43aca0cdab226b122fa6'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:54.969672 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 898/1810] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:45:54 2022] DELETE /identity/v3/users/b2b18ccbb17d43aca0cdab226b122fa6 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:54.969672 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2a643-e9f8-483f-bbd2-5effd2d5a149 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:54.969672 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2fc2a643-e9f8-483f-bbd2-5effd2d5a149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:55.056412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2a643-e9f8-483f-bbd2-5effd2d5a149 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:55.062184 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfc644-7271-425d-a35d-e972813844a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:55.063254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfc644-7271-425d-a35d-e972813844a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:55.063254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfc644-7271-425d-a35d-e972813844a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:55.063664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfc644-7271-425d-a35d-e972813844a4 admin admin] PATH_INFO: `/v3/users/08b909a96fb14f209899149719cf2667` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:55.065017 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfc644-7271-425d-a35d-e972813844a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08b909a96fb14f209899149719cf2667)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:55.067070 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfc644-7271-425d-a35d-e972813844a4 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:55.110569 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 913/1811] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:55.117770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4090f1-ad52-43a9-803c-9ed1cd96624f None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:55.128727 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4090f1-ad52-43a9-803c-9ed1cd96624f None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:55.134507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab737378-ec7a-49bb-9fe3-28683b46537a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:55.135347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab737378-ec7a-49bb-9fe3-28683b46537a admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:55.135715 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab737378-ec7a-49bb-9fe3-28683b46537a admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:55.136023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab737378-ec7a-49bb-9fe3-28683b46537a admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:55.137002 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab737378-ec7a-49bb-9fe3-28683b46537a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:45:55.137361 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab737378-ec7a-49bb-9fe3-28683b46537a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:55.139321 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab737378-ec7a-49bb-9fe3-28683b46537a admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:55.158716 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 914/1812] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:45:55.163435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab737378-ec7a-49bb-9fe3-28683b46537a admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:55.176367 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab737378-ec7a-49bb-9fe3-28683b46537a admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:55.187546 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef03df-48d7-41c7-a457-89d56424735c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:55.188362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef03df-48d7-41c7-a457-89d56424735c admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:55.188653 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef03df-48d7-41c7-a457-89d56424735c admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:55.188933 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef03df-48d7-41c7-a457-89d56424735c admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:55.189744 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef03df-48d7-41c7-a457-89d56424735c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:55.195010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef03df-48d7-41c7-a457-89d56424735c admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:55.288167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-addfc644-7271-425d-a35d-e972813844a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08b909a96fb14f209899149719cf2667'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:55.290003 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-addfc644-7271-425d-a35d-e972813844a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08b909a96fb14f209899149719cf2667'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:55.355299 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 915/1813] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:55 2022] POST /identity/v3/projects => generated 371 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:55.356955 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef03df-48d7-41c7-a457-89d56424735c admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:55.371461 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:55.372483 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-addfc644-7271-425d-a35d-e972813844a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08b909a96fb14f209899149719cf2667'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:55.395291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-addfc644-7271-425d-a35d-e972813844a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08b909a96fb14f209899149719cf2667'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:55.408357 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-addfc644-7271-425d-a35d-e972813844a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08b909a96fb14f209899149719cf2667'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:55.450890 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 899/1814] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:45:54 2022] DELETE /identity/v3/users/08b909a96fb14f209899149719cf2667 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:55.495685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef03df-48d7-41c7-a457-89d56424735c admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:55.624083 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feaaa15-4371-4d0d-b218-66b8933f4bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:55.624788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feaaa15-4371-4d0d-b218-66b8933f4bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:55.625082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feaaa15-4371-4d0d-b218-66b8933f4bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:55.625351 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feaaa15-4371-4d0d-b218-66b8933f4bc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:55.631561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feaaa15-4371-4d0d-b218-66b8933f4bc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:55.635148 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feaaa15-4371-4d0d-b218-66b8933f4bc4 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:55.759197 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfc644-7271-425d-a35d-e972813844a4 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:55.761041 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-addfc644-7271-425d-a35d-e972813844a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:55.780131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfc644-7271-425d-a35d-e972813844a4 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:55.787150 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 916/1815] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:55 2022] POST /identity/v3/users => generated 286 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:45:55.788356 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feaaa15-4371-4d0d-b218-66b8933f4bc4 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:55.790535 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-3feaaa15-4371-4d0d-b218-66b8933f4bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:55.792228 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226417f2-aff8-44e1-abeb-01a1aa6b7522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:55.793229 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226417f2-aff8-44e1-abeb-01a1aa6b7522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:55.793701 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226417f2-aff8-44e1-abeb-01a1aa6b7522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:55.794315 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226417f2-aff8-44e1-abeb-01a1aa6b7522 admin admin] PATH_INFO: `/v3/projects/82f2a24607244083a1f74f90c3cbd477` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:55.796803 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226417f2-aff8-44e1-abeb-01a1aa6b7522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82f2a24607244083a1f74f90c3cbd477)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:55.799522 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226417f2-aff8-44e1-abeb-01a1aa6b7522 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:55.809934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feaaa15-4371-4d0d-b218-66b8933f4bc4 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:55.816418 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295a60a-035f-42a3-98fb-a3dadf7d033a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:55.817203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295a60a-035f-42a3-98fb-a3dadf7d033a admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:55.817490 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295a60a-035f-42a3-98fb-a3dadf7d033a admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:55.817767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295a60a-035f-42a3-98fb-a3dadf7d033a admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:55.818531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295a60a-035f-42a3-98fb-a3dadf7d033a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:55.820737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295a60a-035f-42a3-98fb-a3dadf7d033a admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:55.850753 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 917/1816] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:45:55.851911 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295a60a-035f-42a3-98fb-a3dadf7d033a admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:55.865247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295a60a-035f-42a3-98fb-a3dadf7d033a admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:55.871592 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a4e66-923f-4d6e-aed3-c319a6cc359c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:55.872304 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a4e66-923f-4d6e-aed3-c319a6cc359c admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:55.872583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a4e66-923f-4d6e-aed3-c319a6cc359c admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:55.872868 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a4e66-923f-4d6e-aed3-c319a6cc359c admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:55.873620 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a4e66-923f-4d6e-aed3-c319a6cc359c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:55.876814 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a4e66-923f-4d6e-aed3-c319a6cc359c admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:55.903468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 918/1817] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:55.904625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a4e66-923f-4d6e-aed3-c319a6cc359c admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:55.925629 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a4e66-923f-4d6e-aed3-c319a6cc359c admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:55.931386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75ffca-62c5-4024-a2e0-cca75a5cd1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:55.932610 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75ffca-62c5-4024-a2e0-cca75a5cd1ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:55.933165 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75ffca-62c5-4024-a2e0-cca75a5cd1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:55.933725 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75ffca-62c5-4024-a2e0-cca75a5cd1ba admin admin] PATH_INFO: `/v3/projects/2ab7327b04ee44868046e83b04857fb9/users/e8cb705bbee5471f9cfbf40c2b42b3c2/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:55.950446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75ffca-62c5-4024-a2e0-cca75a5cd1ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab7327b04ee44868046e83b04857fb9, user_id=e8cb705bbee5471f9cfbf40c2b42b3c2, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:55.953905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75ffca-62c5-4024-a2e0-cca75a5cd1ba admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:56.092608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 919/1818] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:55 2022] PUT /identity/v3/projects/2ab7327b04ee44868046e83b04857fb9/users/e8cb705bbee5471f9cfbf40c2b42b3c2/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:56.104746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac064fe5-5ea9-4648-bff9-1864124fc085 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:56.105098 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac064fe5-5ea9-4648-bff9-1864124fc085 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:56.105411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac064fe5-5ea9-4648-bff9-1864124fc085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:56.108063 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-226417f2-aff8-44e1-abeb-01a1aa6b7522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82f2a24607244083a1f74f90c3cbd477', 'request_id': 'req-226417f2-aff8-44e1-abeb-01a1aa6b7522'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:56.121787 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-226417f2-aff8-44e1-abeb-01a1aa6b7522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82f2a24607244083a1f74f90c3cbd477', 'request_id': 'req-226417f2-aff8-44e1-abeb-01a1aa6b7522'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:56.150497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-ac064fe5-5ea9-4648-bff9-1864124fc085 None None] MFA Rules not processed for user `e8cb705bbee5471f9cfbf40c2b42b3c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:56.151801 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ac064fe5-5ea9-4648-bff9-1864124fc085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:56.256382 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-226417f2-aff8-44e1-abeb-01a1aa6b7522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82f2a24607244083a1f74f90c3cbd477', 'request_id': 'req-226417f2-aff8-44e1-abeb-01a1aa6b7522'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:56.256873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 920/1819] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:45:56.258307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac064fe5-5ea9-4648-bff9-1864124fc085 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:56.260647 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ac064fe5-5ea9-4648-bff9-1864124fc085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:56.283333 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-226417f2-aff8-44e1-abeb-01a1aa6b7522 admin admin] The token cache is being invalidate because project 82f2a24607244083a1f74f90c3cbd477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:45:56.283603 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-226417f2-aff8-44e1-abeb-01a1aa6b7522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:56.284541 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-226417f2-aff8-44e1-abeb-01a1aa6b7522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:56.287637 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 900/1820] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:45:55 2022] DELETE /identity/v3/projects/82f2a24607244083a1f74f90c3cbd477 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:45:56.291454 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed51910-2c1e-4bad-b190-657f4b0c8e2c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:56.292040 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed51910-2c1e-4bad-b190-657f4b0c8e2c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:56.292349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed51910-2c1e-4bad-b190-657f4b0c8e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:56.330673 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-2ed51910-2c1e-4bad-b190-657f4b0c8e2c None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:56.332863 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2ed51910-2c1e-4bad-b190-657f4b0c8e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:56.350054 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac064fe5-5ea9-4648-bff9-1864124fc085 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:56.361697 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae55bb9-8e55-471a-8c8a-c404db5959e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:56.362509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae55bb9-8e55-471a-8c8a-c404db5959e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:56.363303 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae55bb9-8e55-471a-8c8a-c404db5959e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:56.363672 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae55bb9-8e55-471a-8c8a-c404db5959e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:56.365584 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5ae55bb9-8e55-471a-8c8a-c404db5959e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:56.381140 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae55bb9-8e55-471a-8c8a-c404db5959e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:56.382848 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae55bb9-8e55-471a-8c8a-c404db5959e0 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:56.398200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 921/1821] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:56.400405 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae55bb9-8e55-471a-8c8a-c404db5959e0 service cinder] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:56.402213 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5ae55bb9-8e55-471a-8c8a-c404db5959e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:56.427095 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 901/1822] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:56.433161 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed51910-2c1e-4bad-b190-657f4b0c8e2c None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:56.433161 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2ed51910-2c1e-4bad-b190-657f4b0c8e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:56.463816 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed51910-2c1e-4bad-b190-657f4b0c8e2c None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:56.471616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d7b53-3574-4fe6-823c-9387e8559910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:56.472928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d7b53-3574-4fe6-823c-9387e8559910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:56.473257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d7b53-3574-4fe6-823c-9387e8559910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:56.473757 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d7b53-3574-4fe6-823c-9387e8559910 admin admin] PATH_INFO: `/v3/users/e8cb705bbee5471f9cfbf40c2b42b3c2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:56.475143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d7b53-3574-4fe6-823c-9387e8559910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8cb705bbee5471f9cfbf40c2b42b3c2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:56.478068 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d7b53-3574-4fe6-823c-9387e8559910 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:56.529241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae55bb9-8e55-471a-8c8a-c404db5959e0 service cinder] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:56.535226 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a1461-8a2a-4c80-bf02-7bb7b508566c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:56.535871 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a1461-8a2a-4c80-bf02-7bb7b508566c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:56.536183 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a1461-8a2a-4c80-bf02-7bb7b508566c admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:56.536465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a1461-8a2a-4c80-bf02-7bb7b508566c admin admin] PATH_INFO: `/v3/projects/c7a0da3b609e4f6a892d5a4a42c60a8a` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:56.537695 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a1461-8a2a-4c80-bf02-7bb7b508566c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7a0da3b609e4f6a892d5a4a42c60a8a)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:56.539705 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a1461-8a2a-4c80-bf02-7bb7b508566c admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:57.101736 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-742a1461-8a2a-4c80-bf02-7bb7b508566c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7a0da3b609e4f6a892d5a4a42c60a8a', 'request_id': 'req-742a1461-8a2a-4c80-bf02-7bb7b508566c'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:57.104103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-213d7b53-3574-4fe6-823c-9387e8559910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8cb705bbee5471f9cfbf40c2b42b3c2'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:57.104888 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-213d7b53-3574-4fe6-823c-9387e8559910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8cb705bbee5471f9cfbf40c2b42b3c2'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:57.107739 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-742a1461-8a2a-4c80-bf02-7bb7b508566c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7a0da3b609e4f6a892d5a4a42c60a8a', 'request_id': 'req-742a1461-8a2a-4c80-bf02-7bb7b508566c'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:57.265211 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-213d7b53-3574-4fe6-823c-9387e8559910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8cb705bbee5471f9cfbf40c2b42b3c2'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:57.278960 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-213d7b53-3574-4fe6-823c-9387e8559910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8cb705bbee5471f9cfbf40c2b42b3c2'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:57.279734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-213d7b53-3574-4fe6-823c-9387e8559910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8cb705bbee5471f9cfbf40c2b42b3c2'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:57.292728 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 902/1823] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:45:56 2022] DELETE /identity/v3/users/e8cb705bbee5471f9cfbf40c2b42b3c2 => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:57.295883 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e24f97-d665-44f0-842b-acdf9de132d5 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:57.295883 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e24f97-d665-44f0-842b-acdf9de132d5 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:57.295883 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e24f97-d665-44f0-842b-acdf9de132d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:57.330393 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-01e24f97-d665-44f0-842b-acdf9de132d5 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:57.330393 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-01e24f97-d665-44f0-842b-acdf9de132d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:57.347008 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-742a1461-8a2a-4c80-bf02-7bb7b508566c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7a0da3b609e4f6a892d5a4a42c60a8a', 'request_id': 'req-742a1461-8a2a-4c80-bf02-7bb7b508566c'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:57.366684 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-742a1461-8a2a-4c80-bf02-7bb7b508566c admin admin] The token cache is being invalidate because project c7a0da3b609e4f6a892d5a4a42c60a8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:45:57.367131 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-742a1461-8a2a-4c80-bf02-7bb7b508566c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:57.367904 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-742a1461-8a2a-4c80-bf02-7bb7b508566c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:57.376434 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 922/1824] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:45:56 2022] DELETE /identity/v3/projects/c7a0da3b609e4f6a892d5a4a42c60a8a => generated 0 bytes in 970 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:57.378082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d85372-53c9-4036-a657-6007da5ba865 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:57.378470 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d85372-53c9-4036-a657-6007da5ba865 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:57.378844 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d85372-53c9-4036-a657-6007da5ba865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:57.399663 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-e9d85372-53c9-4036-a657-6007da5ba865 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:57.404420 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e9d85372-53c9-4036-a657-6007da5ba865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:57.404634 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 903/1825] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:57.404634 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d3007-f0bb-49d6-8695-da220dc6bb4e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:57.404634 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d3007-f0bb-49d6-8695-da220dc6bb4e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:57.404900 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d3007-f0bb-49d6-8695-da220dc6bb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:57.416599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 923/1826] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:57.417605 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d85372-53c9-4036-a657-6007da5ba865 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:57.428298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-e95d3007-f0bb-49d6-8695-da220dc6bb4e None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:57.429628 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e95d3007-f0bb-49d6-8695-da220dc6bb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:57.431025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d85372-53c9-4036-a657-6007da5ba865 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:57.434486 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:57.440029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ad925-afb2-4ca5-8c1a-2185b02db904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:57.440834 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ad925-afb2-4ca5-8c1a-2185b02db904 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:57.441214 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ad925-afb2-4ca5-8c1a-2185b02db904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:57.441841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 904/1827] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:57.442787 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d3007-f0bb-49d6-8695-da220dc6bb4e None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:57.444508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e95d3007-f0bb-49d6-8695-da220dc6bb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:57.447584 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ad925-afb2-4ca5-8c1a-2185b02db904 admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:57.452526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ad925-afb2-4ca5-8c1a-2185b02db904 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:45:57.453186 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ad925-afb2-4ca5-8c1a-2185b02db904 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:57.455386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ad925-afb2-4ca5-8c1a-2185b02db904 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:57.478829 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 924/1828] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:45:57.481658 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3b9fc-6b69-48f1-8e2f-3fbe4c524bcd None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:57.482027 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3b9fc-6b69-48f1-8e2f-3fbe4c524bcd None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:57.482394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3b9fc-6b69-48f1-8e2f-3fbe4c524bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:57.512598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d3007-f0bb-49d6-8695-da220dc6bb4e None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:57.516081 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-bfb3b9fc-6b69-48f1-8e2f-3fbe4c524bcd None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:57.516253 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:57.518984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8c817-a697-42e8-be6b-448ec3f8724b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:57.520312 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8c817-a697-42e8-be6b-448ec3f8724b service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:57.524217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-bfb3b9fc-6b69-48f1-8e2f-3fbe4c524bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:57.524358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8c817-a697-42e8-be6b-448ec3f8724b service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:57.524358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8c817-a697-42e8-be6b-448ec3f8724b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:57.532941 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 925/1829] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:57.533761 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8c817-a697-42e8-be6b-448ec3f8724b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:57.533946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3b9fc-6b69-48f1-8e2f-3fbe4c524bcd None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:57.545635 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3b9fc-6b69-48f1-8e2f-3fbe4c524bcd None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:57.551890 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8c817-a697-42e8-be6b-448ec3f8724b service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:57.555148 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58add8c4-1a6a-440a-b020-6f04f4a48a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:57.555816 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58add8c4-1a6a-440a-b020-6f04f4a48a6e admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:57.556101 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58add8c4-1a6a-440a-b020-6f04f4a48a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:57.556381 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58add8c4-1a6a-440a-b020-6f04f4a48a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:57.557087 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58add8c4-1a6a-440a-b020-6f04f4a48a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:57.559080 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58add8c4-1a6a-440a-b020-6f04f4a48a6e admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:57.569259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 905/1830] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:45:57.570392 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8c817-a697-42e8-be6b-448ec3f8724b service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:57.581560 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8c817-a697-42e8-be6b-448ec3f8724b service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:57.588672 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cfd75-d8bb-4bfb-96ca-8b84c499698d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:57.598664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cfd75-d8bb-4bfb-96ca-8b84c499698d admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:57.598664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cfd75-d8bb-4bfb-96ca-8b84c499698d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:57.598664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cfd75-d8bb-4bfb-96ca-8b84c499698d admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:57.598664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cfd75-d8bb-4bfb-96ca-8b84c499698d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:45:57.598664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cfd75-d8bb-4bfb-96ca-8b84c499698d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:57.598664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cfd75-d8bb-4bfb-96ca-8b84c499698d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:57.608183 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 906/1831] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:45:57.613207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cfd75-d8bb-4bfb-96ca-8b84c499698d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:57.623316 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cfd75-d8bb-4bfb-96ca-8b84c499698d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:57.628300 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eaece3-30e0-44e2-88f3-c75545ebd745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:57.628935 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eaece3-30e0-44e2-88f3-c75545ebd745 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:57.629212 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eaece3-30e0-44e2-88f3-c75545ebd745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:57.629482 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eaece3-30e0-44e2-88f3-c75545ebd745 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:57.630159 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eaece3-30e0-44e2-88f3-c75545ebd745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:57.632140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eaece3-30e0-44e2-88f3-c75545ebd745 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:57.695494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 926/1832] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:57 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:57.701345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58add8c4-1a6a-440a-b020-6f04f4a48a6e admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:57.756303 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 907/1833] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:57 2022] POST /identity/v3/projects => generated 389 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:45:57.757458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eaece3-30e0-44e2-88f3-c75545ebd745 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:57.797526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58add8c4-1a6a-440a-b020-6f04f4a48a6e admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:57.865764 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eaece3-30e0-44e2-88f3-c75545ebd745 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:57.872860 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e7ce4-c96f-43a2-96a2-2770e1ed0719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:57.873698 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e7ce4-c96f-43a2-96a2-2770e1ed0719 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:57.874091 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e7ce4-c96f-43a2-96a2-2770e1ed0719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:57.874633 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e7ce4-c96f-43a2-96a2-2770e1ed0719 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:57.875970 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e7ce4-c96f-43a2-96a2-2770e1ed0719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:57.878362 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e7ce4-c96f-43a2-96a2-2770e1ed0719 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:57.899700 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbec780-17be-4b65-8d6a-2882afc04caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:57.900754 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbec780-17be-4b65-8d6a-2882afc04caa admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:57.901199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbec780-17be-4b65-8d6a-2882afc04caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:57.901630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbec780-17be-4b65-8d6a-2882afc04caa admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:57.902523 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbec780-17be-4b65-8d6a-2882afc04caa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:57.915324 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbec780-17be-4b65-8d6a-2882afc04caa admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:58.110253 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 908/1834] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:57 2022] POST /identity/v3/users => generated 295 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:58.114781 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e7ce4-c96f-43a2-96a2-2770e1ed0719 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:58.130621 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e7ce4-c96f-43a2-96a2-2770e1ed0719 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:58.137832 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaff937-5f75-4d95-b1be-918fcf15e21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:58.138500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaff937-5f75-4d95-b1be-918fcf15e21c admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:58.138786 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaff937-5f75-4d95-b1be-918fcf15e21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:58.139066 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaff937-5f75-4d95-b1be-918fcf15e21c admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:58.169469 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 927/1835] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:57 2022] POST /identity/v3/users => generated 290 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:45:58.170422 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaff937-5f75-4d95-b1be-918fcf15e21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:58.172412 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbec780-17be-4b65-8d6a-2882afc04caa admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:58.172663 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaff937-5f75-4d95-b1be-918fcf15e21c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:58.189350 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 909/1836] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:58.195741 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaff937-5f75-4d95-b1be-918fcf15e21c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:58.201979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbec780-17be-4b65-8d6a-2882afc04caa admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:58.217908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaff937-5f75-4d95-b1be-918fcf15e21c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:58.219401 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869773e-0774-4e27-9cf5-559b4e84c3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:58.220476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869773e-0774-4e27-9cf5-559b4e84c3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:58.220930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869773e-0774-4e27-9cf5-559b4e84c3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:58.221623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869773e-0774-4e27-9cf5-559b4e84c3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:58.222523 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869773e-0774-4e27-9cf5-559b4e84c3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:58.224597 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869773e-0774-4e27-9cf5-559b4e84c3f3 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:58.225932 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e85268-1af5-42e7-abfc-32c24ffd39ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:58.227018 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e85268-1af5-42e7-abfc-32c24ffd39ac admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:58.228059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e85268-1af5-42e7-abfc-32c24ffd39ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:58.230624 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e85268-1af5-42e7-abfc-32c24ffd39ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:58.230624 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e85268-1af5-42e7-abfc-32c24ffd39ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:58.232722 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e85268-1af5-42e7-abfc-32c24ffd39ac admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:58.240694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 928/1837] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:58.245663 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869773e-0774-4e27-9cf5-559b4e84c3f3 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:58.253448 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 910/1838] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:45:58.262498 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e85268-1af5-42e7-abfc-32c24ffd39ac admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:58.267511 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869773e-0774-4e27-9cf5-559b4e84c3f3 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:58.278048 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa1c89-beee-4071-a00a-7368e17877b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:58.278856 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa1c89-beee-4071-a00a-7368e17877b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:58.279219 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa1c89-beee-4071-a00a-7368e17877b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:58.279586 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa1c89-beee-4071-a00a-7368e17877b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:58.280372 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa1c89-beee-4071-a00a-7368e17877b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:58.282781 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa1c89-beee-4071-a00a-7368e17877b7 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:58.309387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 929/1839] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:45:58.315219 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa1c89-beee-4071-a00a-7368e17877b7 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:58.318482 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e85268-1af5-42e7-abfc-32c24ffd39ac admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:58.330601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efaf17-7242-49fc-988f-66ba1ec48614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:58.331207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efaf17-7242-49fc-988f-66ba1ec48614 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:58.331510 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efaf17-7242-49fc-988f-66ba1ec48614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:58.331825 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efaf17-7242-49fc-988f-66ba1ec48614 admin admin] PATH_INFO: `/v3/projects/00e2fac4b5204693b55db70f593d67af/users/9e5f1e12bb8f4bedbf1d57b7d1b361af/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:58.332831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa1c89-beee-4071-a00a-7368e17877b7 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:58.352456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381658dc-6294-46f9-9396-46d32dbd6c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:58.353161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381658dc-6294-46f9-9396-46d32dbd6c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:58.353446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381658dc-6294-46f9-9396-46d32dbd6c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:58.353725 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381658dc-6294-46f9-9396-46d32dbd6c20 admin admin] PATH_INFO: `/v3/projects/e520cb3d06c04b71964aed0b23b4d25a/users/b503bbaa8a464182b1dd0c8f20dfa79d/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:58.377101 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efaf17-7242-49fc-988f-66ba1ec48614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e2fac4b5204693b55db70f593d67af, user_id=9e5f1e12bb8f4bedbf1d57b7d1b361af, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:58.381050 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efaf17-7242-49fc-988f-66ba1ec48614 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:58.385268 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381658dc-6294-46f9-9396-46d32dbd6c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e520cb3d06c04b71964aed0b23b4d25a, user_id=b503bbaa8a464182b1dd0c8f20dfa79d, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:58.388052 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381658dc-6294-46f9-9396-46d32dbd6c20 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:58.480542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 911/1840] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:58 2022] PUT /identity/v3/projects/00e2fac4b5204693b55db70f593d67af/users/9e5f1e12bb8f4bedbf1d57b7d1b361af/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:58.508639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc273c-79a6-4c0c-abf4-cecab8b59fc9 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:58.508963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc273c-79a6-4c0c-abf4-cecab8b59fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:58.509191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc273c-79a6-4c0c-abf4-cecab8b59fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:58.513611 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 930/1841] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:58 2022] PUT /identity/v3/projects/e520cb3d06c04b71964aed0b23b4d25a/users/b503bbaa8a464182b1dd0c8f20dfa79d/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:58.524846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647a10b-72c2-4034-9a5e-ce12b5653000 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:58.525134 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647a10b-72c2-4034-9a5e-ce12b5653000 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:58.525432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647a10b-72c2-4034-9a5e-ce12b5653000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:58.575203 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-d1fc273c-79a6-4c0c-abf4-cecab8b59fc9 None None] MFA Rules not processed for user `9e5f1e12bb8f4bedbf1d57b7d1b361af`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:58.576520 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-8647a10b-72c2-4034-9a5e-ce12b5653000 None None] MFA Rules not processed for user `b503bbaa8a464182b1dd0c8f20dfa79d`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:58.577166 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d1fc273c-79a6-4c0c-abf4-cecab8b59fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:58.579023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-8647a10b-72c2-4034-9a5e-ce12b5653000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:58.679253 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 931/1842] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:45:58.680513 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647a10b-72c2-4034-9a5e-ce12b5653000 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:58.683726 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-8647a10b-72c2-4034-9a5e-ce12b5653000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:58.708415 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 912/1843] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:58.709480 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc273c-79a6-4c0c-abf4-cecab8b59fc9 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:58.801769 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647a10b-72c2-4034-9a5e-ce12b5653000 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:58.811820 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5feb1f-d4c7-4dff-8850-227c63719b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:58.813071 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5feb1f-d4c7-4dff-8850-227c63719b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:58.813372 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5feb1f-d4c7-4dff-8850-227c63719b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:58.813618 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5feb1f-d4c7-4dff-8850-227c63719b1e admin admin] PATH_INFO: `/v3/projects/2ab7327b04ee44868046e83b04857fb9` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:58.815916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5feb1f-d4c7-4dff-8850-227c63719b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab7327b04ee44868046e83b04857fb9)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:58.817893 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5feb1f-d4c7-4dff-8850-227c63719b1e admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:58.824620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc273c-79a6-4c0c-abf4-cecab8b59fc9 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:58.829307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae9618-eae2-4c05-9740-1b78456c8517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:58.830046 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae9618-eae2-4c05-9740-1b78456c8517 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:58.830402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae9618-eae2-4c05-9740-1b78456c8517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:58.831296 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae9618-eae2-4c05-9740-1b78456c8517 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:58.831619 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae9618-eae2-4c05-9740-1b78456c8517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:58.833734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae9618-eae2-4c05-9740-1b78456c8517 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:58.991448 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-3c5feb1f-d4c7-4dff-8850-227c63719b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab7327b04ee44868046e83b04857fb9', 'request_id': 'req-3c5feb1f-d4c7-4dff-8850-227c63719b1e'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:58.996752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-3c5feb1f-d4c7-4dff-8850-227c63719b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab7327b04ee44868046e83b04857fb9', 'request_id': 'req-3c5feb1f-d4c7-4dff-8850-227c63719b1e'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:59.043151 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 913/1844] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:58 2022] POST /identity/v3/projects => generated 383 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:59.044031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae9618-eae2-4c05-9740-1b78456c8517 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:59.112958 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae9618-eae2-4c05-9740-1b78456c8517 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:59.123830 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d51df-b179-40e5-9ffb-e0312d9003c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:59.124867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d51df-b179-40e5-9ffb-e0312d9003c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:59.125154 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d51df-b179-40e5-9ffb-e0312d9003c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:59.125503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d51df-b179-40e5-9ffb-e0312d9003c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:59.126367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d51df-b179-40e5-9ffb-e0312d9003c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:59.128657 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d51df-b179-40e5-9ffb-e0312d9003c4 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:59.130394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-3c5feb1f-d4c7-4dff-8850-227c63719b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab7327b04ee44868046e83b04857fb9', 'request_id': 'req-3c5feb1f-d4c7-4dff-8850-227c63719b1e'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:59.149746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-3c5feb1f-d4c7-4dff-8850-227c63719b1e admin admin] The token cache is being invalidate because project 2ab7327b04ee44868046e83b04857fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:45:59.150009 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-3c5feb1f-d4c7-4dff-8850-227c63719b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:59.150690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-3c5feb1f-d4c7-4dff-8850-227c63719b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:45:59.152582 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 932/1845] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:45:58 2022] DELETE /identity/v3/projects/2ab7327b04ee44868046e83b04857fb9 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:59.153918 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5feb1f-d4c7-4dff-8850-227c63719b1e admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:59.155588 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-3c5feb1f-d4c7-4dff-8850-227c63719b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:59.222302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5feb1f-d4c7-4dff-8850-227c63719b1e admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:59.227090 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8f118-3fd2-46c6-a36f-fe793cf109b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:59.227766 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8f118-3fd2-46c6-a36f-fe793cf109b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:59.228041 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8f118-3fd2-46c6-a36f-fe793cf109b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:59.228501 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8f118-3fd2-46c6-a36f-fe793cf109b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:59.229039 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8f118-3fd2-46c6-a36f-fe793cf109b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:59.231017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8f118-3fd2-46c6-a36f-fe793cf109b2 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:59.289313 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 914/1846] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:59 2022] POST /identity/v3/projects => generated 385 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:59.289313 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f1637-7b4e-4517-8069-deb70726ded5 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:59.289313 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f1637-7b4e-4517-8069-deb70726ded5 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:59.289313 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f1637-7b4e-4517-8069-deb70726ded5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:59.308338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-7a6f1637-7b4e-4517-8069-deb70726ded5 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:59.309562 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7a6f1637-7b4e-4517-8069-deb70726ded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:59.356811 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 933/1847] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:59 2022] POST /identity/v3/users => generated 298 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:59.359922 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8f118-3fd2-46c6-a36f-fe793cf109b2 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:59.361977 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-bbc8f118-3fd2-46c6-a36f-fe793cf109b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:59.384610 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 915/1848] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:59.384610 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f1637-7b4e-4517-8069-deb70726ded5 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:59.385249 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8f118-3fd2-46c6-a36f-fe793cf109b2 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:59.393826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8fce4-e358-43b1-94d3-244a5088fc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:59.395054 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8fce4-e358-43b1-94d3-244a5088fc11 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:59.395627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8fce4-e358-43b1-94d3-244a5088fc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:59.396256 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8fce4-e358-43b1-94d3-244a5088fc11 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:59.397613 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f1637-7b4e-4517-8069-deb70726ded5 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:59.397743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8fce4-e358-43b1-94d3-244a5088fc11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:59.402074 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8fce4-e358-43b1-94d3-244a5088fc11 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:59.402759 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf5e3e-7951-4af1-a682-3ec708605bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:59.403419 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf5e3e-7951-4af1-a682-3ec708605bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:59.403731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf5e3e-7951-4af1-a682-3ec708605bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:59.404007 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf5e3e-7951-4af1-a682-3ec708605bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:59.404714 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf5e3e-7951-4af1-a682-3ec708605bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:59.407160 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf5e3e-7951-4af1-a682-3ec708605bb7 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:59.417694 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 916/1849] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:59.419091 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bfb69-5120-4ccf-b52d-90b984497848 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:59.422074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bfb69-5120-4ccf-b52d-90b984497848 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:59.422074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bfb69-5120-4ccf-b52d-90b984497848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:59.439021 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-4e6bfb69-5120-4ccf-b52d-90b984497848 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:45:59.440265 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4e6bfb69-5120-4ccf-b52d-90b984497848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:59.448182 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 917/1850] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:45:59.449062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bfb69-5120-4ccf-b52d-90b984497848 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:59.458983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bfb69-5120-4ccf-b52d-90b984497848 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:59.463957 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493858a-c242-411e-82e2-25972a98554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:59.464602 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493858a-c242-411e-82e2-25972a98554e admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:59.464881 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493858a-c242-411e-82e2-25972a98554e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:59.465153 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493858a-c242-411e-82e2-25972a98554e admin admin] PATH_INFO: `/v3/projects/4970add38ce7468787192bc6d8910e0c/users/961c0883d1fe46ef8cacf699020ff22b/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:59.481562 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493858a-c242-411e-82e2-25972a98554e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4970add38ce7468787192bc6d8910e0c, user_id=961c0883d1fe46ef8cacf699020ff22b, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:59.484514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493858a-c242-411e-82e2-25972a98554e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:59.516820 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 934/1851] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:59 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:59.522910 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8fce4-e358-43b1-94d3-244a5088fc11 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:59.528301 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8fce4-e358-43b1-94d3-244a5088fc11 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:59.533733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223f193-184b-4f68-8257-9c7fc8fac81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:59.534432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223f193-184b-4f68-8257-9c7fc8fac81a admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:59.534771 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223f193-184b-4f68-8257-9c7fc8fac81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:59.535111 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223f193-184b-4f68-8257-9c7fc8fac81a admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:59.535918 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223f193-184b-4f68-8257-9c7fc8fac81a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:45:59.536437 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223f193-184b-4f68-8257-9c7fc8fac81a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:59.538356 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223f193-184b-4f68-8257-9c7fc8fac81a admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:59.554808 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:59.559137 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 935/1852] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:45:59.560113 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223f193-184b-4f68-8257-9c7fc8fac81a admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:59.569969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223f193-184b-4f68-8257-9c7fc8fac81a admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:59.574868 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3649b2-578a-40de-a55c-f7aa8745b80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:59.575592 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3649b2-578a-40de-a55c-f7aa8745b80f admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:59.575881 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3649b2-578a-40de-a55c-f7aa8745b80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:59.576161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3649b2-578a-40de-a55c-f7aa8745b80f admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:59.576868 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3649b2-578a-40de-a55c-f7aa8745b80f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:59.579043 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3649b2-578a-40de-a55c-f7aa8745b80f admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:59.590170 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 936/1853] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:45:59.599840 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3649b2-578a-40de-a55c-f7aa8745b80f admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:59.599969 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 918/1854] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:59 2022] PUT /identity/v3/projects/4970add38ce7468787192bc6d8910e0c/users/961c0883d1fe46ef8cacf699020ff22b/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:59.599969 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:59.603189 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3649b2-578a-40de-a55c-f7aa8745b80f admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:59.604809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493858a-c242-411e-82e2-25972a98554e admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:59.665392 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb7682-9427-4c3b-a9e2-bad413bdfa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:59.665942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb7682-9427-4c3b-a9e2-bad413bdfa24 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:59.666226 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb7682-9427-4c3b-a9e2-bad413bdfa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:59.666501 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb7682-9427-4c3b-a9e2-bad413bdfa24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:59.667171 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb7682-9427-4c3b-a9e2-bad413bdfa24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:59.669212 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb7682-9427-4c3b-a9e2-bad413bdfa24 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:59.671791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493858a-c242-411e-82e2-25972a98554e admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:59.677768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455eede9-2863-48fb-9682-abe9ff0dcb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:59.678450 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455eede9-2863-48fb-9682-abe9ff0dcb6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:59.678740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455eede9-2863-48fb-9682-abe9ff0dcb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:59.679008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455eede9-2863-48fb-9682-abe9ff0dcb6d admin admin] PATH_INFO: `/v3/projects/ac5aa2b1ca334d8baa3b41fef8da02b9/users/ed754256d60b411daa987b28db74159f/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:59.698935 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455eede9-2863-48fb-9682-abe9ff0dcb6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5aa2b1ca334d8baa3b41fef8da02b9, user_id=ed754256d60b411daa987b28db74159f, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:59.704579 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455eede9-2863-48fb-9682-abe9ff0dcb6d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:59.772273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 937/1855] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:45:59 2022] POST /identity/v3/projects => generated 361 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:45:59.772273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb7682-9427-4c3b-a9e2-bad413bdfa24 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:59.810477 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 919/1856] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:45:59 2022] PUT /identity/v3/projects/ac5aa2b1ca334d8baa3b41fef8da02b9/users/ed754256d60b411daa987b28db74159f/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:45:59.810477 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455eede9-2863-48fb-9682-abe9ff0dcb6d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:59.865275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb7682-9427-4c3b-a9e2-bad413bdfa24 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:59.913624 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455eede9-2863-48fb-9682-abe9ff0dcb6d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:59.922864 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826071e-73fa-425c-80cf-66df7e04aa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:59.922864 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826071e-73fa-425c-80cf-66df7e04aa90 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:59.922864 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826071e-73fa-425c-80cf-66df7e04aa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:59.922864 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826071e-73fa-425c-80cf-66df7e04aa90 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:59.923176 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826071e-73fa-425c-80cf-66df7e04aa90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:59.925744 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826071e-73fa-425c-80cf-66df7e04aa90 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:00.009084 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce2a98-0074-42a8-88c9-48abc5286846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:00.009732 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce2a98-0074-42a8-88c9-48abc5286846 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:00.010012 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce2a98-0074-42a8-88c9-48abc5286846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:00.010289 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce2a98-0074-42a8-88c9-48abc5286846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:00.011153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce2a98-0074-42a8-88c9-48abc5286846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:00.012815 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce2a98-0074-42a8-88c9-48abc5286846 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:00.034389 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 938/1857] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:00.037102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce2a98-0074-42a8-88c9-48abc5286846 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:00.048916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce2a98-0074-42a8-88c9-48abc5286846 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:00.061067 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 920/1858] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:45:59 2022] POST /identity/v3/users => generated 281 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:00.065953 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826071e-73fa-425c-80cf-66df7e04aa90 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:00.075803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4ba33-59f4-498b-a196-70143247d34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:00.076578 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4ba33-59f4-498b-a196-70143247d34e admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:00.076995 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4ba33-59f4-498b-a196-70143247d34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:00.077384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4ba33-59f4-498b-a196-70143247d34e admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:00.078787 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4ba33-59f4-498b-a196-70143247d34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:00.081279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826071e-73fa-425c-80cf-66df7e04aa90 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:00.082070 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4ba33-59f4-498b-a196-70143247d34e admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:00.087451 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ece2ed-2bac-4e1c-bf5e-4503e36e73fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:00.094133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ece2ed-2bac-4e1c-bf5e-4503e36e73fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:00.094133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ece2ed-2bac-4e1c-bf5e-4503e36e73fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:00.094133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ece2ed-2bac-4e1c-bf5e-4503e36e73fd admin admin] PATH_INFO: `/v3/projects/4970add38ce7468787192bc6d8910e0c/users/961c0883d1fe46ef8cacf699020ff22b/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:00.094133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ece2ed-2bac-4e1c-bf5e-4503e36e73fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4970add38ce7468787192bc6d8910e0c, user_id=961c0883d1fe46ef8cacf699020ff22b, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:00.098398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ece2ed-2bac-4e1c-bf5e-4503e36e73fd admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:00.102954 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 939/1859] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:00.104275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4ba33-59f4-498b-a196-70143247d34e admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:00.118458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 921/1860] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:00 2022] PUT /identity/v3/projects/4970add38ce7468787192bc6d8910e0c/users/961c0883d1fe46ef8cacf699020ff22b/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:00.119860 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ece2ed-2bac-4e1c-bf5e-4503e36e73fd admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:00.120970 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4ba33-59f4-498b-a196-70143247d34e admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:00.240380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ece2ed-2bac-4e1c-bf5e-4503e36e73fd admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:00.245826 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1d9f9-593a-4349-9fbe-8b871fe86119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:00.246877 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1d9f9-593a-4349-9fbe-8b871fe86119 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:00.247020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1da15d-f56a-44b3-8088-a3f6750a804c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:00.247763 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1da15d-f56a-44b3-8088-a3f6750a804c admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:00.248846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1da15d-f56a-44b3-8088-a3f6750a804c admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:00.248846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1da15d-f56a-44b3-8088-a3f6750a804c admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:00.249481 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1d9f9-593a-4349-9fbe-8b871fe86119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:00.250253 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1d9f9-593a-4349-9fbe-8b871fe86119 admin admin] PATH_INFO: `/v3/projects/ac5aa2b1ca334d8baa3b41fef8da02b9/users/ed754256d60b411daa987b28db74159f/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:00.252710 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1d9f9-593a-4349-9fbe-8b871fe86119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5aa2b1ca334d8baa3b41fef8da02b9, user_id=ed754256d60b411daa987b28db74159f, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:00.252851 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1da15d-f56a-44b3-8088-a3f6750a804c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:00.254536 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1da15d-f56a-44b3-8088-a3f6750a804c admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:00.260769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1d9f9-593a-4349-9fbe-8b871fe86119 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:00.274786 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 922/1861] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:00 2022] PUT /identity/v3/projects/ac5aa2b1ca334d8baa3b41fef8da02b9/users/ed754256d60b411daa987b28db74159f/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:00.276487 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0042660-1b47-4507-9bc6-eb5bf93b4efc None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:00.276984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0042660-1b47-4507-9bc6-eb5bf93b4efc None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:00.277495 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0042660-1b47-4507-9bc6-eb5bf93b4efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:00.301928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 940/1862] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:00.305300 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea877c3-2f65-45b4-9afe-057d1335ff27 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:00.305859 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea877c3-2f65-45b4-9afe-057d1335ff27 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:00.306154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea877c3-2f65-45b4-9afe-057d1335ff27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:00.312989 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f0042660-1b47-4507-9bc6-eb5bf93b4efc None None] MFA Rules not processed for user `961c0883d1fe46ef8cacf699020ff22b`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:00.314795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f0042660-1b47-4507-9bc6-eb5bf93b4efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:00.346277 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-dea877c3-2f65-45b4-9afe-057d1335ff27 None None] MFA Rules not processed for user `ed754256d60b411daa987b28db74159f`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:00.347526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-dea877c3-2f65-45b4-9afe-057d1335ff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:00.422592 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 923/1863] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:00.424280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0042660-1b47-4507-9bc6-eb5bf93b4efc None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:00.484028 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 941/1864] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:00.485049 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea877c3-2f65-45b4-9afe-057d1335ff27 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:00.486486 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-dea877c3-2f65-45b4-9afe-057d1335ff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:00.502321 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0042660-1b47-4507-9bc6-eb5bf93b4efc None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:00.508136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac884e-bab7-4c0f-84d0-b69392f123a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:00.509128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac884e-bab7-4c0f-84d0-b69392f123a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:00.509612 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac884e-bab7-4c0f-84d0-b69392f123a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:00.510033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac884e-bab7-4c0f-84d0-b69392f123a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:00.511180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac884e-bab7-4c0f-84d0-b69392f123a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:00.513847 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac884e-bab7-4c0f-84d0-b69392f123a1 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:00.596399 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 924/1865] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:00.596399 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac884e-bab7-4c0f-84d0-b69392f123a1 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:00.596399 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac884e-bab7-4c0f-84d0-b69392f123a1 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:00.596399 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c6956-53bc-4e9f-9fe9-a7cd1f7b0679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:00.597337 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c6956-53bc-4e9f-9fe9-a7cd1f7b0679 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:00.597337 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c6956-53bc-4e9f-9fe9-a7cd1f7b0679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:00.597337 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c6956-53bc-4e9f-9fe9-a7cd1f7b0679 admin admin] PATH_INFO: `/v3/projects/5c720f7c83fb41eb8debaea1d6acaaed/users/69d822ac8fae4614abe8ea1b5b42a377/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:00.597337 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c6956-53bc-4e9f-9fe9-a7cd1f7b0679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c720f7c83fb41eb8debaea1d6acaaed, user_id=69d822ac8fae4614abe8ea1b5b42a377, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:00.597907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c6956-53bc-4e9f-9fe9-a7cd1f7b0679 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:00.606856 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea877c3-2f65-45b4-9afe-057d1335ff27 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:00.612514 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5f8ee-915a-4972-bbd8-bb09aee40e43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:00.613167 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5f8ee-915a-4972-bbd8-bb09aee40e43 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:00.613450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5f8ee-915a-4972-bbd8-bb09aee40e43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:00.613734 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5f8ee-915a-4972-bbd8-bb09aee40e43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:00.625597 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5f8ee-915a-4972-bbd8-bb09aee40e43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:00.627199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5f8ee-915a-4972-bbd8-bb09aee40e43 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:00.650318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 942/1866] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:00.677349 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5f8ee-915a-4972-bbd8-bb09aee40e43 service cinder] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:00.687537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5f8ee-915a-4972-bbd8-bb09aee40e43 service cinder] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:00.691708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1aca69-f9f8-457f-8874-b99e004e9e84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:00.692455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aca69-f9f8-457f-8874-b99e004e9e84 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:00.692871 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aca69-f9f8-457f-8874-b99e004e9e84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:00.693246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aca69-f9f8-457f-8874-b99e004e9e84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:00.721963 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1aca69-f9f8-457f-8874-b99e004e9e84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:00.726734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 925/1867] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:00 2022] PUT /identity/v3/projects/5c720f7c83fb41eb8debaea1d6acaaed/users/69d822ac8fae4614abe8ea1b5b42a377/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:00.735280 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1aca69-f9f8-457f-8874-b99e004e9e84 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:00.740836 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6c3df-5c90-4544-b138-4bf291b6ff8d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:00.741949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6c3df-5c90-4544-b138-4bf291b6ff8d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:00.742363 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6c3df-5c90-4544-b138-4bf291b6ff8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:00.747085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 943/1868] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:46:00.830912 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-2eb6c3df-5c90-4544-b138-4bf291b6ff8d None None] MFA Rules not processed for user `69d822ac8fae4614abe8ea1b5b42a377`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:00.833510 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2eb6c3df-5c90-4544-b138-4bf291b6ff8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:01.043815 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1aca69-f9f8-457f-8874-b99e004e9e84 service cinder] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:01.044698 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 926/1869] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:46:01.058348 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6c3df-5c90-4544-b138-4bf291b6ff8d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:01.083576 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1aca69-f9f8-457f-8874-b99e004e9e84 service cinder] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:01.148517 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6515174-d4f4-40a6-b8df-69d6d59818c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:01.149587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6515174-d4f4-40a6-b8df-69d6d59818c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:01.149899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6515174-d4f4-40a6-b8df-69d6d59818c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:01.150261 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6515174-d4f4-40a6-b8df-69d6d59818c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:01.152286 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-f6515174-d4f4-40a6-b8df-69d6d59818c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:01.162707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6c3df-5c90-4544-b138-4bf291b6ff8d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:01.169153 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172b187-125d-424e-9d8a-7045755d7795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:01.169817 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172b187-125d-424e-9d8a-7045755d7795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:01.170106 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172b187-125d-424e-9d8a-7045755d7795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:01.170402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172b187-125d-424e-9d8a-7045755d7795 admin admin] PATH_INFO: `/v3/users/9e5f1e12bb8f4bedbf1d57b7d1b361af` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:01.171742 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172b187-125d-424e-9d8a-7045755d7795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5f1e12bb8f4bedbf1d57b7d1b361af)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:01.173769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172b187-125d-424e-9d8a-7045755d7795 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:01.238759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6515174-d4f4-40a6-b8df-69d6d59818c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:01.240832 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6515174-d4f4-40a6-b8df-69d6d59818c3 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:01.254432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 944/1870] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:01.255318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6515174-d4f4-40a6-b8df-69d6d59818c3 service cinder] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:01.256857 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-f6515174-d4f4-40a6-b8df-69d6d59818c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:01.268734 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6515174-d4f4-40a6-b8df-69d6d59818c3 service cinder] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:01.272734 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312ea3a-7704-4d42-a8aa-bef665e01a2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:01.273357 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312ea3a-7704-4d42-a8aa-bef665e01a2f service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:01.273641 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312ea3a-7704-4d42-a8aa-bef665e01a2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:01.273913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312ea3a-7704-4d42-a8aa-bef665e01a2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:01.284668 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312ea3a-7704-4d42-a8aa-bef665e01a2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:01.285687 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312ea3a-7704-4d42-a8aa-bef665e01a2f service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:01.296344 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 945/1871] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:01.317832 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312ea3a-7704-4d42-a8aa-bef665e01a2f service cinder] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:01.331176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312ea3a-7704-4d42-a8aa-bef665e01a2f service cinder] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:01.337482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fb280-8930-405d-99fd-6d9d4f18ba5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:01.338137 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fb280-8930-405d-99fd-6d9d4f18ba5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:01.338418 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fb280-8930-405d-99fd-6d9d4f18ba5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:01.338696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fb280-8930-405d-99fd-6d9d4f18ba5a admin admin] PATH_INFO: `/v3/users/69d822ac8fae4614abe8ea1b5b42a377` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:01.344382 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fb280-8930-405d-99fd-6d9d4f18ba5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=69d822ac8fae4614abe8ea1b5b42a377)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:01.347400 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fb280-8930-405d-99fd-6d9d4f18ba5a admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:01.395599 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5172b187-125d-424e-9d8a-7045755d7795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5f1e12bb8f4bedbf1d57b7d1b361af'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:01.396558 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5172b187-125d-424e-9d8a-7045755d7795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5f1e12bb8f4bedbf1d57b7d1b361af'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:01.476683 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5172b187-125d-424e-9d8a-7045755d7795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5f1e12bb8f4bedbf1d57b7d1b361af'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:01.492707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5172b187-125d-424e-9d8a-7045755d7795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5f1e12bb8f4bedbf1d57b7d1b361af'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:01.493515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5172b187-125d-424e-9d8a-7045755d7795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5f1e12bb8f4bedbf1d57b7d1b361af'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:01.507157 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 927/1872] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:01 2022] DELETE /identity/v3/users/9e5f1e12bb8f4bedbf1d57b7d1b361af => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:01.511678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9757c9d-91a3-401f-8ee5-b1defb559f55 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:01.511972 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9757c9d-91a3-401f-8ee5-b1defb559f55 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:01.512258 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9757c9d-91a3-401f-8ee5-b1defb559f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:01.532684 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b9757c9d-91a3-401f-8ee5-b1defb559f55 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:01.533995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b9757c9d-91a3-401f-8ee5-b1defb559f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:01.590494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-499fb280-8930-405d-99fd-6d9d4f18ba5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69d822ac8fae4614abe8ea1b5b42a377'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:01.591415 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-499fb280-8930-405d-99fd-6d9d4f18ba5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69d822ac8fae4614abe8ea1b5b42a377'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:01.633900 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 928/1873] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:46:01.649834 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9757c9d-91a3-401f-8ee5-b1defb559f55 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:01.651725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b9757c9d-91a3-401f-8ee5-b1defb559f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:01.696809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-499fb280-8930-405d-99fd-6d9d4f18ba5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69d822ac8fae4614abe8ea1b5b42a377'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:01.731813 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-499fb280-8930-405d-99fd-6d9d4f18ba5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69d822ac8fae4614abe8ea1b5b42a377'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:01.746921 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-499fb280-8930-405d-99fd-6d9d4f18ba5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69d822ac8fae4614abe8ea1b5b42a377'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:01.762367 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 946/1874] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:01 2022] DELETE /identity/v3/users/69d822ac8fae4614abe8ea1b5b42a377 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:01.783425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375fae2-85b8-4e54-88f3-f057f142d5c5 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:01.783425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375fae2-85b8-4e54-88f3-f057f142d5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:01.783425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375fae2-85b8-4e54-88f3-f057f142d5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:01.797540 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9757c9d-91a3-401f-8ee5-b1defb559f55 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:01.807202 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-e375fae2-85b8-4e54-88f3-f057f142d5c5 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:01.808472 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e375fae2-85b8-4e54-88f3-f057f142d5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:01.890141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4a122-9806-4047-9694-d21799b4ceb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:01.891032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4a122-9806-4047-9694-d21799b4ceb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:01.891349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4a122-9806-4047-9694-d21799b4ceb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:01.891633 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4a122-9806-4047-9694-d21799b4ceb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:01.899834 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-fdf4a122-9806-4047-9694-d21799b4ceb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:01.906193 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 947/1875] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:01.914144 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375fae2-85b8-4e54-88f3-f057f142d5c5 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:01.916300 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e375fae2-85b8-4e54-88f3-f057f142d5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:01.930411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4a122-9806-4047-9694-d21799b4ceb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:01.930717 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375fae2-85b8-4e54-88f3-f057f142d5c5 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:01.932587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4a122-9806-4047-9694-d21799b4ceb8 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:01.936063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3331afa-c920-43e3-9a19-25c0ac47b1e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:01.937125 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3331afa-c920-43e3-9a19-25c0ac47b1e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:01.937996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3331afa-c920-43e3-9a19-25c0ac47b1e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:01.938406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3331afa-c920-43e3-9a19-25c0ac47b1e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:01.947326 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 929/1876] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:01.951217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3331afa-c920-43e3-9a19-25c0ac47b1e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:01.953103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3331afa-c920-43e3-9a19-25c0ac47b1e1 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:01.967853 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 948/1877] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:46:03.137631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:03.244701 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:03.366826 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4a122-9806-4047-9694-d21799b4ceb8 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:03.368422 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-fdf4a122-9806-4047-9694-d21799b4ceb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:03.392623 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4a122-9806-4047-9694-d21799b4ceb8 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:03.407575 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef6031-84b0-4d18-ba8e-163e6b4158ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:03.407575 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef6031-84b0-4d18-ba8e-163e6b4158ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:03.407575 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef6031-84b0-4d18-ba8e-163e6b4158ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:03.407922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef6031-84b0-4d18-ba8e-163e6b4158ce admin admin] PATH_INFO: `/v3/projects/5c720f7c83fb41eb8debaea1d6acaaed` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:03.411581 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef6031-84b0-4d18-ba8e-163e6b4158ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c720f7c83fb41eb8debaea1d6acaaed)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:03.412862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef6031-84b0-4d18-ba8e-163e6b4158ce admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:03.588916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3331afa-c920-43e3-9a19-25c0ac47b1e1 service neutron] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:03.591182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-d3331afa-c920-43e3-9a19-25c0ac47b1e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:03.618865 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3331afa-c920-43e3-9a19-25c0ac47b1e1 service neutron] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:03.635038 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8572f-0e4b-4285-a99e-6605ee42a130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:03.636018 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8572f-0e4b-4285-a99e-6605ee42a130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:03.636313 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8572f-0e4b-4285-a99e-6605ee42a130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:03.637105 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8572f-0e4b-4285-a99e-6605ee42a130 admin admin] PATH_INFO: `/v3/projects/00e2fac4b5204693b55db70f593d67af` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:03.642713 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8572f-0e4b-4285-a99e-6605ee42a130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00e2fac4b5204693b55db70f593d67af)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:03.661062 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8572f-0e4b-4285-a99e-6605ee42a130 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:03.686195 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2bef6031-84b0-4d18-ba8e-163e6b4158ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c720f7c83fb41eb8debaea1d6acaaed', 'request_id': 'req-2bef6031-84b0-4d18-ba8e-163e6b4158ce'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:03.704978 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2bef6031-84b0-4d18-ba8e-163e6b4158ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c720f7c83fb41eb8debaea1d6acaaed', 'request_id': 'req-2bef6031-84b0-4d18-ba8e-163e6b4158ce'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:03.877580 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2bef6031-84b0-4d18-ba8e-163e6b4158ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c720f7c83fb41eb8debaea1d6acaaed', 'request_id': 'req-2bef6031-84b0-4d18-ba8e-163e6b4158ce'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:03.887668 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2bef6031-84b0-4d18-ba8e-163e6b4158ce admin admin] The token cache is being invalidate because project 5c720f7c83fb41eb8debaea1d6acaaed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:03.888078 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2bef6031-84b0-4d18-ba8e-163e6b4158ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:03.888856 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2bef6031-84b0-4d18-ba8e-163e6b4158ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:03.891384 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 930/1878] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:03 2022] DELETE /identity/v3/projects/5c720f7c83fb41eb8debaea1d6acaaed => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:03.893258 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-36a8572f-0e4b-4285-a99e-6605ee42a130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e2fac4b5204693b55db70f593d67af', 'request_id': 'req-36a8572f-0e4b-4285-a99e-6605ee42a130'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:03.895897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c366bbd-6b19-4ebf-ad49-cdaad86bddac None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:03.896261 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c366bbd-6b19-4ebf-ad49-cdaad86bddac None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:03.896608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c366bbd-6b19-4ebf-ad49-cdaad86bddac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:03.902795 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-36a8572f-0e4b-4285-a99e-6605ee42a130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e2fac4b5204693b55db70f593d67af', 'request_id': 'req-36a8572f-0e4b-4285-a99e-6605ee42a130'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:03.919457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0c366bbd-6b19-4ebf-ad49-cdaad86bddac None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:03.920688 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0c366bbd-6b19-4ebf-ad49-cdaad86bddac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:03.970935 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-36a8572f-0e4b-4285-a99e-6605ee42a130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e2fac4b5204693b55db70f593d67af', 'request_id': 'req-36a8572f-0e4b-4285-a99e-6605ee42a130'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:03.983252 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-36a8572f-0e4b-4285-a99e-6605ee42a130 admin admin] The token cache is being invalidate because project 00e2fac4b5204693b55db70f593d67af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:03.983573 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-36a8572f-0e4b-4285-a99e-6605ee42a130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:03.984826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-36a8572f-0e4b-4285-a99e-6605ee42a130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:03.989294 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 949/1879] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:03 2022] DELETE /identity/v3/projects/00e2fac4b5204693b55db70f593d67af => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:03.990509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8572f-0e4b-4285-a99e-6605ee42a130 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:03.991511 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 931/1880] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:46:03.998073 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-36a8572f-0e4b-4285-a99e-6605ee42a130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:03.999027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0243b-7f84-49eb-a06e-ec83db8d7651 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:03.999349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0243b-7f84-49eb-a06e-ec83db8d7651 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:03.999739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0243b-7f84-49eb-a06e-ec83db8d7651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:04.012447 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8572f-0e4b-4285-a99e-6605ee42a130 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:04.019566 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2911751-1706-41fa-9f4b-7882511ae597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:04.024203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2911751-1706-41fa-9f4b-7882511ae597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:04.024203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2911751-1706-41fa-9f4b-7882511ae597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:04.024203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2911751-1706-41fa-9f4b-7882511ae597 admin admin] PATH_INFO: `/v3/users/ed754256d60b411daa987b28db74159f` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:04.024203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2911751-1706-41fa-9f4b-7882511ae597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed754256d60b411daa987b28db74159f)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:04.024203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2911751-1706-41fa-9f4b-7882511ae597 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:04.024755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-8da0243b-7f84-49eb-a06e-ec83db8d7651 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:04.025904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8da0243b-7f84-49eb-a06e-ec83db8d7651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:04.036916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 932/1881] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:46:04.040774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0243b-7f84-49eb-a06e-ec83db8d7651 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:04.051846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0243b-7f84-49eb-a06e-ec83db8d7651 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:04.056799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a03437-d594-4fe7-9b28-bf56db662d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:04.057461 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a03437-d594-4fe7-9b28-bf56db662d40 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:04.057749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a03437-d594-4fe7-9b28-bf56db662d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:04.058028 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a03437-d594-4fe7-9b28-bf56db662d40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:04.058745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a03437-d594-4fe7-9b28-bf56db662d40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:46:04.059059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a03437-d594-4fe7-9b28-bf56db662d40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:04.060754 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a03437-d594-4fe7-9b28-bf56db662d40 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:04.076851 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 933/1882] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:46:04.078360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a03437-d594-4fe7-9b28-bf56db662d40 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:04.089452 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a03437-d594-4fe7-9b28-bf56db662d40 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:04.094386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9df347-e83e-49f0-a99a-4a3c6de7f028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:04.095030 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9df347-e83e-49f0-a99a-4a3c6de7f028 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:04.095347 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9df347-e83e-49f0-a99a-4a3c6de7f028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:04.095627 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9df347-e83e-49f0-a99a-4a3c6de7f028 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:04.096360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9df347-e83e-49f0-a99a-4a3c6de7f028 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:04.098459 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9df347-e83e-49f0-a99a-4a3c6de7f028 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:04.238188 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 934/1883] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:46:04 2022] POST /identity/v3/projects => generated 371 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:04.242774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9df347-e83e-49f0-a99a-4a3c6de7f028 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:04.291289 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f2911751-1706-41fa-9f4b-7882511ae597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed754256d60b411daa987b28db74159f'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:04.291289 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f2911751-1706-41fa-9f4b-7882511ae597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed754256d60b411daa987b28db74159f'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:04.359880 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9df347-e83e-49f0-a99a-4a3c6de7f028 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:04.365151 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17ce94-c25c-41c1-8380-33ce40a3ec23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:04.365727 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17ce94-c25c-41c1-8380-33ce40a3ec23 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:04.366623 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17ce94-c25c-41c1-8380-33ce40a3ec23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:04.366623 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17ce94-c25c-41c1-8380-33ce40a3ec23 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:04.370065 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17ce94-c25c-41c1-8380-33ce40a3ec23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:04.372547 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17ce94-c25c-41c1-8380-33ce40a3ec23 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:04.378743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f2911751-1706-41fa-9f4b-7882511ae597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed754256d60b411daa987b28db74159f'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:04.395924 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f2911751-1706-41fa-9f4b-7882511ae597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed754256d60b411daa987b28db74159f'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:04.415762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f2911751-1706-41fa-9f4b-7882511ae597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed754256d60b411daa987b28db74159f'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:04.426311 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 950/1884] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:03 2022] DELETE /identity/v3/users/ed754256d60b411daa987b28db74159f => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:04.494814 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 935/1885] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:46:04 2022] POST /identity/v3/users => generated 286 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:04.495954 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2911751-1706-41fa-9f4b-7882511ae597 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:04.498163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-f2911751-1706-41fa-9f4b-7882511ae597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:04.611699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2911751-1706-41fa-9f4b-7882511ae597 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:04.617241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8a7d5-9ef6-4690-833a-d5d9c0fe30fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:04.622601 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8a7d5-9ef6-4690-833a-d5d9c0fe30fa admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:04.622601 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8a7d5-9ef6-4690-833a-d5d9c0fe30fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:04.622601 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8a7d5-9ef6-4690-833a-d5d9c0fe30fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:04.622601 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8a7d5-9ef6-4690-833a-d5d9c0fe30fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:04.622601 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8a7d5-9ef6-4690-833a-d5d9c0fe30fa admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:04.638534 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 951/1886] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:46:04.642880 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17ce94-c25c-41c1-8380-33ce40a3ec23 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:04.654948 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17ce94-c25c-41c1-8380-33ce40a3ec23 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:04.661282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6395d-c13e-4909-acc7-f995c7380f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:04.661917 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6395d-c13e-4909-acc7-f995c7380f94 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:04.662207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6395d-c13e-4909-acc7-f995c7380f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:04.662487 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6395d-c13e-4909-acc7-f995c7380f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:04.663529 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6395d-c13e-4909-acc7-f995c7380f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:04.665291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6395d-c13e-4909-acc7-f995c7380f94 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:04.703629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 936/1887] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:04.707873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8a7d5-9ef6-4690-833a-d5d9c0fe30fa admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:04.726705 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8a7d5-9ef6-4690-833a-d5d9c0fe30fa admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:04.735430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5aed2-3626-4375-9a04-01546c05c489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:04.735430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5aed2-3626-4375-9a04-01546c05c489 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:04.735430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5aed2-3626-4375-9a04-01546c05c489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:04.735430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5aed2-3626-4375-9a04-01546c05c489 admin admin] PATH_INFO: `/v3/projects/fae475af12784e64a8a3b917c0000574/users/313ac38fa5514e84b862657c46ca66d5/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:04.769393 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5aed2-3626-4375-9a04-01546c05c489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fae475af12784e64a8a3b917c0000574, user_id=313ac38fa5514e84b862657c46ca66d5, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:04.772731 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5aed2-3626-4375-9a04-01546c05c489 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:04.859650 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 952/1888] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:04 2022] PUT /identity/v3/projects/fae475af12784e64a8a3b917c0000574/users/313ac38fa5514e84b862657c46ca66d5/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:04.871485 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe725d-9daf-4748-932d-ef71d4157ed2 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:04.871818 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe725d-9daf-4748-932d-ef71d4157ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:04.871955 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe725d-9daf-4748-932d-ef71d4157ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:04.941445 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-28fe725d-9daf-4748-932d-ef71d4157ed2 None None] MFA Rules not processed for user `313ac38fa5514e84b862657c46ca66d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:04.944190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-28fe725d-9daf-4748-932d-ef71d4157ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:05.057697 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 937/1889] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:05.076164 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5aed2-3626-4375-9a04-01546c05c489 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:05.079032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-52f5aed2-3626-4375-9a04-01546c05c489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:05.141600 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5aed2-3626-4375-9a04-01546c05c489 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:05.145185 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8572edb-2c61-448a-ac48-1fee300fef9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:05.145814 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8572edb-2c61-448a-ac48-1fee300fef9c service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:05.146100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8572edb-2c61-448a-ac48-1fee300fef9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:05.146381 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8572edb-2c61-448a-ac48-1fee300fef9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:05.154813 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8572edb-2c61-448a-ac48-1fee300fef9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:05.156714 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8572edb-2c61-448a-ac48-1fee300fef9c service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:05.165594 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 953/1890] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:05.191761 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe725d-9daf-4748-932d-ef71d4157ed2 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:05.192376 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8572edb-2c61-448a-ac48-1fee300fef9c service cinder] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:05.193289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-28fe725d-9daf-4748-932d-ef71d4157ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:05.268520 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8572edb-2c61-448a-ac48-1fee300fef9c service cinder] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:05.274540 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a4a03-d28b-4190-b4e1-bb8f07ada838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:05.275546 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a4a03-d28b-4190-b4e1-bb8f07ada838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:05.276047 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a4a03-d28b-4190-b4e1-bb8f07ada838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:05.276571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a4a03-d28b-4190-b4e1-bb8f07ada838 admin admin] PATH_INFO: `/v3/users/313ac38fa5514e84b862657c46ca66d5` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:05.278143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a4a03-d28b-4190-b4e1-bb8f07ada838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=313ac38fa5514e84b862657c46ca66d5)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:05.278816 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe725d-9daf-4748-932d-ef71d4157ed2 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:05.282354 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a4a03-d28b-4190-b4e1-bb8f07ada838 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:05.285045 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f8e0b-026e-4d12-9a32-fee818cc9ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:05.285799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f8e0b-026e-4d12-9a32-fee818cc9ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:05.286080 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f8e0b-026e-4d12-9a32-fee818cc9ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:05.286398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f8e0b-026e-4d12-9a32-fee818cc9ed8 admin admin] PATH_INFO: `/v3/projects/ac5aa2b1ca334d8baa3b41fef8da02b9` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:05.287947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f8e0b-026e-4d12-9a32-fee818cc9ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac5aa2b1ca334d8baa3b41fef8da02b9)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:05.289899 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f8e0b-026e-4d12-9a32-fee818cc9ed8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:05.475321 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c97a4a03-d28b-4190-b4e1-bb8f07ada838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '313ac38fa5514e84b862657c46ca66d5'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:05.475932 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b98f8e0b-026e-4d12-9a32-fee818cc9ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac5aa2b1ca334d8baa3b41fef8da02b9', 'request_id': 'req-b98f8e0b-026e-4d12-9a32-fee818cc9ed8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:05.476291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c97a4a03-d28b-4190-b4e1-bb8f07ada838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '313ac38fa5514e84b862657c46ca66d5'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:05.481567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b98f8e0b-026e-4d12-9a32-fee818cc9ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac5aa2b1ca334d8baa3b41fef8da02b9', 'request_id': 'req-b98f8e0b-026e-4d12-9a32-fee818cc9ed8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:05.555498 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c97a4a03-d28b-4190-b4e1-bb8f07ada838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '313ac38fa5514e84b862657c46ca66d5'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:05.569647 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c97a4a03-d28b-4190-b4e1-bb8f07ada838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '313ac38fa5514e84b862657c46ca66d5'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:05.576715 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c97a4a03-d28b-4190-b4e1-bb8f07ada838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '313ac38fa5514e84b862657c46ca66d5'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:05.584141 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 954/1891] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:05 2022] DELETE /identity/v3/users/313ac38fa5514e84b862657c46ca66d5 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:05.588785 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295de22d-80db-481f-bbeb-540f905c6136 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:05.589093 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295de22d-80db-481f-bbeb-540f905c6136 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:05.589367 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295de22d-80db-481f-bbeb-540f905c6136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:05.604182 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b98f8e0b-026e-4d12-9a32-fee818cc9ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac5aa2b1ca334d8baa3b41fef8da02b9', 'request_id': 'req-b98f8e0b-026e-4d12-9a32-fee818cc9ed8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:05.613901 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-295de22d-80db-481f-bbeb-540f905c6136 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:05.613901 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-295de22d-80db-481f-bbeb-540f905c6136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:05.623365 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b98f8e0b-026e-4d12-9a32-fee818cc9ed8 admin admin] The token cache is being invalidate because project ac5aa2b1ca334d8baa3b41fef8da02b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:05.623939 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b98f8e0b-026e-4d12-9a32-fee818cc9ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:05.625316 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b98f8e0b-026e-4d12-9a32-fee818cc9ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:05.628059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 938/1892] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:05 2022] DELETE /identity/v3/projects/ac5aa2b1ca334d8baa3b41fef8da02b9 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:05.634233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95669f3d-b4f1-4e9f-b532-0f4e537709d0 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:05.634638 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95669f3d-b4f1-4e9f-b532-0f4e537709d0 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:05.635442 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95669f3d-b4f1-4e9f-b532-0f4e537709d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:05.660439 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-95669f3d-b4f1-4e9f-b532-0f4e537709d0 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:05.662080 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-95669f3d-b4f1-4e9f-b532-0f4e537709d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:05.691002 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 955/1893] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:46:05.703725 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295de22d-80db-481f-bbeb-540f905c6136 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:05.707996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-295de22d-80db-481f-bbeb-540f905c6136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:05.758004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:05.768427 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 939/1894] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:05.769427 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95669f3d-b4f1-4e9f-b532-0f4e537709d0 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:05.770830 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-95669f3d-b4f1-4e9f-b532-0f4e537709d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:05.786464 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95669f3d-b4f1-4e9f-b532-0f4e537709d0 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:05.799602 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214e3ef-7624-44b6-9b02-6d83e8adfbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:05.800701 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214e3ef-7624-44b6-9b02-6d83e8adfbef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:05.801368 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214e3ef-7624-44b6-9b02-6d83e8adfbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:05.802032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214e3ef-7624-44b6-9b02-6d83e8adfbef admin admin] PATH_INFO: `/v3/users/b503bbaa8a464182b1dd0c8f20dfa79d` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:05.804190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214e3ef-7624-44b6-9b02-6d83e8adfbef admin admin] RBAC: Authorizing `identity:delete_user(user_id=b503bbaa8a464182b1dd0c8f20dfa79d)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:05.807254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214e3ef-7624-44b6-9b02-6d83e8adfbef admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:05.807861 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295de22d-80db-481f-bbeb-540f905c6136 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:05.813482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7ac0f-173f-4806-8359-6a428ef0ee38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:05.814327 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7ac0f-173f-4806-8359-6a428ef0ee38 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:05.814618 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7ac0f-173f-4806-8359-6a428ef0ee38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:05.815240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7ac0f-173f-4806-8359-6a428ef0ee38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:05.828713 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7ac0f-173f-4806-8359-6a428ef0ee38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:05.833033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7ac0f-173f-4806-8359-6a428ef0ee38 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:05.844809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 956/1895] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:05.846101 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e09eb6-2e72-4b67-9ad3-c6c52589641d None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:05.846832 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e09eb6-2e72-4b67-9ad3-c6c52589641d None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:05.846832 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e09eb6-2e72-4b67-9ad3-c6c52589641d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:05.867097 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-84e09eb6-2e72-4b67-9ad3-c6c52589641d None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:05.868362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-84e09eb6-2e72-4b67-9ad3-c6c52589641d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:05.877345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 957/1896] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:05.881443 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e09eb6-2e72-4b67-9ad3-c6c52589641d None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:05.891312 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e09eb6-2e72-4b67-9ad3-c6c52589641d None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:05.896793 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cd2d1-3723-48b7-be67-3f5bb4f66c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:05.897620 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cd2d1-3723-48b7-be67-3f5bb4f66c75 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:05.897909 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cd2d1-3723-48b7-be67-3f5bb4f66c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:05.898186 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cd2d1-3723-48b7-be67-3f5bb4f66c75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:05.898941 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cd2d1-3723-48b7-be67-3f5bb4f66c75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:46:05.899248 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cd2d1-3723-48b7-be67-3f5bb4f66c75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:05.900897 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cd2d1-3723-48b7-be67-3f5bb4f66c75 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:05.922258 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 958/1897] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:46:05.926466 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cd2d1-3723-48b7-be67-3f5bb4f66c75 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:05.937496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cd2d1-3723-48b7-be67-3f5bb4f66c75 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:05.943173 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0283a9-5578-4870-8321-b8456e60a38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:05.943902 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0283a9-5578-4870-8321-b8456e60a38e admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:05.944195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0283a9-5578-4870-8321-b8456e60a38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:05.944473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0283a9-5578-4870-8321-b8456e60a38e admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:05.945174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0283a9-5578-4870-8321-b8456e60a38e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:05.947591 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0283a9-5578-4870-8321-b8456e60a38e admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:05.992381 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0214e3ef-7624-44b6-9b02-6d83e8adfbef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b503bbaa8a464182b1dd0c8f20dfa79d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:05.993172 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0214e3ef-7624-44b6-9b02-6d83e8adfbef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b503bbaa8a464182b1dd0c8f20dfa79d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:06.068757 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 959/1898] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:46:05 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:06.072790 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0283a9-5578-4870-8321-b8456e60a38e admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:06.216410 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0214e3ef-7624-44b6-9b02-6d83e8adfbef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b503bbaa8a464182b1dd0c8f20dfa79d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:06.243574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0283a9-5578-4870-8321-b8456e60a38e admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:06.244533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0214e3ef-7624-44b6-9b02-6d83e8adfbef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b503bbaa8a464182b1dd0c8f20dfa79d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:06.245774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0214e3ef-7624-44b6-9b02-6d83e8adfbef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b503bbaa8a464182b1dd0c8f20dfa79d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:06.256148 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe49a8-8f9f-4149-8337-348043b097de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:06.257092 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe49a8-8f9f-4149-8337-348043b097de admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:06.258056 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe49a8-8f9f-4149-8337-348043b097de admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:06.258409 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe49a8-8f9f-4149-8337-348043b097de admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:06.259459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe49a8-8f9f-4149-8337-348043b097de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:06.264794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe49a8-8f9f-4149-8337-348043b097de admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:06.267659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 940/1899] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:05 2022] DELETE /identity/v3/users/b503bbaa8a464182b1dd0c8f20dfa79d => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:06.273163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbf3ad-d851-460c-b37b-f284e1fef62e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:06.273873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbf3ad-d851-460c-b37b-f284e1fef62e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:06.274345 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbf3ad-d851-460c-b37b-f284e1fef62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:06.301131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-8ecbf3ad-d851-460c-b37b-f284e1fef62e None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:06.302366 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8ecbf3ad-d851-460c-b37b-f284e1fef62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:06.371096 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 941/1900] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:06.390684 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbf3ad-d851-460c-b37b-f284e1fef62e None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:06.407863 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8ecbf3ad-d851-460c-b37b-f284e1fef62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:06.437692 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 960/1901] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:46:06 2022] POST /identity/v3/users => generated 289 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:46:06.441905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe49a8-8f9f-4149-8337-348043b097de admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:06.445854 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-7ffe49a8-8f9f-4149-8337-348043b097de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:06.461926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe49a8-8f9f-4149-8337-348043b097de admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:06.466871 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26722956-ba2b-4b3a-b2c4-8e19dfbce353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:06.467809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26722956-ba2b-4b3a-b2c4-8e19dfbce353 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:06.467809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26722956-ba2b-4b3a-b2c4-8e19dfbce353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:06.467809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26722956-ba2b-4b3a-b2c4-8e19dfbce353 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:06.469832 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26722956-ba2b-4b3a-b2c4-8e19dfbce353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:06.471528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26722956-ba2b-4b3a-b2c4-8e19dfbce353 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:06.484729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 961/1902] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:06.487906 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26722956-ba2b-4b3a-b2c4-8e19dfbce353 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:06.502354 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26722956-ba2b-4b3a-b2c4-8e19dfbce353 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:06.508503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd3a36-b9d8-4b71-87ad-5c0e092e14ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:06.509452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd3a36-b9d8-4b71-87ad-5c0e092e14ec admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:06.509836 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd3a36-b9d8-4b71-87ad-5c0e092e14ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:06.510671 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd3a36-b9d8-4b71-87ad-5c0e092e14ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:06.511357 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd3a36-b9d8-4b71-87ad-5c0e092e14ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:06.513183 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd3a36-b9d8-4b71-87ad-5c0e092e14ec admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:06.530677 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 962/1903] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:06.533107 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd3a36-b9d8-4b71-87ad-5c0e092e14ec admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:06.545102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd3a36-b9d8-4b71-87ad-5c0e092e14ec admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:06.550930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbf3ad-d851-460c-b37b-f284e1fef62e None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:06.551643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71583364-e4d3-44ca-86ea-71bf3047d169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:06.552403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71583364-e4d3-44ca-86ea-71bf3047d169 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:06.552749 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71583364-e4d3-44ca-86ea-71bf3047d169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:06.553198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71583364-e4d3-44ca-86ea-71bf3047d169 admin admin] PATH_INFO: `/v3/projects/0ca8b27285c641af8a98b6b25df8c28c/users/6b708bfe91ac4aaa8c336245f1f0ea7f/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:06.563372 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71d575-99a6-414b-b331-e4f213a658df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:06.564812 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71d575-99a6-414b-b331-e4f213a658df service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:06.565174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71d575-99a6-414b-b331-e4f213a658df service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:06.565728 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71d575-99a6-414b-b331-e4f213a658df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:06.570108 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71583364-e4d3-44ca-86ea-71bf3047d169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca8b27285c641af8a98b6b25df8c28c, user_id=6b708bfe91ac4aaa8c336245f1f0ea7f, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:06.573255 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71583364-e4d3-44ca-86ea-71bf3047d169 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:06.576274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71d575-99a6-414b-b331-e4f213a658df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:06.577762 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71d575-99a6-414b-b331-e4f213a658df service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:06.589887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 942/1904] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:06.591488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a4578-d781-48f3-b65f-9094adf450ce None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:06.591782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a4578-d781-48f3-b65f-9094adf450ce None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:06.592064 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a4578-d781-48f3-b65f-9094adf450ce None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:06.593953 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 943/1905] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 18:46:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:46:06.606434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a4578-d781-48f3-b65f-9094adf450ce None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:06.609948 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f88a4578-d781-48f3-b65f-9094adf450ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:06.634906 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a4578-d781-48f3-b65f-9094adf450ce None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:06.641923 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625a893-13eb-4a46-8d16-c3a254fd58f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:06.642774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625a893-13eb-4a46-8d16-c3a254fd58f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:06.642914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625a893-13eb-4a46-8d16-c3a254fd58f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:06.643126 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625a893-13eb-4a46-8d16-c3a254fd58f6 admin admin] PATH_INFO: `/v3/projects/fae475af12784e64a8a3b917c0000574` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:06.644601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625a893-13eb-4a46-8d16-c3a254fd58f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fae475af12784e64a8a3b917c0000574)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:06.656596 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625a893-13eb-4a46-8d16-c3a254fd58f6 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:06.656868 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 963/1906] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:06 2022] PUT /identity/v3/projects/0ca8b27285c641af8a98b6b25df8c28c/users/6b708bfe91ac4aaa8c336245f1f0ea7f/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:06.656868 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae211cea-cb98-4a9b-b23f-a0fe161419a0 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:06.656868 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae211cea-cb98-4a9b-b23f-a0fe161419a0 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:06.656868 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae211cea-cb98-4a9b-b23f-a0fe161419a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:06.677028 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:06.683158 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-ae211cea-cb98-4a9b-b23f-a0fe161419a0 None None] MFA Rules not processed for user `be769d4dd016466f9174e7d5e47a2a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:06.686622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ae211cea-cb98-4a9b-b23f-a0fe161419a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:06.769823 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 964/1907] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 18:46:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:06.771290 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec7e31-4452-43bc-b34e-86545c81d413 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:06.771658 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec7e31-4452-43bc-b34e-86545c81d413 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:06.771937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec7e31-4452-43bc-b34e-86545c81d413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:06.806610 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-aaec7e31-4452-43bc-b34e-86545c81d413 None None] MFA Rules not processed for user `6b708bfe91ac4aaa8c336245f1f0ea7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:06.807995 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-aaec7e31-4452-43bc-b34e-86545c81d413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:06.810036 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5625a893-13eb-4a46-8d16-c3a254fd58f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fae475af12784e64a8a3b917c0000574', 'request_id': 'req-5625a893-13eb-4a46-8d16-c3a254fd58f6'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:06.817464 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5625a893-13eb-4a46-8d16-c3a254fd58f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fae475af12784e64a8a3b917c0000574', 'request_id': 'req-5625a893-13eb-4a46-8d16-c3a254fd58f6'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:06.889581 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 965/1908] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:06.893025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec7e31-4452-43bc-b34e-86545c81d413 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:06.894580 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5625a893-13eb-4a46-8d16-c3a254fd58f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fae475af12784e64a8a3b917c0000574', 'request_id': 'req-5625a893-13eb-4a46-8d16-c3a254fd58f6'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:06.905331 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-aaec7e31-4452-43bc-b34e-86545c81d413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:06.913269 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5625a893-13eb-4a46-8d16-c3a254fd58f6 admin admin] The token cache is being invalidate because project fae475af12784e64a8a3b917c0000574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:06.913571 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5625a893-13eb-4a46-8d16-c3a254fd58f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:06.914709 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5625a893-13eb-4a46-8d16-c3a254fd58f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:06.916610 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 944/1909] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:06 2022] DELETE /identity/v3/projects/fae475af12784e64a8a3b917c0000574 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:06.917585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625a893-13eb-4a46-8d16-c3a254fd58f6 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:06.923227 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5625a893-13eb-4a46-8d16-c3a254fd58f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:07.026617 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625a893-13eb-4a46-8d16-c3a254fd58f6 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:07.027058 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec7e31-4452-43bc-b34e-86545c81d413 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:07.033363 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68face-66fd-454c-af60-225dd849e5cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:07.033847 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f385d6-e5db-48e4-804f-58dea006f206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:07.034188 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68face-66fd-454c-af60-225dd849e5cd service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:07.034536 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68face-66fd-454c-af60-225dd849e5cd service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:07.034879 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68face-66fd-454c-af60-225dd849e5cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:07.035156 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f385d6-e5db-48e4-804f-58dea006f206 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:07.035707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f385d6-e5db-48e4-804f-58dea006f206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:07.036130 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f385d6-e5db-48e4-804f-58dea006f206 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:07.037103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-fb68face-66fd-454c-af60-225dd849e5cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:07.037686 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f385d6-e5db-48e4-804f-58dea006f206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:07.040040 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f385d6-e5db-48e4-804f-58dea006f206 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:07.055418 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68face-66fd-454c-af60-225dd849e5cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:07.057491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68face-66fd-454c-af60-225dd849e5cd service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:07.075931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 966/1910] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:07.079911 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fee3b-1b6f-4f05-833e-752092b03cd4 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:07.079911 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fee3b-1b6f-4f05-833e-752092b03cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:07.079911 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fee3b-1b6f-4f05-833e-752092b03cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:07.110962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-539fee3b-1b6f-4f05-833e-752092b03cd4 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:07.112845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-539fee3b-1b6f-4f05-833e-752092b03cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:07.131692 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 967/1911] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:07.138068 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fee3b-1b6f-4f05-833e-752092b03cd4 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:07.139142 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 945/1912] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:46:06 2022] POST /identity/v3/projects => generated 377 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:07.143856 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f385d6-e5db-48e4-804f-58dea006f206 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:07.147435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-539fee3b-1b6f-4f05-833e-752092b03cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:07.179826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fee3b-1b6f-4f05-833e-752092b03cd4 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:07.264077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa0f7d-cdcc-4cc2-ac2c-a5d16856d5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:07.264885 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa0f7d-cdcc-4cc2-ac2c-a5d16856d5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:07.265984 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa0f7d-cdcc-4cc2-ac2c-a5d16856d5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:07.266341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa0f7d-cdcc-4cc2-ac2c-a5d16856d5ea admin admin] PATH_INFO: `/v3/projects/e520cb3d06c04b71964aed0b23b4d25a` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:07.267880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa0f7d-cdcc-4cc2-ac2c-a5d16856d5ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=e520cb3d06c04b71964aed0b23b4d25a)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:07.269915 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa0f7d-cdcc-4cc2-ac2c-a5d16856d5ea admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:07.284983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f385d6-e5db-48e4-804f-58dea006f206 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:07.291881 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8453d-bd2c-4c07-a537-8e29d3a6cae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:07.295901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8453d-bd2c-4c07-a537-8e29d3a6cae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:07.296452 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8453d-bd2c-4c07-a537-8e29d3a6cae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:07.297389 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8453d-bd2c-4c07-a537-8e29d3a6cae8 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:07.298890 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8453d-bd2c-4c07-a537-8e29d3a6cae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:07.301183 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8453d-bd2c-4c07-a537-8e29d3a6cae8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:07.413478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-66aa0f7d-cdcc-4cc2-ac2c-a5d16856d5ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e520cb3d06c04b71964aed0b23b4d25a', 'request_id': 'req-66aa0f7d-cdcc-4cc2-ac2c-a5d16856d5ea'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:07.418864 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-66aa0f7d-cdcc-4cc2-ac2c-a5d16856d5ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e520cb3d06c04b71964aed0b23b4d25a', 'request_id': 'req-66aa0f7d-cdcc-4cc2-ac2c-a5d16856d5ea'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:07.431034 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 946/1913] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:46:07 2022] POST /identity/v3/users => generated 289 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:07.432647 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdd5f2-e76c-40d9-ba2c-a22974946799 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:07.433084 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdd5f2-e76c-40d9-ba2c-a22974946799 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:07.433370 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdd5f2-e76c-40d9-ba2c-a22974946799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:07.454747 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0fbdd5f2-e76c-40d9-ba2c-a22974946799 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:07.457634 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0fbdd5f2-e76c-40d9-ba2c-a22974946799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:07.527445 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-66aa0f7d-cdcc-4cc2-ac2c-a5d16856d5ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e520cb3d06c04b71964aed0b23b4d25a', 'request_id': 'req-66aa0f7d-cdcc-4cc2-ac2c-a5d16856d5ea'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:07.544261 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 947/1914] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:07.545197 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdd5f2-e76c-40d9-ba2c-a22974946799 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:07.567397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-66aa0f7d-cdcc-4cc2-ac2c-a5d16856d5ea admin admin] The token cache is being invalidate because project e520cb3d06c04b71964aed0b23b4d25a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:07.567764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-66aa0f7d-cdcc-4cc2-ac2c-a5d16856d5ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:07.567888 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdd5f2-e76c-40d9-ba2c-a22974946799 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:07.570353 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-66aa0f7d-cdcc-4cc2-ac2c-a5d16856d5ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:07.577109 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 968/1915] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:07 2022] DELETE /identity/v3/projects/e520cb3d06c04b71964aed0b23b4d25a => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:07.578341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa0f7d-cdcc-4cc2-ac2c-a5d16856d5ea admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:07.579154 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea4be1-d153-478b-83e7-ba336560e3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:07.579922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea4be1-d153-478b-83e7-ba336560e3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:07.580212 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea4be1-d153-478b-83e7-ba336560e3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:07.581181 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-66aa0f7d-cdcc-4cc2-ac2c-a5d16856d5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:07.581299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea4be1-d153-478b-83e7-ba336560e3a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:07.582996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea4be1-d153-478b-83e7-ba336560e3a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:07.587161 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea4be1-d153-478b-83e7-ba336560e3a7 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:07.611902 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa0f7d-cdcc-4cc2-ac2c-a5d16856d5ea admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:07.612084 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 948/1916] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:07.612084 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea4be1-d153-478b-83e7-ba336560e3a7 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:07.613987 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-76ea4be1-d153-478b-83e7-ba336560e3a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:07.628689 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020bb44-519c-491d-a01b-a0b53771819b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:07.629428 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020bb44-519c-491d-a01b-a0b53771819b admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:07.629538 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea4be1-d153-478b-83e7-ba336560e3a7 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:07.629789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020bb44-519c-491d-a01b-a0b53771819b admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:07.630183 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020bb44-519c-491d-a01b-a0b53771819b admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:07.631046 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020bb44-519c-491d-a01b-a0b53771819b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:46:07.631450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020bb44-519c-491d-a01b-a0b53771819b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:07.633162 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020bb44-519c-491d-a01b-a0b53771819b admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:07.634673 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bf33c-6b0b-49bb-bdca-65862b3190c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:07.635364 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bf33c-6b0b-49bb-bdca-65862b3190c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:07.635706 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bf33c-6b0b-49bb-bdca-65862b3190c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:07.635990 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bf33c-6b0b-49bb-bdca-65862b3190c8 admin admin] PATH_INFO: `/v3/users/961c0883d1fe46ef8cacf699020ff22b` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:07.637393 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bf33c-6b0b-49bb-bdca-65862b3190c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=961c0883d1fe46ef8cacf699020ff22b)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:07.639554 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bf33c-6b0b-49bb-bdca-65862b3190c8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:07.659403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 969/1917] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:46:07.660491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020bb44-519c-491d-a01b-a0b53771819b admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:07.662524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-9020bb44-519c-491d-a01b-a0b53771819b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:07.676749 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020bb44-519c-491d-a01b-a0b53771819b admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:07.682028 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c27e6-90d4-413b-9faf-90355e96aef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:07.682661 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c27e6-90d4-413b-9faf-90355e96aef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:07.683130 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c27e6-90d4-413b-9faf-90355e96aef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:07.683586 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c27e6-90d4-413b-9faf-90355e96aef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:07.684444 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c27e6-90d4-413b-9faf-90355e96aef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:07.686255 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c27e6-90d4-413b-9faf-90355e96aef7 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:07.699005 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 970/1918] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:07.700198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c27e6-90d4-413b-9faf-90355e96aef7 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:07.715715 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c27e6-90d4-413b-9faf-90355e96aef7 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:07.722987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddc8ef-1e3b-4147-a973-2154dea70f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:07.723964 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddc8ef-1e3b-4147-a973-2154dea70f1b admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:07.724175 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddc8ef-1e3b-4147-a973-2154dea70f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:07.724459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddc8ef-1e3b-4147-a973-2154dea70f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:07.725456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ddc8ef-1e3b-4147-a973-2154dea70f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:07.727982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ddc8ef-1e3b-4147-a973-2154dea70f1b admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:07.847353 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 971/1919] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:46:07 2022] POST /identity/v3/projects => generated 399 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:07.848562 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddc8ef-1e3b-4147-a973-2154dea70f1b admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:07.913178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddc8ef-1e3b-4147-a973-2154dea70f1b admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:07.921006 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cc6b5-deff-45f4-842e-9d25377e2a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:07.922386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cc6b5-deff-45f4-842e-9d25377e2a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:07.922674 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cc6b5-deff-45f4-842e-9d25377e2a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:07.922946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cc6b5-deff-45f4-842e-9d25377e2a57 admin admin] PATH_INFO: `/v3/projects/80fd90f0137d4e1fa7fb15d0c2d4d03b/users/333ec5629cad40b2a9a24160e6b22170/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:07.948118 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cc6b5-deff-45f4-842e-9d25377e2a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80fd90f0137d4e1fa7fb15d0c2d4d03b, user_id=333ec5629cad40b2a9a24160e6b22170, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:07.950907 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cc6b5-deff-45f4-842e-9d25377e2a57 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:07.994640 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5e7bf33c-6b0b-49bb-bdca-65862b3190c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '961c0883d1fe46ef8cacf699020ff22b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:07.995056 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5e7bf33c-6b0b-49bb-bdca-65862b3190c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '961c0883d1fe46ef8cacf699020ff22b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:08.021777 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 972/1920] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:07 2022] PUT /identity/v3/projects/80fd90f0137d4e1fa7fb15d0c2d4d03b/users/333ec5629cad40b2a9a24160e6b22170/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:08.022743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cc6b5-deff-45f4-842e-9d25377e2a57 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:08.084249 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cc6b5-deff-45f4-842e-9d25377e2a57 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:08.086780 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5e7bf33c-6b0b-49bb-bdca-65862b3190c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '961c0883d1fe46ef8cacf699020ff22b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:08.089286 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11954b86-416b-44ae-bd8b-4c0d3a9f140d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:08.089913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11954b86-416b-44ae-bd8b-4c0d3a9f140d admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:08.090201 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11954b86-416b-44ae-bd8b-4c0d3a9f140d admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:08.090484 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11954b86-416b-44ae-bd8b-4c0d3a9f140d admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:08.091282 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11954b86-416b-44ae-bd8b-4c0d3a9f140d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:08.093838 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11954b86-416b-44ae-bd8b-4c0d3a9f140d admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:08.117430 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5e7bf33c-6b0b-49bb-bdca-65862b3190c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '961c0883d1fe46ef8cacf699020ff22b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:08.118199 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5e7bf33c-6b0b-49bb-bdca-65862b3190c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '961c0883d1fe46ef8cacf699020ff22b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:08.131549 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 949/1921] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:07 2022] DELETE /identity/v3/users/961c0883d1fe46ef8cacf699020ff22b => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:08.135866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8da98e-bb8e-40af-b35f-059871fdee6a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:08.136143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8da98e-bb8e-40af-b35f-059871fdee6a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:08.136427 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8da98e-bb8e-40af-b35f-059871fdee6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:08.174440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 973/1922] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:46:08 2022] POST /identity/v3/users => generated 300 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:08.178691 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11954b86-416b-44ae-bd8b-4c0d3a9f140d admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:08.181222 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-8c8da98e-bb8e-40af-b35f-059871fdee6a None None] MFA Rules not processed for user `333ec5629cad40b2a9a24160e6b22170`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:08.182488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8c8da98e-bb8e-40af-b35f-059871fdee6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:08.183677 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-11954b86-416b-44ae-bd8b-4c0d3a9f140d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:08.196821 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11954b86-416b-44ae-bd8b-4c0d3a9f140d admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:08.272964 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f29a9-680c-4f6e-833a-ff98939c21d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:08.273244 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f29a9-680c-4f6e-833a-ff98939c21d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:08.273332 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f29a9-680c-4f6e-833a-ff98939c21d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:08.273595 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f29a9-680c-4f6e-833a-ff98939c21d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:08.274324 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f29a9-680c-4f6e-833a-ff98939c21d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:08.276438 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f29a9-680c-4f6e-833a-ff98939c21d2 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:08.284491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 950/1923] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:08.289436 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8da98e-bb8e-40af-b35f-059871fdee6a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:08.291323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8c8da98e-bb8e-40af-b35f-059871fdee6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:08.297499 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 974/1924] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:08.301061 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f29a9-680c-4f6e-833a-ff98939c21d2 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:08.309896 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8da98e-bb8e-40af-b35f-059871fdee6a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:08.315871 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f29a9-680c-4f6e-833a-ff98939c21d2 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:08.317975 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353ade9-f7ed-433d-a2b5-7fe840fc9b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:08.318735 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353ade9-f7ed-433d-a2b5-7fe840fc9b90 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:08.319128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353ade9-f7ed-433d-a2b5-7fe840fc9b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:08.319555 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353ade9-f7ed-433d-a2b5-7fe840fc9b90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:08.320349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353ade9-f7ed-433d-a2b5-7fe840fc9b90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:08.322557 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353ade9-f7ed-433d-a2b5-7fe840fc9b90 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:08.323843 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc74ed-73c7-4936-b437-3156a3c2ffaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:08.324698 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc74ed-73c7-4936-b437-3156a3c2ffaf admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:08.325127 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc74ed-73c7-4936-b437-3156a3c2ffaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:08.325581 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc74ed-73c7-4936-b437-3156a3c2ffaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:08.326478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc74ed-73c7-4936-b437-3156a3c2ffaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:08.329104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc74ed-73c7-4936-b437-3156a3c2ffaf admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:08.342594 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 975/1925] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:08.347456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc74ed-73c7-4936-b437-3156a3c2ffaf admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:08.358354 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc74ed-73c7-4936-b437-3156a3c2ffaf admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:08.364624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab7064-47c6-4a90-a00c-c9b71119c1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:08.365439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab7064-47c6-4a90-a00c-c9b71119c1e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:08.365722 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab7064-47c6-4a90-a00c-c9b71119c1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:08.366521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab7064-47c6-4a90-a00c-c9b71119c1e6 admin admin] PATH_INFO: `/v3/projects/ba3485e2964c43f4afad03c7c128d909/users/68d812222cd2474d8dc8566811a2ac6c/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:08.388224 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab7064-47c6-4a90-a00c-c9b71119c1e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3485e2964c43f4afad03c7c128d909, user_id=68d812222cd2474d8dc8566811a2ac6c, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:08.392811 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab7064-47c6-4a90-a00c-c9b71119c1e6 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:08.399217 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:08.435774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 951/1926] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:46:08 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:08.439175 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353ade9-f7ed-433d-a2b5-7fe840fc9b90 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:08.514314 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353ade9-f7ed-433d-a2b5-7fe840fc9b90 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:08.520304 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fd45d-4936-4f87-bd24-cc0380c59add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:08.520475 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fd45d-4936-4f87-bd24-cc0380c59add admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:08.520730 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fd45d-4936-4f87-bd24-cc0380c59add admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:08.521012 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fd45d-4936-4f87-bd24-cc0380c59add admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:08.521686 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fd45d-4936-4f87-bd24-cc0380c59add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:08.523655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fd45d-4936-4f87-bd24-cc0380c59add admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:08.542797 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 976/1927] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:08 2022] PUT /identity/v3/projects/ba3485e2964c43f4afad03c7c128d909/users/68d812222cd2474d8dc8566811a2ac6c/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:08.550631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cfb38-c0a3-4786-bc1a-0cbb1d194361 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:08.550900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cfb38-c0a3-4786-bc1a-0cbb1d194361 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:08.551185 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cfb38-c0a3-4786-bc1a-0cbb1d194361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:08.602038 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-386cfb38-c0a3-4786-bc1a-0cbb1d194361 None None] MFA Rules not processed for user `68d812222cd2474d8dc8566811a2ac6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:08.603711 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-386cfb38-c0a3-4786-bc1a-0cbb1d194361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:08.686752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 977/1928] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:08.699405 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386cfb38-c0a3-4786-bc1a-0cbb1d194361 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:08.701146 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-386cfb38-c0a3-4786-bc1a-0cbb1d194361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:08.703755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 952/1929] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:46:08 2022] POST /identity/v3/users => generated 296 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:46:08.707646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fd45d-4936-4f87-bd24-cc0380c59add admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:08.719334 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fd45d-4936-4f87-bd24-cc0380c59add admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:08.764246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386cfb38-c0a3-4786-bc1a-0cbb1d194361 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:08.771417 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8d04c-7446-4c12-b6ad-559fa81e7894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:08.772753 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8d04c-7446-4c12-b6ad-559fa81e7894 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:08.773047 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8d04c-7446-4c12-b6ad-559fa81e7894 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:08.773329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8d04c-7446-4c12-b6ad-559fa81e7894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:08.779887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c7b66-0154-4529-827f-16040491d825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:08.780971 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c7b66-0154-4529-827f-16040491d825 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:08.780971 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c7b66-0154-4529-827f-16040491d825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:08.781282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c7b66-0154-4529-827f-16040491d825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:08.782055 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c7b66-0154-4529-827f-16040491d825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:08.784211 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c7b66-0154-4529-827f-16040491d825 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:08.788839 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8d04c-7446-4c12-b6ad-559fa81e7894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:08.790494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8d04c-7446-4c12-b6ad-559fa81e7894 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:08.796513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 953/1930] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:46:08.797858 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c7b66-0154-4529-827f-16040491d825 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:08.800637 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-137c7b66-0154-4529-827f-16040491d825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:08.814790 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c7b66-0154-4529-827f-16040491d825 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:08.823199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 978/1931] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:08 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:08.824093 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8d04c-7446-4c12-b6ad-559fa81e7894 service cinder] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:08.832908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce4e59-0bd0-4015-90c5-58f000b2a836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:08.833938 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce4e59-0bd0-4015-90c5-58f000b2a836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:08.834376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce4e59-0bd0-4015-90c5-58f000b2a836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:08.834931 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce4e59-0bd0-4015-90c5-58f000b2a836 admin admin] PATH_INFO: `/v3/projects/4970add38ce7468787192bc6d8910e0c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:08.836680 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce4e59-0bd0-4015-90c5-58f000b2a836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4970add38ce7468787192bc6d8910e0c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:08.840270 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce4e59-0bd0-4015-90c5-58f000b2a836 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:08.877687 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8d04c-7446-4c12-b6ad-559fa81e7894 service cinder] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:08.900143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd7b3f-424d-475f-9223-04116c27be0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:08.901187 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd7b3f-424d-475f-9223-04116c27be0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:08.901623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd7b3f-424d-475f-9223-04116c27be0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:08.902112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd7b3f-424d-475f-9223-04116c27be0a admin admin] PATH_INFO: `/v3/projects/4fa51c690f224ae38df7a30064dfb4c3/users/90bdc302c9c84b439e7424a2153c5573/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:08.941944 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd7b3f-424d-475f-9223-04116c27be0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fa51c690f224ae38df7a30064dfb4c3, user_id=90bdc302c9c84b439e7424a2153c5573, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:08.946206 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd7b3f-424d-475f-9223-04116c27be0a admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:08.975061 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2dce4e59-0bd0-4015-90c5-58f000b2a836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4970add38ce7468787192bc6d8910e0c', 'request_id': 'req-2dce4e59-0bd0-4015-90c5-58f000b2a836'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:08.985958 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2dce4e59-0bd0-4015-90c5-58f000b2a836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4970add38ce7468787192bc6d8910e0c', 'request_id': 'req-2dce4e59-0bd0-4015-90c5-58f000b2a836'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:09.043057 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 979/1932] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:08 2022] PUT /identity/v3/projects/4fa51c690f224ae38df7a30064dfb4c3/users/90bdc302c9c84b439e7424a2153c5573/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:09.047370 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd7b3f-424d-475f-9223-04116c27be0a admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:09.072556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:09.121131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2dce4e59-0bd0-4015-90c5-58f000b2a836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4970add38ce7468787192bc6d8910e0c', 'request_id': 'req-2dce4e59-0bd0-4015-90c5-58f000b2a836'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:09.137335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2dce4e59-0bd0-4015-90c5-58f000b2a836 admin admin] The token cache is being invalidate because project 4970add38ce7468787192bc6d8910e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:09.137629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2dce4e59-0bd0-4015-90c5-58f000b2a836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:09.138409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2dce4e59-0bd0-4015-90c5-58f000b2a836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:09.148700 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 954/1933] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:08 2022] DELETE /identity/v3/projects/4970add38ce7468787192bc6d8910e0c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:09.157188 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f4c08-6ab0-4a6c-98e1-942bfa2601d2 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:09.157188 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f4c08-6ab0-4a6c-98e1-942bfa2601d2 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:09.157554 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f4c08-6ab0-4a6c-98e1-942bfa2601d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:09.170406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd7b3f-424d-475f-9223-04116c27be0a admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:09.176471 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ad4ee-6096-41cf-805c-ec4028bcf448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:09.177152 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ad4ee-6096-41cf-805c-ec4028bcf448 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:09.177434 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ad4ee-6096-41cf-805c-ec4028bcf448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:09.177712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ad4ee-6096-41cf-805c-ec4028bcf448 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:09.178411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ad4ee-6096-41cf-805c-ec4028bcf448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:09.180146 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ad4ee-6096-41cf-805c-ec4028bcf448 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:09.195324 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a88f4c08-6ab0-4a6c-98e1-942bfa2601d2 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:09.196381 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 980/1934] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:46:09.196625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a88f4c08-6ab0-4a6c-98e1-942bfa2601d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:09.201967 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ad4ee-6096-41cf-805c-ec4028bcf448 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:09.203761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-496ad4ee-6096-41cf-805c-ec4028bcf448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:09.216434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 955/1935] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:09.228578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa74701-4d5f-458f-b7c0-038a3e0a4935 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:09.228902 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa74701-4d5f-458f-b7c0-038a3e0a4935 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:09.230005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa74701-4d5f-458f-b7c0-038a3e0a4935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:09.231234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ad4ee-6096-41cf-805c-ec4028bcf448 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:09.238980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7158c27-2453-45fd-9370-027f0a92cd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:09.239802 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7158c27-2453-45fd-9370-027f0a92cd28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:09.240079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7158c27-2453-45fd-9370-027f0a92cd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:09.242804 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7158c27-2453-45fd-9370-027f0a92cd28 admin admin] PATH_INFO: `/v3/projects/4fa51c690f224ae38df7a30064dfb4c3/users/90bdc302c9c84b439e7424a2153c5573/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:09.242804 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7158c27-2453-45fd-9370-027f0a92cd28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fa51c690f224ae38df7a30064dfb4c3, user_id=90bdc302c9c84b439e7424a2153c5573, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:09.245509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7158c27-2453-45fd-9370-027f0a92cd28 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:09.256727 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-1aa74701-4d5f-458f-b7c0-038a3e0a4935 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:09.258466 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1aa74701-4d5f-458f-b7c0-038a3e0a4935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:09.260454 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 981/1936] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:09 2022] PUT /identity/v3/projects/4fa51c690f224ae38df7a30064dfb4c3/users/90bdc302c9c84b439e7424a2153c5573/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:09.275628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41de0ad-716d-4470-9de6-b8615f113349 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:09.275923 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41de0ad-716d-4470-9de6-b8615f113349 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:09.276211 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41de0ad-716d-4470-9de6-b8615f113349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:09.305746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-e41de0ad-716d-4470-9de6-b8615f113349 None None] MFA Rules not processed for user `90bdc302c9c84b439e7424a2153c5573`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:09.307012 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e41de0ad-716d-4470-9de6-b8615f113349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:09.327720 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 956/1937] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:46:09.331897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa74701-4d5f-458f-b7c0-038a3e0a4935 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:09.343047 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa74701-4d5f-458f-b7c0-038a3e0a4935 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:09.348206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86356821-c044-459b-b870-fcb3d8dd4fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:09.348835 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86356821-c044-459b-b870-fcb3d8dd4fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:09.349121 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86356821-c044-459b-b870-fcb3d8dd4fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:09.349399 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86356821-c044-459b-b870-fcb3d8dd4fd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:09.350106 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86356821-c044-459b-b870-fcb3d8dd4fd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:46:09.350421 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86356821-c044-459b-b870-fcb3d8dd4fd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:09.352089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86356821-c044-459b-b870-fcb3d8dd4fd1 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:09.364556 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 957/1938] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:46:09.369011 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86356821-c044-459b-b870-fcb3d8dd4fd1 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:09.380221 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86356821-c044-459b-b870-fcb3d8dd4fd1 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:09.386812 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 982/1939] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:46:09.387806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fd323-d491-4bc9-b8ae-1332253e35b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:09.388572 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fd323-d491-4bc9-b8ae-1332253e35b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:09.388869 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fd323-d491-4bc9-b8ae-1332253e35b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:09.389139 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fd323-d491-4bc9-b8ae-1332253e35b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:09.389824 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2fd323-d491-4bc9-b8ae-1332253e35b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:09.391964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2fd323-d491-4bc9-b8ae-1332253e35b0 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:09.400372 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41de0ad-716d-4470-9de6-b8615f113349 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:09.402390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e41de0ad-716d-4470-9de6-b8615f113349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:09.487996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41de0ad-716d-4470-9de6-b8615f113349 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:09.492286 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bd51a-46da-4b60-9c1d-22c3a945d15c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:09.493018 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bd51a-46da-4b60-9c1d-22c3a945d15c service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:09.493305 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bd51a-46da-4b60-9c1d-22c3a945d15c service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:09.493584 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bd51a-46da-4b60-9c1d-22c3a945d15c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:09.503422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bd51a-46da-4b60-9c1d-22c3a945d15c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:09.505022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bd51a-46da-4b60-9c1d-22c3a945d15c service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:09.515464 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 983/1940] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:46:09.532428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 958/1941] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:46:09 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:46:09.536734 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bd51a-46da-4b60-9c1d-22c3a945d15c service cinder] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:09.565661 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bd51a-46da-4b60-9c1d-22c3a945d15c service cinder] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:09.636855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fd323-d491-4bc9-b8ae-1332253e35b0 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:09.648328 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335cf71-2904-40fe-bddc-9f809f5dc6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:09.648968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335cf71-2904-40fe-bddc-9f809f5dc6fc admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:09.649298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335cf71-2904-40fe-bddc-9f809f5dc6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:09.649531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335cf71-2904-40fe-bddc-9f809f5dc6fc admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:09.650217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335cf71-2904-40fe-bddc-9f809f5dc6fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:09.652539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335cf71-2904-40fe-bddc-9f809f5dc6fc admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:09.695804 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fd323-d491-4bc9-b8ae-1332253e35b0 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:09.700020 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b5174-f3f7-42e2-abe1-53faa1d961e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:09.700593 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b5174-f3f7-42e2-abe1-53faa1d961e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:09.700879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b5174-f3f7-42e2-abe1-53faa1d961e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:09.701159 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b5174-f3f7-42e2-abe1-53faa1d961e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:09.703084 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-788b5174-f3f7-42e2-abe1-53faa1d961e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:09.728216 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:09.797342 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 984/1942] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:46:09 2022] POST /identity/v3/users => generated 283 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:09.798933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b5174-f3f7-42e2-abe1-53faa1d961e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:09.800492 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b5174-f3f7-42e2-abe1-53faa1d961e5 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:09.815492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335cf71-2904-40fe-bddc-9f809f5dc6fc admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:09.818377 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 959/1943] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:09.830669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335cf71-2904-40fe-bddc-9f809f5dc6fc admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:09.838101 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a72e61-5874-47b1-9340-18abe412f19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:09.839117 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a72e61-5874-47b1-9340-18abe412f19a admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:09.839565 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a72e61-5874-47b1-9340-18abe412f19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:09.839848 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a72e61-5874-47b1-9340-18abe412f19a admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:09.840936 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a72e61-5874-47b1-9340-18abe412f19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:09.844834 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a72e61-5874-47b1-9340-18abe412f19a admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:09.859761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 985/1944] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:09.862817 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b5174-f3f7-42e2-abe1-53faa1d961e5 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:09.875498 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b5174-f3f7-42e2-abe1-53faa1d961e5 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:09.882811 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0c96c-606a-4de7-9d27-d695dd283ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:09.883493 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0c96c-606a-4de7-9d27-d695dd283ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:09.883789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0c96c-606a-4de7-9d27-d695dd283ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:09.884200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0c96c-606a-4de7-9d27-d695dd283ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:09.884851 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0c96c-606a-4de7-9d27-d695dd283ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:09.886466 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0c96c-606a-4de7-9d27-d695dd283ca5 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:09.899297 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 960/1945] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:09.902360 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a72e61-5874-47b1-9340-18abe412f19a admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:09.913285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a72e61-5874-47b1-9340-18abe412f19a admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:09.917973 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35273a-1712-4fbf-95b9-1fb809982810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:09.918654 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35273a-1712-4fbf-95b9-1fb809982810 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:09.919425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35273a-1712-4fbf-95b9-1fb809982810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:09.919425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35273a-1712-4fbf-95b9-1fb809982810 admin admin] PATH_INFO: `/v3/projects/8e6b0b15c47240cea71344ffe8bfb286/users/b7031500eef247eaa01ed41d2afe2c80/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:09.935692 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35273a-1712-4fbf-95b9-1fb809982810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6b0b15c47240cea71344ffe8bfb286, user_id=b7031500eef247eaa01ed41d2afe2c80, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:09.938621 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35273a-1712-4fbf-95b9-1fb809982810 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:10.037438 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 986/1946] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:09 2022] PUT /identity/v3/projects/8e6b0b15c47240cea71344ffe8bfb286/users/b7031500eef247eaa01ed41d2afe2c80/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:10.046985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44cb23-72c4-4f58-a13f-cdce8f9456d2 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:10.047616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44cb23-72c4-4f58-a13f-cdce8f9456d2 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:10.047994 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44cb23-72c4-4f58-a13f-cdce8f9456d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:10.088597 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-2b44cb23-72c4-4f58-a13f-cdce8f9456d2 None None] MFA Rules not processed for user `b7031500eef247eaa01ed41d2afe2c80`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:10.089833 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2b44cb23-72c4-4f58-a13f-cdce8f9456d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:10.186711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 961/1947] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:10.193164 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35273a-1712-4fbf-95b9-1fb809982810 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:10.331712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35273a-1712-4fbf-95b9-1fb809982810 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:10.338086 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776de075-47b6-4a66-81e8-d59ea17abf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:10.339392 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776de075-47b6-4a66-81e8-d59ea17abf1f admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:10.339987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776de075-47b6-4a66-81e8-d59ea17abf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:10.341113 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776de075-47b6-4a66-81e8-d59ea17abf1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:10.342175 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776de075-47b6-4a66-81e8-d59ea17abf1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:10.344885 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776de075-47b6-4a66-81e8-d59ea17abf1f admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:10.399623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:10.472930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 987/1948] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:46:10 2022] POST /identity/v3/projects => generated 365 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:10.473727 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44cb23-72c4-4f58-a13f-cdce8f9456d2 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:10.498375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44cb23-72c4-4f58-a13f-cdce8f9456d2 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:10.580820 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6aec31-2817-411e-b9e1-5d62876d734f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:10.581614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6aec31-2817-411e-b9e1-5d62876d734f admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:10.581928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6aec31-2817-411e-b9e1-5d62876d734f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:10.594162 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6aec31-2817-411e-b9e1-5d62876d734f admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:10.594974 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6aec31-2817-411e-b9e1-5d62876d734f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:10.596966 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6aec31-2817-411e-b9e1-5d62876d734f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:10.724047 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 962/1949] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:46:10 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:10.728118 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776de075-47b6-4a66-81e8-d59ea17abf1f admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:10.742269 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776de075-47b6-4a66-81e8-d59ea17abf1f admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:10.748092 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902714c-c42d-4ffd-b9c1-deafb9cb44fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:10.750040 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902714c-c42d-4ffd-b9c1-deafb9cb44fb admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:10.750384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902714c-c42d-4ffd-b9c1-deafb9cb44fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:10.750670 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902714c-c42d-4ffd-b9c1-deafb9cb44fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:10.751833 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902714c-c42d-4ffd-b9c1-deafb9cb44fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:10.753560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902714c-c42d-4ffd-b9c1-deafb9cb44fb admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:10.769238 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 988/1950] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:10.773550 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6aec31-2817-411e-b9e1-5d62876d734f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:10.784416 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6aec31-2817-411e-b9e1-5d62876d734f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:10.789274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52af1c-612b-48c0-8eff-a9d8b2d5b000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:10.790176 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52af1c-612b-48c0-8eff-a9d8b2d5b000 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:10.790448 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52af1c-612b-48c0-8eff-a9d8b2d5b000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:10.790775 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52af1c-612b-48c0-8eff-a9d8b2d5b000 admin admin] PATH_INFO: `/v3/projects/1e108deeaa0b4b758e7e4dbab12e1743/users/03e6f73b414f44d8b260165292a41778/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:10.808596 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52af1c-612b-48c0-8eff-a9d8b2d5b000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e108deeaa0b4b758e7e4dbab12e1743, user_id=03e6f73b414f44d8b260165292a41778, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:10.811405 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52af1c-612b-48c0-8eff-a9d8b2d5b000 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:10.930414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 963/1951] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:10 2022] PUT /identity/v3/projects/1e108deeaa0b4b758e7e4dbab12e1743/users/03e6f73b414f44d8b260165292a41778/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:10.931921 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902714c-c42d-4ffd-b9c1-deafb9cb44fb admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:10.944659 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902714c-c42d-4ffd-b9c1-deafb9cb44fb admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:11.034655 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534819c-8ef1-47a6-bda7-b6422d20cb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:11.035245 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534819c-8ef1-47a6-bda7-b6422d20cb79 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:11.035832 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534819c-8ef1-47a6-bda7-b6422d20cb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:11.035832 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534819c-8ef1-47a6-bda7-b6422d20cb79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:11.036517 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534819c-8ef1-47a6-bda7-b6422d20cb79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:11.038338 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534819c-8ef1-47a6-bda7-b6422d20cb79 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:11.051109 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 989/1952] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:11.055837 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52af1c-612b-48c0-8eff-a9d8b2d5b000 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:11.069088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52af1c-612b-48c0-8eff-a9d8b2d5b000 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:11.073892 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a63402-3901-4504-b463-5d0fc5773e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:11.074569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a63402-3901-4504-b463-5d0fc5773e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:11.074850 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a63402-3901-4504-b463-5d0fc5773e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:11.075128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a63402-3901-4504-b463-5d0fc5773e78 admin admin] PATH_INFO: `/v3/projects/1e108deeaa0b4b758e7e4dbab12e1743/users/03e6f73b414f44d8b260165292a41778/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:11.077146 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a63402-3901-4504-b463-5d0fc5773e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e108deeaa0b4b758e7e4dbab12e1743, user_id=03e6f73b414f44d8b260165292a41778, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:11.080428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a63402-3901-4504-b463-5d0fc5773e78 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:11.092293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 964/1953] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:11 2022] PUT /identity/v3/projects/1e108deeaa0b4b758e7e4dbab12e1743/users/03e6f73b414f44d8b260165292a41778/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:11.104359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca75dd1-ba8d-49cf-8304-e92915433d16 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:11.104650 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca75dd1-ba8d-49cf-8304-e92915433d16 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:11.104945 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca75dd1-ba8d-49cf-8304-e92915433d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:11.135873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-8ca75dd1-ba8d-49cf-8304-e92915433d16 None None] MFA Rules not processed for user `03e6f73b414f44d8b260165292a41778`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:11.137097 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-8ca75dd1-ba8d-49cf-8304-e92915433d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:11.214586 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 990/1954] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:11 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:11.226494 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a63402-3901-4504-b463-5d0fc5773e78 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:11.290424 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a63402-3901-4504-b463-5d0fc5773e78 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:11.294208 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab40d8e-1c5b-410b-b7de-038c65780e88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:11.294846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab40d8e-1c5b-410b-b7de-038c65780e88 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:11.295131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab40d8e-1c5b-410b-b7de-038c65780e88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:11.295446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab40d8e-1c5b-410b-b7de-038c65780e88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:11.304669 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab40d8e-1c5b-410b-b7de-038c65780e88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:11.306111 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab40d8e-1c5b-410b-b7de-038c65780e88 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:11.316450 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 965/1955] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:46:11.620650 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca75dd1-ba8d-49cf-8304-e92915433d16 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:11.634901 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca75dd1-ba8d-49cf-8304-e92915433d16 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:11.640595 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b64ed-ebab-4eb8-8a10-0654bd97156b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:11.641536 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b64ed-ebab-4eb8-8a10-0654bd97156b service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:11.641822 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b64ed-ebab-4eb8-8a10-0654bd97156b service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:11.642098 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b64ed-ebab-4eb8-8a10-0654bd97156b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:11.716860 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b64ed-ebab-4eb8-8a10-0654bd97156b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:11.718869 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b64ed-ebab-4eb8-8a10-0654bd97156b service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:11.729322 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 991/1956] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:12.319027 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:12.409139 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:15.070112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:15.190359 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:15.280909 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab40d8e-1c5b-410b-b7de-038c65780e88 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:15.366984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab40d8e-1c5b-410b-b7de-038c65780e88 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:15.372555 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49719d-37f5-4731-ac80-936ad94e6319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:15.373482 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49719d-37f5-4731-ac80-936ad94e6319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:15.374053 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49719d-37f5-4731-ac80-936ad94e6319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:15.374169 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49719d-37f5-4731-ac80-936ad94e6319 admin admin] PATH_INFO: `/v3/users/6b708bfe91ac4aaa8c336245f1f0ea7f` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:15.380395 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49719d-37f5-4731-ac80-936ad94e6319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b708bfe91ac4aaa8c336245f1f0ea7f)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:15.381438 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49719d-37f5-4731-ac80-936ad94e6319 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:15.650732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6b49719d-37f5-4731-ac80-936ad94e6319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b708bfe91ac4aaa8c336245f1f0ea7f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:15.652070 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6b49719d-37f5-4731-ac80-936ad94e6319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b708bfe91ac4aaa8c336245f1f0ea7f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:15.742087 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6b49719d-37f5-4731-ac80-936ad94e6319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b708bfe91ac4aaa8c336245f1f0ea7f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:15.776666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6b49719d-37f5-4731-ac80-936ad94e6319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b708bfe91ac4aaa8c336245f1f0ea7f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:15.777752 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6b49719d-37f5-4731-ac80-936ad94e6319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b708bfe91ac4aaa8c336245f1f0ea7f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:15.801258 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 966/1957] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:15 2022] DELETE /identity/v3/users/6b708bfe91ac4aaa8c336245f1f0ea7f => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:15.802872 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b252aca-4d23-47e8-8d48-8ee05d10b72b None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:15.803161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b252aca-4d23-47e8-8d48-8ee05d10b72b None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:15.803470 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b252aca-4d23-47e8-8d48-8ee05d10b72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:15.832968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-2b252aca-4d23-47e8-8d48-8ee05d10b72b None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:15.837333 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2b252aca-4d23-47e8-8d48-8ee05d10b72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:15.838398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49719d-37f5-4731-ac80-936ad94e6319 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:15.840905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6b49719d-37f5-4731-ac80-936ad94e6319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:15.945984 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 992/1958] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:15.956847 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b252aca-4d23-47e8-8d48-8ee05d10b72b None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:15.958267 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2b252aca-4d23-47e8-8d48-8ee05d10b72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:15.990650 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49719d-37f5-4731-ac80-936ad94e6319 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:15.996332 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3343ad6-0dd8-4f99-8dd2-5739e8aa0be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:15.996998 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3343ad6-0dd8-4f99-8dd2-5739e8aa0be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:15.997286 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3343ad6-0dd8-4f99-8dd2-5739e8aa0be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:15.997566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3343ad6-0dd8-4f99-8dd2-5739e8aa0be3 admin admin] PATH_INFO: `/v3/users/68d812222cd2474d8dc8566811a2ac6c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:15.998867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3343ad6-0dd8-4f99-8dd2-5739e8aa0be3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d812222cd2474d8dc8566811a2ac6c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:16.001323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3343ad6-0dd8-4f99-8dd2-5739e8aa0be3 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:16.033036 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b252aca-4d23-47e8-8d48-8ee05d10b72b None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:16.041409 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc35e98-f29e-4dec-b00f-0eaa117d38c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:16.043619 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc35e98-f29e-4dec-b00f-0eaa117d38c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:16.045022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc35e98-f29e-4dec-b00f-0eaa117d38c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:16.047327 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc35e98-f29e-4dec-b00f-0eaa117d38c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:16.061405 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc35e98-f29e-4dec-b00f-0eaa117d38c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:16.062871 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc35e98-f29e-4dec-b00f-0eaa117d38c3 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:16.075514 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 993/1959] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:16.231968 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d3343ad6-0dd8-4f99-8dd2-5739e8aa0be3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d812222cd2474d8dc8566811a2ac6c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:16.232900 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d3343ad6-0dd8-4f99-8dd2-5739e8aa0be3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d812222cd2474d8dc8566811a2ac6c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:16.347295 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d3343ad6-0dd8-4f99-8dd2-5739e8aa0be3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d812222cd2474d8dc8566811a2ac6c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:16.370683 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d3343ad6-0dd8-4f99-8dd2-5739e8aa0be3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d812222cd2474d8dc8566811a2ac6c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:16.371925 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d3343ad6-0dd8-4f99-8dd2-5739e8aa0be3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d812222cd2474d8dc8566811a2ac6c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:16.410009 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 967/1960] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:15 2022] DELETE /identity/v3/users/68d812222cd2474d8dc8566811a2ac6c => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:16.424899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b5b2d-5bec-4049-a92d-67af897c59fb None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:16.425199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b5b2d-5bec-4049-a92d-67af897c59fb None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:16.425482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b5b2d-5bec-4049-a92d-67af897c59fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:16.487768 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-376b5b2d-5bec-4049-a92d-67af897c59fb None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:16.489049 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-376b5b2d-5bec-4049-a92d-67af897c59fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:16.631490 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 994/1961] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:16.643180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3343ad6-0dd8-4f99-8dd2-5739e8aa0be3 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:16.644828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d3343ad6-0dd8-4f99-8dd2-5739e8aa0be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:16.735130 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3343ad6-0dd8-4f99-8dd2-5739e8aa0be3 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:16.742236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63528b24-e20f-4cc1-b2b0-7504f37e07d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:16.743437 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63528b24-e20f-4cc1-b2b0-7504f37e07d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:16.743999 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63528b24-e20f-4cc1-b2b0-7504f37e07d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:16.744599 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63528b24-e20f-4cc1-b2b0-7504f37e07d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:16.759982 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63528b24-e20f-4cc1-b2b0-7504f37e07d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:16.762947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63528b24-e20f-4cc1-b2b0-7504f37e07d9 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:16.774725 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b5b2d-5bec-4049-a92d-67af897c59fb None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:16.774725 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-376b5b2d-5bec-4049-a92d-67af897c59fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:16.777472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 968/1962] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:16.796293 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b5b2d-5bec-4049-a92d-67af897c59fb None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:16.805644 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42687c-1e7c-44c3-a9b9-c60c1ae31268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:16.807029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42687c-1e7c-44c3-a9b9-c60c1ae31268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:16.807558 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42687c-1e7c-44c3-a9b9-c60c1ae31268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:16.808067 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42687c-1e7c-44c3-a9b9-c60c1ae31268 admin admin] PATH_INFO: `/v3/projects/0ca8b27285c641af8a98b6b25df8c28c` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:16.809826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42687c-1e7c-44c3-a9b9-c60c1ae31268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca8b27285c641af8a98b6b25df8c28c)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:16.812285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42687c-1e7c-44c3-a9b9-c60c1ae31268 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:16.998176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-fd42687c-1e7c-44c3-a9b9-c60c1ae31268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca8b27285c641af8a98b6b25df8c28c', 'request_id': 'req-fd42687c-1e7c-44c3-a9b9-c60c1ae31268'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:17.005997 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-fd42687c-1e7c-44c3-a9b9-c60c1ae31268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca8b27285c641af8a98b6b25df8c28c', 'request_id': 'req-fd42687c-1e7c-44c3-a9b9-c60c1ae31268'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:17.150456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-fd42687c-1e7c-44c3-a9b9-c60c1ae31268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca8b27285c641af8a98b6b25df8c28c', 'request_id': 'req-fd42687c-1e7c-44c3-a9b9-c60c1ae31268'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:17.166598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-fd42687c-1e7c-44c3-a9b9-c60c1ae31268 admin admin] The token cache is being invalidate because project 0ca8b27285c641af8a98b6b25df8c28c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:17.167410 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-fd42687c-1e7c-44c3-a9b9-c60c1ae31268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:17.168357 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-fd42687c-1e7c-44c3-a9b9-c60c1ae31268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:17.170228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 995/1963] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:16 2022] DELETE /identity/v3/projects/0ca8b27285c641af8a98b6b25df8c28c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:17.175074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63528b24-e20f-4cc1-b2b0-7504f37e07d9 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:17.191843 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63528b24-e20f-4cc1-b2b0-7504f37e07d9 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:17.312280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca929d1d-46c2-4b7f-96e4-afac9d1fb519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:17.313593 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca929d1d-46c2-4b7f-96e4-afac9d1fb519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:17.313593 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca929d1d-46c2-4b7f-96e4-afac9d1fb519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:17.313829 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca929d1d-46c2-4b7f-96e4-afac9d1fb519 admin admin] PATH_INFO: `/v3/users/333ec5629cad40b2a9a24160e6b22170` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:17.316303 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca929d1d-46c2-4b7f-96e4-afac9d1fb519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=333ec5629cad40b2a9a24160e6b22170)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:17.318422 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca929d1d-46c2-4b7f-96e4-afac9d1fb519 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:17.604707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ca929d1d-46c2-4b7f-96e4-afac9d1fb519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '333ec5629cad40b2a9a24160e6b22170'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:17.608522 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ca929d1d-46c2-4b7f-96e4-afac9d1fb519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '333ec5629cad40b2a9a24160e6b22170'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:17.693335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ca929d1d-46c2-4b7f-96e4-afac9d1fb519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '333ec5629cad40b2a9a24160e6b22170'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:17.747825 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ca929d1d-46c2-4b7f-96e4-afac9d1fb519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '333ec5629cad40b2a9a24160e6b22170'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:17.748636 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ca929d1d-46c2-4b7f-96e4-afac9d1fb519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '333ec5629cad40b2a9a24160e6b22170'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:17.778762 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 969/1964] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:17 2022] DELETE /identity/v3/users/333ec5629cad40b2a9a24160e6b22170 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:17.806877 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:17.890495 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:18.520207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42687c-1e7c-44c3-a9b9-c60c1ae31268 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:18.522614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-fd42687c-1e7c-44c3-a9b9-c60c1ae31268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:18.544272 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42687c-1e7c-44c3-a9b9-c60c1ae31268 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:18.651356 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81180a4-1643-444a-80d9-5f855bb0adbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:18.652352 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81180a4-1643-444a-80d9-5f855bb0adbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:18.652636 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81180a4-1643-444a-80d9-5f855bb0adbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:18.657850 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81180a4-1643-444a-80d9-5f855bb0adbf admin admin] PATH_INFO: `/v3/projects/ba3485e2964c43f4afad03c7c128d909` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:18.657850 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81180a4-1643-444a-80d9-5f855bb0adbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba3485e2964c43f4afad03c7c128d909)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:18.658561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81180a4-1643-444a-80d9-5f855bb0adbf admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:18.821675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-a81180a4-1643-444a-80d9-5f855bb0adbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba3485e2964c43f4afad03c7c128d909', 'request_id': 'req-a81180a4-1643-444a-80d9-5f855bb0adbf'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:18.833241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-a81180a4-1643-444a-80d9-5f855bb0adbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba3485e2964c43f4afad03c7c128d909', 'request_id': 'req-a81180a4-1643-444a-80d9-5f855bb0adbf'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:18.910703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-a81180a4-1643-444a-80d9-5f855bb0adbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba3485e2964c43f4afad03c7c128d909', 'request_id': 'req-a81180a4-1643-444a-80d9-5f855bb0adbf'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:18.926521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca929d1d-46c2-4b7f-96e4-afac9d1fb519 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:18.929009 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ca929d1d-46c2-4b7f-96e4-afac9d1fb519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:18.970793 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca929d1d-46c2-4b7f-96e4-afac9d1fb519 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:19.017854 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-a81180a4-1643-444a-80d9-5f855bb0adbf admin admin] The token cache is being invalidate because project ba3485e2964c43f4afad03c7c128d909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:19.019318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-a81180a4-1643-444a-80d9-5f855bb0adbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:19.025391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-a81180a4-1643-444a-80d9-5f855bb0adbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:19.029454 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 996/1965] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:18 2022] DELETE /identity/v3/projects/ba3485e2964c43f4afad03c7c128d909 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:19.114426 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade54edc-6889-4a01-89bd-422381b284b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:19.115371 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade54edc-6889-4a01-89bd-422381b284b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:19.117634 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade54edc-6889-4a01-89bd-422381b284b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:19.117634 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade54edc-6889-4a01-89bd-422381b284b3 admin admin] PATH_INFO: `/v3/projects/80fd90f0137d4e1fa7fb15d0c2d4d03b` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:19.117634 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade54edc-6889-4a01-89bd-422381b284b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80fd90f0137d4e1fa7fb15d0c2d4d03b)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:19.120049 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade54edc-6889-4a01-89bd-422381b284b3 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:19.188693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:19.276603 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ade54edc-6889-4a01-89bd-422381b284b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80fd90f0137d4e1fa7fb15d0c2d4d03b', 'request_id': 'req-ade54edc-6889-4a01-89bd-422381b284b3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:19.294326 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:19.294326 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ade54edc-6889-4a01-89bd-422381b284b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80fd90f0137d4e1fa7fb15d0c2d4d03b', 'request_id': 'req-ade54edc-6889-4a01-89bd-422381b284b3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:19.412028 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ade54edc-6889-4a01-89bd-422381b284b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80fd90f0137d4e1fa7fb15d0c2d4d03b', 'request_id': 'req-ade54edc-6889-4a01-89bd-422381b284b3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:19.428000 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ade54edc-6889-4a01-89bd-422381b284b3 admin admin] The token cache is being invalidate because project 80fd90f0137d4e1fa7fb15d0c2d4d03b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:19.428630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ade54edc-6889-4a01-89bd-422381b284b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:19.429646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ade54edc-6889-4a01-89bd-422381b284b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:19.431742 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 970/1966] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:18 2022] DELETE /identity/v3/projects/80fd90f0137d4e1fa7fb15d0c2d4d03b => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:19.435527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81180a4-1643-444a-80d9-5f855bb0adbf admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:19.437169 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a81180a4-1643-444a-80d9-5f855bb0adbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:19.452918 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81180a4-1643-444a-80d9-5f855bb0adbf admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:19.566140 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570c5d8-76d5-4c3c-8e02-7e697934b716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:19.567798 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570c5d8-76d5-4c3c-8e02-7e697934b716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:19.569883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570c5d8-76d5-4c3c-8e02-7e697934b716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:19.570180 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570c5d8-76d5-4c3c-8e02-7e697934b716 admin admin] PATH_INFO: `/v3/users/90bdc302c9c84b439e7424a2153c5573` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:19.575069 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570c5d8-76d5-4c3c-8e02-7e697934b716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90bdc302c9c84b439e7424a2153c5573)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:19.578113 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570c5d8-76d5-4c3c-8e02-7e697934b716 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:19.814167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade54edc-6889-4a01-89bd-422381b284b3 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:19.815843 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ade54edc-6889-4a01-89bd-422381b284b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:19.830590 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade54edc-6889-4a01-89bd-422381b284b3 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:19.837764 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cc51b-aeef-4ee7-9843-52ae72709401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:19.838433 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cc51b-aeef-4ee7-9843-52ae72709401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:19.838785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cc51b-aeef-4ee7-9843-52ae72709401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:19.839073 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cc51b-aeef-4ee7-9843-52ae72709401 admin admin] PATH_INFO: `/v3/users/b7031500eef247eaa01ed41d2afe2c80` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:19.840302 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cc51b-aeef-4ee7-9843-52ae72709401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7031500eef247eaa01ed41d2afe2c80)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:19.842387 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cc51b-aeef-4ee7-9843-52ae72709401 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:19.907979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d570c5d8-76d5-4c3c-8e02-7e697934b716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90bdc302c9c84b439e7424a2153c5573'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:19.908794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d570c5d8-76d5-4c3c-8e02-7e697934b716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90bdc302c9c84b439e7424a2153c5573'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:20.008778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d570c5d8-76d5-4c3c-8e02-7e697934b716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90bdc302c9c84b439e7424a2153c5573'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:20.044993 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:20.065765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d570c5d8-76d5-4c3c-8e02-7e697934b716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90bdc302c9c84b439e7424a2153c5573'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:20.070463 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-160cc51b-aeef-4ee7-9843-52ae72709401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7031500eef247eaa01ed41d2afe2c80'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:20.071809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-160cc51b-aeef-4ee7-9843-52ae72709401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7031500eef247eaa01ed41d2afe2c80'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:20.082302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d570c5d8-76d5-4c3c-8e02-7e697934b716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90bdc302c9c84b439e7424a2153c5573'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:20.091069 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 997/1967] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:19 2022] DELETE /identity/v3/users/90bdc302c9c84b439e7424a2153c5573 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:20.229952 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-160cc51b-aeef-4ee7-9843-52ae72709401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7031500eef247eaa01ed41d2afe2c80'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:20.241553 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-160cc51b-aeef-4ee7-9843-52ae72709401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7031500eef247eaa01ed41d2afe2c80'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:20.242404 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-160cc51b-aeef-4ee7-9843-52ae72709401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7031500eef247eaa01ed41d2afe2c80'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:20.255646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 971/1968] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:19 2022] DELETE /identity/v3/users/b7031500eef247eaa01ed41d2afe2c80 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:20.260460 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38a78a-6160-421f-83c8-0f60e6895d6c None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:20.260797 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38a78a-6160-421f-83c8-0f60e6895d6c None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:20.261083 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38a78a-6160-421f-83c8-0f60e6895d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:20.282239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-eb38a78a-6160-421f-83c8-0f60e6895d6c None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:20.283682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-eb38a78a-6160-421f-83c8-0f60e6895d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:20.350658 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 998/1969] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:46:20.361195 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cc51b-aeef-4ee7-9843-52ae72709401 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:20.362721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-160cc51b-aeef-4ee7-9843-52ae72709401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:20.443883 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cc51b-aeef-4ee7-9843-52ae72709401 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:20.448320 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c03af-88dd-40f9-9406-c280a9e38da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:20.449170 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c03af-88dd-40f9-9406-c280a9e38da6 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:20.460395 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c03af-88dd-40f9-9406-c280a9e38da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:20.460395 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c03af-88dd-40f9-9406-c280a9e38da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:20.464674 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c03af-88dd-40f9-9406-c280a9e38da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:20.466967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c03af-88dd-40f9-9406-c280a9e38da6 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:20.479991 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 972/1970] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:46:20.687593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38a78a-6160-421f-83c8-0f60e6895d6c None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:20.689210 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-eb38a78a-6160-421f-83c8-0f60e6895d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:20.711609 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38a78a-6160-421f-83c8-0f60e6895d6c None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:20.717963 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276651ef-1316-40d1-9a6f-44015f2e5741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:20.718628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276651ef-1316-40d1-9a6f-44015f2e5741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:20.718931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276651ef-1316-40d1-9a6f-44015f2e5741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:20.719850 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276651ef-1316-40d1-9a6f-44015f2e5741 admin admin] PATH_INFO: `/v3/projects/4fa51c690f224ae38df7a30064dfb4c3` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:20.721081 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276651ef-1316-40d1-9a6f-44015f2e5741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fa51c690f224ae38df7a30064dfb4c3)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:20.723347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276651ef-1316-40d1-9a6f-44015f2e5741 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:20.836647 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-276651ef-1316-40d1-9a6f-44015f2e5741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fa51c690f224ae38df7a30064dfb4c3', 'request_id': 'req-276651ef-1316-40d1-9a6f-44015f2e5741'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:20.842380 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-276651ef-1316-40d1-9a6f-44015f2e5741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fa51c690f224ae38df7a30064dfb4c3', 'request_id': 'req-276651ef-1316-40d1-9a6f-44015f2e5741'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:20.926597 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-276651ef-1316-40d1-9a6f-44015f2e5741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fa51c690f224ae38df7a30064dfb4c3', 'request_id': 'req-276651ef-1316-40d1-9a6f-44015f2e5741'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:20.939116 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-276651ef-1316-40d1-9a6f-44015f2e5741 admin admin] The token cache is being invalidate because project 4fa51c690f224ae38df7a30064dfb4c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:20.939464 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-276651ef-1316-40d1-9a6f-44015f2e5741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:20.940135 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-276651ef-1316-40d1-9a6f-44015f2e5741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:20.941722 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 999/1971] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:20 2022] DELETE /identity/v3/projects/4fa51c690f224ae38df7a30064dfb4c3 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:20.947766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508cf6c-71b4-47a7-8141-ec6344bda2cf None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:20.948240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508cf6c-71b4-47a7-8141-ec6344bda2cf None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:20.948531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508cf6c-71b4-47a7-8141-ec6344bda2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:20.968318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276651ef-1316-40d1-9a6f-44015f2e5741 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:20.969987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-276651ef-1316-40d1-9a6f-44015f2e5741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:20.981548 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5508cf6c-71b4-47a7-8141-ec6344bda2cf None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:20.983820 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5508cf6c-71b4-47a7-8141-ec6344bda2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:21.067101 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276651ef-1316-40d1-9a6f-44015f2e5741 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:21.074967 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02764b61-b9be-4af9-9626-a5921db4a1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:21.075741 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02764b61-b9be-4af9-9626-a5921db4a1e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:21.075968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02764b61-b9be-4af9-9626-a5921db4a1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:21.076431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02764b61-b9be-4af9-9626-a5921db4a1e9 admin admin] PATH_INFO: `/v3/projects/8e6b0b15c47240cea71344ffe8bfb286` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:21.078590 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02764b61-b9be-4af9-9626-a5921db4a1e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e6b0b15c47240cea71344ffe8bfb286)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:21.080935 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02764b61-b9be-4af9-9626-a5921db4a1e9 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:21.117863 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 973/1972] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:21.132211 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde22cf-a66a-47bc-a456-edb35fbf9c0c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:21.132694 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde22cf-a66a-47bc-a456-edb35fbf9c0c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:21.133172 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde22cf-a66a-47bc-a456-edb35fbf9c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:21.163664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-cdde22cf-a66a-47bc-a456-edb35fbf9c0c None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:21.165645 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cdde22cf-a66a-47bc-a456-edb35fbf9c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:21.180481 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 974/1973] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:21.183238 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde22cf-a66a-47bc-a456-edb35fbf9c0c None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:21.192915 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde22cf-a66a-47bc-a456-edb35fbf9c0c None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:21.198227 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da662b2a-0d4c-4b04-9bbc-9a4c72acdcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:21.198838 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da662b2a-0d4c-4b04-9bbc-9a4c72acdcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:21.203819 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da662b2a-0d4c-4b04-9bbc-9a4c72acdcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:21.203819 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da662b2a-0d4c-4b04-9bbc-9a4c72acdcd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:21.203819 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da662b2a-0d4c-4b04-9bbc-9a4c72acdcd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:46:21.203819 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da662b2a-0d4c-4b04-9bbc-9a4c72acdcd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:21.203819 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da662b2a-0d4c-4b04-9bbc-9a4c72acdcd8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:21.214741 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 975/1974] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:46:21.219712 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da662b2a-0d4c-4b04-9bbc-9a4c72acdcd8 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:21.229767 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da662b2a-0d4c-4b04-9bbc-9a4c72acdcd8 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:21.234380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80949ce-cde9-40e6-b229-c60971a93357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:21.235745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80949ce-cde9-40e6-b229-c60971a93357 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:21.236193 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80949ce-cde9-40e6-b229-c60971a93357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:21.236527 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80949ce-cde9-40e6-b229-c60971a93357 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:21.238150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80949ce-cde9-40e6-b229-c60971a93357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:21.239150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80949ce-cde9-40e6-b229-c60971a93357 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:21.281185 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-02764b61-b9be-4af9-9626-a5921db4a1e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e6b0b15c47240cea71344ffe8bfb286', 'request_id': 'req-02764b61-b9be-4af9-9626-a5921db4a1e9'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:21.288577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-02764b61-b9be-4af9-9626-a5921db4a1e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e6b0b15c47240cea71344ffe8bfb286', 'request_id': 'req-02764b61-b9be-4af9-9626-a5921db4a1e9'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:21.361520 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-02764b61-b9be-4af9-9626-a5921db4a1e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e6b0b15c47240cea71344ffe8bfb286', 'request_id': 'req-02764b61-b9be-4af9-9626-a5921db4a1e9'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:21.369367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:21.375818 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 976/1975] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:46:21 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:46:21.379604 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80949ce-cde9-40e6-b229-c60971a93357 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:21.381514 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-02764b61-b9be-4af9-9626-a5921db4a1e9 admin admin] The token cache is being invalidate because project 8e6b0b15c47240cea71344ffe8bfb286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:21.382070 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-02764b61-b9be-4af9-9626-a5921db4a1e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:21.382926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-02764b61-b9be-4af9-9626-a5921db4a1e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:21.384679 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1000/1976] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:20 2022] DELETE /identity/v3/projects/8e6b0b15c47240cea71344ffe8bfb286 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:21.389688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02764b61-b9be-4af9-9626-a5921db4a1e9 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:21.391444 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-02764b61-b9be-4af9-9626-a5921db4a1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:21.462036 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80949ce-cde9-40e6-b229-c60971a93357 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:21.466864 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bdb6a-6123-413e-84e4-fc54b43cb849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:21.467632 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bdb6a-6123-413e-84e4-fc54b43cb849 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:21.467988 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bdb6a-6123-413e-84e4-fc54b43cb849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:21.468331 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bdb6a-6123-413e-84e4-fc54b43cb849 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:21.469607 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8bdb6a-6123-413e-84e4-fc54b43cb849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:21.471733 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8bdb6a-6123-413e-84e4-fc54b43cb849 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:21.473300 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02764b61-b9be-4af9-9626-a5921db4a1e9 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:21.478290 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239a933-38e4-41ee-9b41-c021ff549bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:21.485877 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239a933-38e4-41ee-9b41-c021ff549bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:21.485877 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239a933-38e4-41ee-9b41-c021ff549bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:21.485877 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239a933-38e4-41ee-9b41-c021ff549bab admin admin] PATH_INFO: `/v3/users/03e6f73b414f44d8b260165292a41778` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:21.485877 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239a933-38e4-41ee-9b41-c021ff549bab admin admin] RBAC: Authorizing `identity:delete_user(user_id=03e6f73b414f44d8b260165292a41778)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:21.485877 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239a933-38e4-41ee-9b41-c021ff549bab admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:21.593572 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 977/1977] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:46:21 2022] POST /identity/v3/users => generated 291 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:46:21.598051 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bdb6a-6123-413e-84e4-fc54b43cb849 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:21.599823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7f8bdb6a-6123-413e-84e4-fc54b43cb849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:21.612180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bdb6a-6123-413e-84e4-fc54b43cb849 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:21.618425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cfce0-5b03-4837-abc7-26b08b923072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:21.619046 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cfce0-5b03-4837-abc7-26b08b923072 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:21.619358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cfce0-5b03-4837-abc7-26b08b923072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:21.630503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cfce0-5b03-4837-abc7-26b08b923072 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:21.630503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cfce0-5b03-4837-abc7-26b08b923072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:21.630503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cfce0-5b03-4837-abc7-26b08b923072 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:21.632808 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 978/1978] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:46:21.637155 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cfce0-5b03-4837-abc7-26b08b923072 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:21.647691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cfce0-5b03-4837-abc7-26b08b923072 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:21.652284 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fa49f-f129-49f8-a656-afc60f8ee9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:21.652881 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fa49f-f129-49f8-a656-afc60f8ee9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:21.653162 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fa49f-f129-49f8-a656-afc60f8ee9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:21.653441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fa49f-f129-49f8-a656-afc60f8ee9d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:21.655194 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fa49f-f129-49f8-a656-afc60f8ee9d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:21.655745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fa49f-f129-49f8-a656-afc60f8ee9d2 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:21.666976 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 979/1979] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:46:21.671228 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fa49f-f129-49f8-a656-afc60f8ee9d2 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:21.681004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fa49f-f129-49f8-a656-afc60f8ee9d2 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:21.685626 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f11df3-5b67-49e8-8317-b586d78e007f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:21.686266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f11df3-5b67-49e8-8317-b586d78e007f admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:21.686548 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f11df3-5b67-49e8-8317-b586d78e007f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:21.686824 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f11df3-5b67-49e8-8317-b586d78e007f admin admin] PATH_INFO: `/v3/projects/f7d90c9989174eb08a1fecfcaa10ee51/users/3a4e09c04a734cef9f095585ee2855f0/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:21.700944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f11df3-5b67-49e8-8317-b586d78e007f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d90c9989174eb08a1fecfcaa10ee51, user_id=3a4e09c04a734cef9f095585ee2855f0, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:21.704284 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f11df3-5b67-49e8-8317-b586d78e007f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:21.721991 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-7239a933-38e4-41ee-9b41-c021ff549bab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03e6f73b414f44d8b260165292a41778'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:21.722932 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-7239a933-38e4-41ee-9b41-c021ff549bab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03e6f73b414f44d8b260165292a41778'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:21.817274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 980/1980] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:21 2022] PUT /identity/v3/projects/f7d90c9989174eb08a1fecfcaa10ee51/users/3a4e09c04a734cef9f095585ee2855f0/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:21.828296 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cb548-c0e2-45d6-a6ac-15c16e3d61c3 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:21.829105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cb548-c0e2-45d6-a6ac-15c16e3d61c3 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:21.829385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cb548-c0e2-45d6-a6ac-15c16e3d61c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:21.839650 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-7239a933-38e4-41ee-9b41-c021ff549bab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03e6f73b414f44d8b260165292a41778'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:21.858551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-7239a933-38e4-41ee-9b41-c021ff549bab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03e6f73b414f44d8b260165292a41778'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:21.866736 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-436cb548-c0e2-45d6-a6ac-15c16e3d61c3 None None] MFA Rules not processed for user `3a4e09c04a734cef9f095585ee2855f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:21.867434 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-7239a933-38e4-41ee-9b41-c021ff549bab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03e6f73b414f44d8b260165292a41778'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:21.868012 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-436cb548-c0e2-45d6-a6ac-15c16e3d61c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:21.874848 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1001/1981] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:21 2022] DELETE /identity/v3/users/03e6f73b414f44d8b260165292a41778 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:21.947819 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 981/1982] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:46:21.952539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239a933-38e4-41ee-9b41-c021ff549bab admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:21.955241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-7239a933-38e4-41ee-9b41-c021ff549bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:22.033002 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239a933-38e4-41ee-9b41-c021ff549bab admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:22.037743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e07ba-0e47-4e16-9ea1-8cbb9ec8d91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:22.038384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e07ba-0e47-4e16-9ea1-8cbb9ec8d91e admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:22.038664 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e07ba-0e47-4e16-9ea1-8cbb9ec8d91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:22.038946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e07ba-0e47-4e16-9ea1-8cbb9ec8d91e admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:22.039820 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e07ba-0e47-4e16-9ea1-8cbb9ec8d91e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:22.042139 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e07ba-0e47-4e16-9ea1-8cbb9ec8d91e admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:22.262417 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1002/1983] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:46:21 2022] POST /identity/v3/projects => generated 379 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:22.265742 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cb548-c0e2-45d6-a6ac-15c16e3d61c3 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:22.341034 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cb548-c0e2-45d6-a6ac-15c16e3d61c3 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:22.364747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e07ba-0e47-4e16-9ea1-8cbb9ec8d91e admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:22.366652 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-f62e07ba-0e47-4e16-9ea1-8cbb9ec8d91e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:22.382689 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:22.412905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f43398-43e0-46ef-985e-5c7f0453ae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:22.413517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f43398-43e0-46ef-985e-5c7f0453ae96 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:22.413767 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f43398-43e0-46ef-985e-5c7f0453ae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:22.414041 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f43398-43e0-46ef-985e-5c7f0453ae96 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:22.414716 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f43398-43e0-46ef-985e-5c7f0453ae96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:22.416681 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f43398-43e0-46ef-985e-5c7f0453ae96 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:22.456272 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e07ba-0e47-4e16-9ea1-8cbb9ec8d91e admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:22.461530 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58313ba1-4912-4313-a27c-62694ca06d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:22.462564 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58313ba1-4912-4313-a27c-62694ca06d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:22.462851 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58313ba1-4912-4313-a27c-62694ca06d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:22.463133 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58313ba1-4912-4313-a27c-62694ca06d3b admin admin] PATH_INFO: `/v3/projects/1e108deeaa0b4b758e7e4dbab12e1743` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:22.464370 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58313ba1-4912-4313-a27c-62694ca06d3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e108deeaa0b4b758e7e4dbab12e1743)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:22.470776 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58313ba1-4912-4313-a27c-62694ca06d3b admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:22.539760 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 982/1984] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:46:22 2022] POST /identity/v3/users => generated 296 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:22.540726 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f43398-43e0-46ef-985e-5c7f0453ae96 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:22.551897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f43398-43e0-46ef-985e-5c7f0453ae96 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:22.557689 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c84a3d-ddf9-49ff-80ad-744691b282ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:22.558356 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c84a3d-ddf9-49ff-80ad-744691b282ea admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:22.558644 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c84a3d-ddf9-49ff-80ad-744691b282ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:22.558923 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c84a3d-ddf9-49ff-80ad-744691b282ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:22.559662 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c84a3d-ddf9-49ff-80ad-744691b282ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:22.561296 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c84a3d-ddf9-49ff-80ad-744691b282ea admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:22.572940 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 983/1985] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:22.577023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c84a3d-ddf9-49ff-80ad-744691b282ea admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:22.596070 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c84a3d-ddf9-49ff-80ad-744691b282ea admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:22.613302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-58313ba1-4912-4313-a27c-62694ca06d3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e108deeaa0b4b758e7e4dbab12e1743', 'request_id': 'req-58313ba1-4912-4313-a27c-62694ca06d3b'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:22.623193 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-58313ba1-4912-4313-a27c-62694ca06d3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e108deeaa0b4b758e7e4dbab12e1743', 'request_id': 'req-58313ba1-4912-4313-a27c-62694ca06d3b'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:22.687040 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23226c1b-d8cc-4d0e-8e82-358c7e4dd212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:22.688515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23226c1b-d8cc-4d0e-8e82-358c7e4dd212 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:22.688783 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23226c1b-d8cc-4d0e-8e82-358c7e4dd212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:22.689142 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23226c1b-d8cc-4d0e-8e82-358c7e4dd212 admin admin] PATH_INFO: `/v3/projects/e9f469b818ea4c189ba3468617051a2e/users/b6a9586244f74deab6a0c3101b962ddf/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:22.691438 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-58313ba1-4912-4313-a27c-62694ca06d3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e108deeaa0b4b758e7e4dbab12e1743', 'request_id': 'req-58313ba1-4912-4313-a27c-62694ca06d3b'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:22.704613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-58313ba1-4912-4313-a27c-62694ca06d3b admin admin] The token cache is being invalidate because project 1e108deeaa0b4b758e7e4dbab12e1743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:22.704889 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-58313ba1-4912-4313-a27c-62694ca06d3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:22.705597 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-58313ba1-4912-4313-a27c-62694ca06d3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:22.707291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1003/1986] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:22 2022] DELETE /identity/v3/projects/1e108deeaa0b4b758e7e4dbab12e1743 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:22.709730 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23226c1b-d8cc-4d0e-8e82-358c7e4dd212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f469b818ea4c189ba3468617051a2e, user_id=b6a9586244f74deab6a0c3101b962ddf, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:22.712614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4be9c7-981c-4078-9205-51cdd0094a12 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:22.713209 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4be9c7-981c-4078-9205-51cdd0094a12 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:22.713563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23226c1b-d8cc-4d0e-8e82-358c7e4dd212 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:22.713950 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4be9c7-981c-4078-9205-51cdd0094a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:22.745223 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-6d4be9c7-981c-4078-9205-51cdd0094a12 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:22.746444 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-6d4be9c7-981c-4078-9205-51cdd0094a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:22.755765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1004/1987] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:46:22.773021 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04193e93-e814-4ec8-a4c5-e9ae7623ee15 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:22.773021 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04193e93-e814-4ec8-a4c5-e9ae7623ee15 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:22.773021 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04193e93-e814-4ec8-a4c5-e9ae7623ee15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:22.785803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-04193e93-e814-4ec8-a4c5-e9ae7623ee15 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:22.787038 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-04193e93-e814-4ec8-a4c5-e9ae7623ee15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:22.795358 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1005/1988] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:46:22.800153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04193e93-e814-4ec8-a4c5-e9ae7623ee15 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:22.809568 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04193e93-e814-4ec8-a4c5-e9ae7623ee15 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:22.814912 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208f80c-ba67-4b77-a634-47d044b267a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:22.815572 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208f80c-ba67-4b77-a634-47d044b267a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:22.815860 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208f80c-ba67-4b77-a634-47d044b267a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:22.816136 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208f80c-ba67-4b77-a634-47d044b267a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:22.816844 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208f80c-ba67-4b77-a634-47d044b267a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:46:22.817150 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208f80c-ba67-4b77-a634-47d044b267a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:22.818766 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208f80c-ba67-4b77-a634-47d044b267a4 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:22.829445 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 984/1989] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:22 2022] PUT /identity/v3/projects/e9f469b818ea4c189ba3468617051a2e/users/b6a9586244f74deab6a0c3101b962ddf/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:22.833352 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23226c1b-d8cc-4d0e-8e82-358c7e4dd212 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:22.834799 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1006/1990] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:46:22.835509 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-23226c1b-d8cc-4d0e-8e82-358c7e4dd212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:22.839082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208f80c-ba67-4b77-a634-47d044b267a4 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:22.867224 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208f80c-ba67-4b77-a634-47d044b267a4 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:22.925477 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23226c1b-d8cc-4d0e-8e82-358c7e4dd212 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:22.933690 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b56f2-af68-4af5-bd48-e55205061f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:22.934688 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b56f2-af68-4af5-bd48-e55205061f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:22.934982 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b56f2-af68-4af5-bd48-e55205061f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:22.935372 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b56f2-af68-4af5-bd48-e55205061f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:22.935994 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b56f2-af68-4af5-bd48-e55205061f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:22.937623 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b56f2-af68-4af5-bd48-e55205061f6b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:22.946840 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdbffc-9cb0-43d9-af50-19e0420983df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:22.947516 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdbffc-9cb0-43d9-af50-19e0420983df admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:22.947802 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdbffc-9cb0-43d9-af50-19e0420983df admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:22.948080 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdbffc-9cb0-43d9-af50-19e0420983df admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:22.948900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabdbffc-9cb0-43d9-af50-19e0420983df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:22.951007 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabdbffc-9cb0-43d9-af50-19e0420983df admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:22.954073 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 985/1991] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:22.958437 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b56f2-af68-4af5-bd48-e55205061f6b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:22.970937 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b56f2-af68-4af5-bd48-e55205061f6b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:22.975713 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633293c-bbbc-442e-b6d1-e4ab27fe8a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:22.976398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633293c-bbbc-442e-b6d1-e4ab27fe8a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:22.976691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633293c-bbbc-442e-b6d1-e4ab27fe8a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:22.976969 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633293c-bbbc-442e-b6d1-e4ab27fe8a92 admin admin] PATH_INFO: `/v3/projects/e9f469b818ea4c189ba3468617051a2e/users/b6a9586244f74deab6a0c3101b962ddf/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:22.979224 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633293c-bbbc-442e-b6d1-e4ab27fe8a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f469b818ea4c189ba3468617051a2e, user_id=b6a9586244f74deab6a0c3101b962ddf, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:22.982088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633293c-bbbc-442e-b6d1-e4ab27fe8a92 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:22.993657 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 986/1992] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:22 2022] PUT /identity/v3/projects/e9f469b818ea4c189ba3468617051a2e/users/b6a9586244f74deab6a0c3101b962ddf/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:23.005027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1609a55-6767-41c5-8cd3-d13566850bac None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:23.005323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1609a55-6767-41c5-8cd3-d13566850bac None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:23.009374 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1609a55-6767-41c5-8cd3-d13566850bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:23.035482 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c1609a55-6767-41c5-8cd3-d13566850bac None None] MFA Rules not processed for user `b6a9586244f74deab6a0c3101b962ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:23.036725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c1609a55-6767-41c5-8cd3-d13566850bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:23.108075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 987/1993] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:46:23.144670 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1007/1994] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:46:22 2022] POST /identity/v3/projects => generated 373 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:46:23.150671 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1609a55-6767-41c5-8cd3-d13566850bac None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:23.170973 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdbffc-9cb0-43d9-af50-19e0420983df admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:23.172825 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-cabdbffc-9cb0-43d9-af50-19e0420983df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:23.222963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1609a55-6767-41c5-8cd3-d13566850bac None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:23.246393 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdbffc-9cb0-43d9-af50-19e0420983df admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:23.250391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a8429-411e-4277-a353-f34205ca13e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:23.251031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a8429-411e-4277-a353-f34205ca13e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:23.251343 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a8429-411e-4277-a353-f34205ca13e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:23.255579 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a8429-411e-4277-a353-f34205ca13e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:23.289925 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390a58d-2ddb-4e4e-a9fb-7071cc8b43f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:23.293278 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390a58d-2ddb-4e4e-a9fb-7071cc8b43f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:23.293278 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390a58d-2ddb-4e4e-a9fb-7071cc8b43f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:23.293278 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390a58d-2ddb-4e4e-a9fb-7071cc8b43f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:23.293278 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390a58d-2ddb-4e4e-a9fb-7071cc8b43f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:23.294361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390a58d-2ddb-4e4e-a9fb-7071cc8b43f7 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:23.319517 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a8429-411e-4277-a353-f34205ca13e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:23.321020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a8429-411e-4277-a353-f34205ca13e8 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:23.332122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1008/1995] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:46:23.367103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:23.377030 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 988/1996] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:46:23 2022] POST /identity/v3/users => generated 287 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:23.382964 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a8429-411e-4277-a353-f34205ca13e8 service cinder] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:23.398435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a8429-411e-4277-a353-f34205ca13e8 service cinder] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:23.418646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987073a-bd92-4be1-88d1-db37bc44e177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:23.419693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987073a-bd92-4be1-88d1-db37bc44e177 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:23.420020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987073a-bd92-4be1-88d1-db37bc44e177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:23.420353 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987073a-bd92-4be1-88d1-db37bc44e177 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:23.421362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987073a-bd92-4be1-88d1-db37bc44e177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:23.423884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987073a-bd92-4be1-88d1-db37bc44e177 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:23.436202 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1009/1997] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:23.440788 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390a58d-2ddb-4e4e-a9fb-7071cc8b43f7 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:23.451864 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390a58d-2ddb-4e4e-a9fb-7071cc8b43f7 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:23.458383 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19792a-966a-4e6d-a5b7-899fd38a2caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:23.459031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19792a-966a-4e6d-a5b7-899fd38a2caf admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:23.459535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19792a-966a-4e6d-a5b7-899fd38a2caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:23.459834 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19792a-966a-4e6d-a5b7-899fd38a2caf admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:23.460544 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19792a-966a-4e6d-a5b7-899fd38a2caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:23.462546 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19792a-966a-4e6d-a5b7-899fd38a2caf admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:23.499473 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 989/1998] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:23.502615 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987073a-bd92-4be1-88d1-db37bc44e177 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:23.518017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987073a-bd92-4be1-88d1-db37bc44e177 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:23.525664 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fd8f9-bc48-4931-b335-ade10a701e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:23.527722 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fd8f9-bc48-4931-b335-ade10a701e11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:23.527722 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fd8f9-bc48-4931-b335-ade10a701e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:23.532537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fd8f9-bc48-4931-b335-ade10a701e11 admin admin] PATH_INFO: `/v3/projects/3e4ec9b59fb745e682eeede33ec29417/users/a5be4e5a6e1241f0b01b62953e66cc34/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:23.557749 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fd8f9-bc48-4931-b335-ade10a701e11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e4ec9b59fb745e682eeede33ec29417, user_id=a5be4e5a6e1241f0b01b62953e66cc34, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:23.564414 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fd8f9-bc48-4931-b335-ade10a701e11 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:23.690833 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1010/1999] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:23 2022] PUT /identity/v3/projects/3e4ec9b59fb745e682eeede33ec29417/users/a5be4e5a6e1241f0b01b62953e66cc34/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:23.706332 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ef21e-e82a-4cc2-919c-84f82a841d69 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:23.706332 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ef21e-e82a-4cc2-919c-84f82a841d69 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:23.706332 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ef21e-e82a-4cc2-919c-84f82a841d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:23.724099 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c85ef21e-e82a-4cc2-919c-84f82a841d69 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:23.725428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c85ef21e-e82a-4cc2-919c-84f82a841d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:23.817517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 990/2000] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:23.830866 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fd8f9-bc48-4931-b335-ade10a701e11 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:23.832715 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-0b2fd8f9-bc48-4931-b335-ade10a701e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:23.897826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fd8f9-bc48-4931-b335-ade10a701e11 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:23.901831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb2347-f784-4218-b36b-9059b548f873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:23.902460 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2347-f784-4218-b36b-9059b548f873 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:23.902750 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2347-f784-4218-b36b-9059b548f873 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:23.903027 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2347-f784-4218-b36b-9059b548f873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:23.915028 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb2347-f784-4218-b36b-9059b548f873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:23.917060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb2347-f784-4218-b36b-9059b548f873 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:23.928373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1011/2001] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:23.980654 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ef21e-e82a-4cc2-919c-84f82a841d69 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:23.993141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ef21e-e82a-4cc2-919c-84f82a841d69 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:23.998323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1cf1fa-e458-425f-acdd-009e89eaf3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:23.999157 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cf1fa-e458-425f-acdd-009e89eaf3d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:23.999478 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cf1fa-e458-425f-acdd-009e89eaf3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:23.999762 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cf1fa-e458-425f-acdd-009e89eaf3d8 admin admin] PATH_INFO: `/v3/users/3a4e09c04a734cef9f095585ee2855f0` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:24.001656 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1cf1fa-e458-425f-acdd-009e89eaf3d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a4e09c04a734cef9f095585ee2855f0)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:24.003686 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1cf1fa-e458-425f-acdd-009e89eaf3d8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:24.241238 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ee1cf1fa-e458-425f-acdd-009e89eaf3d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a4e09c04a734cef9f095585ee2855f0'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:24.241814 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ee1cf1fa-e458-425f-acdd-009e89eaf3d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a4e09c04a734cef9f095585ee2855f0'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:24.318504 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ee1cf1fa-e458-425f-acdd-009e89eaf3d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a4e09c04a734cef9f095585ee2855f0'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:24.332502 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ee1cf1fa-e458-425f-acdd-009e89eaf3d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a4e09c04a734cef9f095585ee2855f0'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:24.333336 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ee1cf1fa-e458-425f-acdd-009e89eaf3d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a4e09c04a734cef9f095585ee2855f0'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:24.350068 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 991/2002] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:23 2022] DELETE /identity/v3/users/3a4e09c04a734cef9f095585ee2855f0 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:24.352560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734e906-c083-4ffa-aa53-c2dee75e41ad None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:24.353047 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734e906-c083-4ffa-aa53-c2dee75e41ad None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:24.356113 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734e906-c083-4ffa-aa53-c2dee75e41ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:24.373339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-9734e906-c083-4ffa-aa53-c2dee75e41ad None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:24.374590 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-9734e906-c083-4ffa-aa53-c2dee75e41ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:24.436944 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1012/2003] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:24.447074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1cf1fa-e458-425f-acdd-009e89eaf3d8 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:24.448552 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ee1cf1fa-e458-425f-acdd-009e89eaf3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:24.510653 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1cf1fa-e458-425f-acdd-009e89eaf3d8 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:24.514902 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:24.515360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cd3bd-b664-4fa0-95a6-6b2b500745e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:24.516528 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cd3bd-b664-4fa0-95a6-6b2b500745e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:24.519629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cd3bd-b664-4fa0-95a6-6b2b500745e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:24.519629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cd3bd-b664-4fa0-95a6-6b2b500745e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:24.526926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0cd3bd-b664-4fa0-95a6-6b2b500745e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:24.528856 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0cd3bd-b664-4fa0-95a6-6b2b500745e0 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:24.540434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 992/2004] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:24.686513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:25.103360 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734e906-c083-4ffa-aa53-c2dee75e41ad None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:25.106172 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-9734e906-c083-4ffa-aa53-c2dee75e41ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:25.127961 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734e906-c083-4ffa-aa53-c2dee75e41ad None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:25.138854 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78412b8b-8701-46b9-bf4f-f07852b9133c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:25.143105 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78412b8b-8701-46b9-bf4f-f07852b9133c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:25.143426 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78412b8b-8701-46b9-bf4f-f07852b9133c admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:25.145902 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78412b8b-8701-46b9-bf4f-f07852b9133c admin admin] PATH_INFO: `/v3/projects/f7d90c9989174eb08a1fecfcaa10ee51` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:25.145902 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78412b8b-8701-46b9-bf4f-f07852b9133c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7d90c9989174eb08a1fecfcaa10ee51)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:25.149481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78412b8b-8701-46b9-bf4f-f07852b9133c admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:25.291504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-78412b8b-8701-46b9-bf4f-f07852b9133c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7d90c9989174eb08a1fecfcaa10ee51', 'request_id': 'req-78412b8b-8701-46b9-bf4f-f07852b9133c'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:25.296970 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-78412b8b-8701-46b9-bf4f-f07852b9133c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7d90c9989174eb08a1fecfcaa10ee51', 'request_id': 'req-78412b8b-8701-46b9-bf4f-f07852b9133c'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:25.439366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-78412b8b-8701-46b9-bf4f-f07852b9133c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7d90c9989174eb08a1fecfcaa10ee51', 'request_id': 'req-78412b8b-8701-46b9-bf4f-f07852b9133c'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:25.452376 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-78412b8b-8701-46b9-bf4f-f07852b9133c admin admin] The token cache is being invalidate because project f7d90c9989174eb08a1fecfcaa10ee51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:25.452666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-78412b8b-8701-46b9-bf4f-f07852b9133c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:25.454459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-78412b8b-8701-46b9-bf4f-f07852b9133c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:25.456593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1013/2005] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:25 2022] DELETE /identity/v3/projects/f7d90c9989174eb08a1fecfcaa10ee51 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:25.460852 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cd3bd-b664-4fa0-95a6-6b2b500745e0 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:25.478533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cd3bd-b664-4fa0-95a6-6b2b500745e0 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:25.545258 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ac527-792e-4ef8-9f82-a93be2dbff2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:25.545258 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ac527-792e-4ef8-9f82-a93be2dbff2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:25.545258 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ac527-792e-4ef8-9f82-a93be2dbff2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:25.545258 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ac527-792e-4ef8-9f82-a93be2dbff2d admin admin] PATH_INFO: `/v3/users/b6a9586244f74deab6a0c3101b962ddf` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:25.546190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ac527-792e-4ef8-9f82-a93be2dbff2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a9586244f74deab6a0c3101b962ddf)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:25.547182 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ac527-792e-4ef8-9f82-a93be2dbff2d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:25.581565 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dac6d8-c47d-44da-b843-1ffe86a459dc None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:25.582153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dac6d8-c47d-44da-b843-1ffe86a459dc None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:25.582445 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dac6d8-c47d-44da-b843-1ffe86a459dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:25.612897 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-b3dac6d8-c47d-44da-b843-1ffe86a459dc None None] MFA Rules not processed for user `a5be4e5a6e1241f0b01b62953e66cc34`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:25.614160 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b3dac6d8-c47d-44da-b843-1ffe86a459dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:25.679819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1014/2006] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:25.684312 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dac6d8-c47d-44da-b843-1ffe86a459dc None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:25.685914 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b3dac6d8-c47d-44da-b843-1ffe86a459dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:25.700155 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dac6d8-c47d-44da-b843-1ffe86a459dc None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:25.706135 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7feb7cb-cde3-451c-b13d-74c96953fa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:25.706772 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feb7cb-cde3-451c-b13d-74c96953fa76 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:25.707067 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feb7cb-cde3-451c-b13d-74c96953fa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:25.707432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feb7cb-cde3-451c-b13d-74c96953fa76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:25.708182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7feb7cb-cde3-451c-b13d-74c96953fa76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:25.710172 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7feb7cb-cde3-451c-b13d-74c96953fa76 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:25.786216 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-836ac527-792e-4ef8-9f82-a93be2dbff2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a9586244f74deab6a0c3101b962ddf'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:25.787039 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-836ac527-792e-4ef8-9f82-a93be2dbff2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a9586244f74deab6a0c3101b962ddf'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:25.848312 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1015/2007] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:46:25 2022] POST /identity/v3/projects => generated 371 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:25.852244 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7feb7cb-cde3-451c-b13d-74c96953fa76 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:25.869579 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-836ac527-792e-4ef8-9f82-a93be2dbff2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a9586244f74deab6a0c3101b962ddf'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:25.884311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-836ac527-792e-4ef8-9f82-a93be2dbff2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a9586244f74deab6a0c3101b962ddf'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:25.885138 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-836ac527-792e-4ef8-9f82-a93be2dbff2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a9586244f74deab6a0c3101b962ddf'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:25.903998 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 993/2008] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:25 2022] DELETE /identity/v3/users/b6a9586244f74deab6a0c3101b962ddf => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:25.935316 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7feb7cb-cde3-451c-b13d-74c96953fa76 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:26.000033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea3040-5802-4784-923a-e8ea4a0c37d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:26.001514 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea3040-5802-4784-923a-e8ea4a0c37d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:26.001803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea3040-5802-4784-923a-e8ea4a0c37d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:26.002082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea3040-5802-4784-923a-e8ea4a0c37d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:26.002770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea3040-5802-4784-923a-e8ea4a0c37d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:26.004776 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea3040-5802-4784-923a-e8ea4a0c37d7 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:26.159514 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1016/2009] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:46:25 2022] POST /identity/v3/users => generated 292 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:46:26.163855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ac527-792e-4ef8-9f82-a93be2dbff2d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:26.165305 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-836ac527-792e-4ef8-9f82-a93be2dbff2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:26.179923 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ac527-792e-4ef8-9f82-a93be2dbff2d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:26.184963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4ade9-346f-4ae3-afbb-c5834c7c7a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:26.186155 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4ade9-346f-4ae3-afbb-c5834c7c7a4a admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:26.186155 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4ade9-346f-4ae3-afbb-c5834c7c7a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:26.186155 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4ade9-346f-4ae3-afbb-c5834c7c7a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:26.186872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4ade9-346f-4ae3-afbb-c5834c7c7a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:26.189378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4ade9-346f-4ae3-afbb-c5834c7c7a4a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:26.201063 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 994/2010] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:26.208287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea3040-5802-4784-923a-e8ea4a0c37d7 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:26.219556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea3040-5802-4784-923a-e8ea4a0c37d7 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:26.224433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb5376-cc3c-48d5-80c2-5353d9023f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:26.225229 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb5376-cc3c-48d5-80c2-5353d9023f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:26.225719 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb5376-cc3c-48d5-80c2-5353d9023f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:26.225993 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb5376-cc3c-48d5-80c2-5353d9023f56 admin admin] PATH_INFO: `/v3/projects/bd38d6c84d0f4c9798c7c5b1f2180ca7/users/0397787b459e45aab7f1250c826d465b/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:26.242748 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb5376-cc3c-48d5-80c2-5353d9023f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd38d6c84d0f4c9798c7c5b1f2180ca7, user_id=0397787b459e45aab7f1250c826d465b, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:26.245498 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb5376-cc3c-48d5-80c2-5353d9023f56 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:26.365149 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1017/2011] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:26 2022] PUT /identity/v3/projects/bd38d6c84d0f4c9798c7c5b1f2180ca7/users/0397787b459e45aab7f1250c826d465b/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:26.366276 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4ade9-346f-4ae3-afbb-c5834c7c7a4a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:26.376568 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4ade9-346f-4ae3-afbb-c5834c7c7a4a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:26.446883 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ce48d-1282-45af-93e0-6db3b880ae3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:26.446883 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ce48d-1282-45af-93e0-6db3b880ae3f admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:26.447624 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ce48d-1282-45af-93e0-6db3b880ae3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:26.447997 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ce48d-1282-45af-93e0-6db3b880ae3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:26.448739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ce48d-1282-45af-93e0-6db3b880ae3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:26.450397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ce48d-1282-45af-93e0-6db3b880ae3f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:26.472008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 995/2012] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:26.473288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb5376-cc3c-48d5-80c2-5353d9023f56 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:26.489563 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb5376-cc3c-48d5-80c2-5353d9023f56 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:26.496781 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ce48d-1282-45af-93e0-6db3b880ae3f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:26.496781 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cf4ce48d-1282-45af-93e0-6db3b880ae3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:26.501593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60ba1c-bd0f-4d3e-acc3-db9255bd36a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:26.501839 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60ba1c-bd0f-4d3e-acc3-db9255bd36a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:26.502105 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60ba1c-bd0f-4d3e-acc3-db9255bd36a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:26.502391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60ba1c-bd0f-4d3e-acc3-db9255bd36a5 admin admin] PATH_INFO: `/v3/projects/bd38d6c84d0f4c9798c7c5b1f2180ca7/users/0397787b459e45aab7f1250c826d465b/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:26.512056 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ce48d-1282-45af-93e0-6db3b880ae3f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:26.512782 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60ba1c-bd0f-4d3e-acc3-db9255bd36a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd38d6c84d0f4c9798c7c5b1f2180ca7, user_id=0397787b459e45aab7f1250c826d465b, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:26.517565 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3c416-fea9-4bec-8c8e-45b6ebef6cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:26.519402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3c416-fea9-4bec-8c8e-45b6ebef6cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:26.519402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3c416-fea9-4bec-8c8e-45b6ebef6cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:26.519625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60ba1c-bd0f-4d3e-acc3-db9255bd36a5 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:26.519704 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3c416-fea9-4bec-8c8e-45b6ebef6cbc admin admin] PATH_INFO: `/v3/projects/e9f469b818ea4c189ba3468617051a2e` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:26.520688 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3c416-fea9-4bec-8c8e-45b6ebef6cbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9f469b818ea4c189ba3468617051a2e)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:26.524090 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3c416-fea9-4bec-8c8e-45b6ebef6cbc admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:26.554283 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1018/2013] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:26 2022] PUT /identity/v3/projects/bd38d6c84d0f4c9798c7c5b1f2180ca7/users/0397787b459e45aab7f1250c826d465b/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:26.646568 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:26.656208 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ffc3c416-fea9-4bec-8c8e-45b6ebef6cbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9f469b818ea4c189ba3468617051a2e', 'request_id': 'req-ffc3c416-fea9-4bec-8c8e-45b6ebef6cbc'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:26.663109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ffc3c416-fea9-4bec-8c8e-45b6ebef6cbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9f469b818ea4c189ba3468617051a2e', 'request_id': 'req-ffc3c416-fea9-4bec-8c8e-45b6ebef6cbc'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:26.698641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:26.731655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ffc3c416-fea9-4bec-8c8e-45b6ebef6cbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9f469b818ea4c189ba3468617051a2e', 'request_id': 'req-ffc3c416-fea9-4bec-8c8e-45b6ebef6cbc'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:26.749282 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ffc3c416-fea9-4bec-8c8e-45b6ebef6cbc admin admin] The token cache is being invalidate because project e9f469b818ea4c189ba3468617051a2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:26.749574 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ffc3c416-fea9-4bec-8c8e-45b6ebef6cbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:26.750440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ffc3c416-fea9-4bec-8c8e-45b6ebef6cbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:26.752324 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 996/2014] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:26 2022] DELETE /identity/v3/projects/e9f469b818ea4c189ba3468617051a2e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:26.757368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c3ec7-e6b3-413b-bae1-cfa747d06822 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:26.757657 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c3ec7-e6b3-413b-bae1-cfa747d06822 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:26.757932 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c3ec7-e6b3-413b-bae1-cfa747d06822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:26.779440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-fc1c3ec7-e6b3-413b-bae1-cfa747d06822 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:26.780833 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-fc1c3ec7-e6b3-413b-bae1-cfa747d06822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:26.863501 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1019/2015] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:26.871563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e62b9-cfe0-4c5e-bab8-2493447859bf None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:26.872170 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e62b9-cfe0-4c5e-bab8-2493447859bf None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:26.872759 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e62b9-cfe0-4c5e-bab8-2493447859bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:26.893785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c21e62b9-cfe0-4c5e-bab8-2493447859bf None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:26.895030 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c21e62b9-cfe0-4c5e-bab8-2493447859bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:26.904263 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 997/2016] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:26.909042 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c3ec7-e6b3-413b-bae1-cfa747d06822 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:26.921830 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c3ec7-e6b3-413b-bae1-cfa747d06822 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:26.929260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0d541-d83a-4dd9-98cf-2300d091200a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:26.929882 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0d541-d83a-4dd9-98cf-2300d091200a admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:26.930350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0d541-d83a-4dd9-98cf-2300d091200a admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:26.930758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0d541-d83a-4dd9-98cf-2300d091200a admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:26.931534 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0d541-d83a-4dd9-98cf-2300d091200a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:46:26.931968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0d541-d83a-4dd9-98cf-2300d091200a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:26.934338 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0d541-d83a-4dd9-98cf-2300d091200a admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:26.947800 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1020/2017] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:46:26.952519 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e62b9-cfe0-4c5e-bab8-2493447859bf None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:26.964261 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e62b9-cfe0-4c5e-bab8-2493447859bf None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:26.969494 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a765b-db48-44ce-a4ec-13ddd38c712c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:26.970463 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a765b-db48-44ce-a4ec-13ddd38c712c admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:26.970745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a765b-db48-44ce-a4ec-13ddd38c712c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:26.971313 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a765b-db48-44ce-a4ec-13ddd38c712c admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:26.972207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a765b-db48-44ce-a4ec-13ddd38c712c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:26.974332 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a765b-db48-44ce-a4ec-13ddd38c712c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:27.089265 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 998/2018] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:46:26 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:27.090518 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0d541-d83a-4dd9-98cf-2300d091200a admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:27.104982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0d541-d83a-4dd9-98cf-2300d091200a admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:27.193263 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b82090-3b75-4f96-864e-f3f92d770dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:27.194262 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b82090-3b75-4f96-864e-f3f92d770dcd admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:27.194641 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b82090-3b75-4f96-864e-f3f92d770dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:27.195186 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b82090-3b75-4f96-864e-f3f92d770dcd admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:27.196142 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b82090-3b75-4f96-864e-f3f92d770dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:27.201426 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b82090-3b75-4f96-864e-f3f92d770dcd admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:27.275277 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1021/2019] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:46:27 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:27.279629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a765b-db48-44ce-a4ec-13ddd38c712c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:27.291997 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a765b-db48-44ce-a4ec-13ddd38c712c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:27.298006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e18ab-6d07-4f68-bf06-29b617224882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:27.302818 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e18ab-6d07-4f68-bf06-29b617224882 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:27.302818 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e18ab-6d07-4f68-bf06-29b617224882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:27.302818 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e18ab-6d07-4f68-bf06-29b617224882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:27.302818 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e18ab-6d07-4f68-bf06-29b617224882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:27.302818 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e18ab-6d07-4f68-bf06-29b617224882 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:27.318378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 999/2020] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:46:27.322470 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b82090-3b75-4f96-864e-f3f92d770dcd admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:27.334476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b82090-3b75-4f96-864e-f3f92d770dcd admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:27.342941 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9c5ad-db0a-4092-9387-13fe403e09fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:27.344544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9c5ad-db0a-4092-9387-13fe403e09fb admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:27.344936 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9c5ad-db0a-4092-9387-13fe403e09fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:27.345239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9c5ad-db0a-4092-9387-13fe403e09fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:27.345971 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9c5ad-db0a-4092-9387-13fe403e09fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:27.347895 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9c5ad-db0a-4092-9387-13fe403e09fb admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:27.363827 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1022/2021] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:27.368066 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e18ab-6d07-4f68-bf06-29b617224882 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:27.381212 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e18ab-6d07-4f68-bf06-29b617224882 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:27.388281 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35cb80-6869-44ce-b33a-46b50d7c6513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:27.388962 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35cb80-6869-44ce-b33a-46b50d7c6513 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:27.389249 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35cb80-6869-44ce-b33a-46b50d7c6513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:27.389515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35cb80-6869-44ce-b33a-46b50d7c6513 admin admin] PATH_INFO: `/v3/projects/62b1396061154423a6a018d6e0fba302/users/f01724d244584b4eb19a48c607b9728f/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:27.426584 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35cb80-6869-44ce-b33a-46b50d7c6513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b1396061154423a6a018d6e0fba302, user_id=f01724d244584b4eb19a48c607b9728f, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:27.429322 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35cb80-6869-44ce-b33a-46b50d7c6513 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:27.491600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1000/2022] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:27 2022] PUT /identity/v3/projects/62b1396061154423a6a018d6e0fba302/users/f01724d244584b4eb19a48c607b9728f/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:27.506017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9839ce-7587-43e7-966b-ecedf704c16e None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:27.506394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9839ce-7587-43e7-966b-ecedf704c16e None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:27.506691 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9839ce-7587-43e7-966b-ecedf704c16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:27.544037 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-8d9839ce-7587-43e7-966b-ecedf704c16e None None] MFA Rules not processed for user `f01724d244584b4eb19a48c607b9728f`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:27.545324 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-8d9839ce-7587-43e7-966b-ecedf704c16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:27.617923 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1023/2023] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:46:27.630664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35cb80-6869-44ce-b33a-46b50d7c6513 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:27.632777 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-db35cb80-6869-44ce-b33a-46b50d7c6513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:27.726518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35cb80-6869-44ce-b33a-46b50d7c6513 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:27.731172 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e69f7-0b53-430b-9b2f-f514d9cfe5af service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49a34cd99ab47bb92af6ed2f82fefde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:27.731856 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e69f7-0b53-430b-9b2f-f514d9cfe5af service glance] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:27.733157 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e69f7-0b53-430b-9b2f-f514d9cfe5af service glance] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:27.733157 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e69f7-0b53-430b-9b2f-f514d9cfe5af service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:27.741847 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e69f7-0b53-430b-9b2f-f514d9cfe5af service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:27.743346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e69f7-0b53-430b-9b2f-f514d9cfe5af service glance] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:27.752768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1001/2024] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:28.166986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfaef4-1386-4226-8d9e-1402b1e35b12 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:28.167625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfaef4-1386-4226-8d9e-1402b1e35b12 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:28.168113 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfaef4-1386-4226-8d9e-1402b1e35b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:28.228983 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-a2dfaef4-1386-4226-8d9e-1402b1e35b12 None None] MFA Rules not processed for user `0397787b459e45aab7f1250c826d465b`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:28.230245 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a2dfaef4-1386-4226-8d9e-1402b1e35b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:28.330272 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1024/2025] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:28 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:28.355101 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09dd3b-1303-4548-b157-c0405c96f2a4 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:28.355443 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09dd3b-1303-4548-b157-c0405c96f2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:28.355725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09dd3b-1303-4548-b157-c0405c96f2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:28.377339 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-ed09dd3b-1303-4548-b157-c0405c96f2a4 None None] MFA Rules not processed for user `a5be4e5a6e1241f0b01b62953e66cc34`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:28.378568 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ed09dd3b-1303-4548-b157-c0405c96f2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:28.435162 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1002/2026] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:28.575682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfaef4-1386-4226-8d9e-1402b1e35b12 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:28.577698 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a2dfaef4-1386-4226-8d9e-1402b1e35b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:28.674900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfaef4-1386-4226-8d9e-1402b1e35b12 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:28.695754 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec464583-0e61-4712-9523-904926b23ab2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:28.696695 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec464583-0e61-4712-9523-904926b23ab2 service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:28.697869 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec464583-0e61-4712-9523-904926b23ab2 service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:28.698358 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec464583-0e61-4712-9523-904926b23ab2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:28.700243 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ec464583-0e61-4712-9523-904926b23ab2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:28.713556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec464583-0e61-4712-9523-904926b23ab2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:28.715934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec464583-0e61-4712-9523-904926b23ab2 service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:28.725618 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1025/2027] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:28.897805 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:29.000832 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:29.195789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09dd3b-1303-4548-b157-c0405c96f2a4 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:29.202342 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ed09dd3b-1303-4548-b157-c0405c96f2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:29.333208 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09dd3b-1303-4548-b157-c0405c96f2a4 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:29.339869 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac28ce-fd45-4748-8289-6210aeb7b676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:29.340861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac28ce-fd45-4748-8289-6210aeb7b676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:29.341149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac28ce-fd45-4748-8289-6210aeb7b676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:29.341440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac28ce-fd45-4748-8289-6210aeb7b676 admin admin] PATH_INFO: `/v3/users/f21fdf522efe4ac6ae97e612a8132b22` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:29.343242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac28ce-fd45-4748-8289-6210aeb7b676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f21fdf522efe4ac6ae97e612a8132b22)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:29.346221 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac28ce-fd45-4748-8289-6210aeb7b676 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:29.586390 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d1ac28ce-fd45-4748-8289-6210aeb7b676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f21fdf522efe4ac6ae97e612a8132b22'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:29.587082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d1ac28ce-fd45-4748-8289-6210aeb7b676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f21fdf522efe4ac6ae97e612a8132b22'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:29.689180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d1ac28ce-fd45-4748-8289-6210aeb7b676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f21fdf522efe4ac6ae97e612a8132b22'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:29.702859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d1ac28ce-fd45-4748-8289-6210aeb7b676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f21fdf522efe4ac6ae97e612a8132b22'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:29.703795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d1ac28ce-fd45-4748-8289-6210aeb7b676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f21fdf522efe4ac6ae97e612a8132b22'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:29.718319 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1003/2028] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:29 2022] DELETE /identity/v3/users/f21fdf522efe4ac6ae97e612a8132b22 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:29.727645 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7044cc-da92-40e7-9e1d-5390565aa62e None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:29.727645 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7044cc-da92-40e7-9e1d-5390565aa62e None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:29.727645 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7044cc-da92-40e7-9e1d-5390565aa62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:29.746980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-4f7044cc-da92-40e7-9e1d-5390565aa62e None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:29.748243 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4f7044cc-da92-40e7-9e1d-5390565aa62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:29.825539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1026/2029] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:29.839225 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac28ce-fd45-4748-8289-6210aeb7b676 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:29.841987 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d1ac28ce-fd45-4748-8289-6210aeb7b676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:29.962242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac28ce-fd45-4748-8289-6210aeb7b676 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:29.967207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36eafb-9878-43fc-a472-b4b1ba390e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:29.967936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36eafb-9878-43fc-a472-b4b1ba390e78 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:29.968224 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36eafb-9878-43fc-a472-b4b1ba390e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:29.968502 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36eafb-9878-43fc-a472-b4b1ba390e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:29.980370 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36eafb-9878-43fc-a472-b4b1ba390e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:29.981872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36eafb-9878-43fc-a472-b4b1ba390e78 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:29.999446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1004/2030] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:30.415549 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:30.579879 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7044cc-da92-40e7-9e1d-5390565aa62e None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:30.581562 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4f7044cc-da92-40e7-9e1d-5390565aa62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:30.603807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7044cc-da92-40e7-9e1d-5390565aa62e None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:30.626592 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01306fc7-e869-4d32-9de6-668431fbf671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:30.630922 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01306fc7-e869-4d32-9de6-668431fbf671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:30.631882 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01306fc7-e869-4d32-9de6-668431fbf671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:30.634370 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01306fc7-e869-4d32-9de6-668431fbf671 admin admin] PATH_INFO: `/v3/projects/8f3d26c456ee4b8a9c7264d0fd06e2c6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:30.636140 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01306fc7-e869-4d32-9de6-668431fbf671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3d26c456ee4b8a9c7264d0fd06e2c6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:30.643821 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01306fc7-e869-4d32-9de6-668431fbf671 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:30.839497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-01306fc7-e869-4d32-9de6-668431fbf671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3d26c456ee4b8a9c7264d0fd06e2c6', 'request_id': 'req-01306fc7-e869-4d32-9de6-668431fbf671'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:30.845821 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-01306fc7-e869-4d32-9de6-668431fbf671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3d26c456ee4b8a9c7264d0fd06e2c6', 'request_id': 'req-01306fc7-e869-4d32-9de6-668431fbf671'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:30.933397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-01306fc7-e869-4d32-9de6-668431fbf671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3d26c456ee4b8a9c7264d0fd06e2c6', 'request_id': 'req-01306fc7-e869-4d32-9de6-668431fbf671'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:30.984946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-01306fc7-e869-4d32-9de6-668431fbf671 admin admin] The token cache is being invalidate because project 8f3d26c456ee4b8a9c7264d0fd06e2c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:30.985603 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-01306fc7-e869-4d32-9de6-668431fbf671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:30.990284 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-01306fc7-e869-4d32-9de6-668431fbf671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:30.996911 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1027/2031] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:30 2022] DELETE /identity/v3/projects/8f3d26c456ee4b8a9c7264d0fd06e2c6 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:31.001955 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36eafb-9878-43fc-a472-b4b1ba390e78 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:31.013003 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36eafb-9878-43fc-a472-b4b1ba390e78 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:31.088524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:31.121839 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341de05e-ac94-4a68-8271-851cc4b78a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:31.123221 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341de05e-ac94-4a68-8271-851cc4b78a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:31.123711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341de05e-ac94-4a68-8271-851cc4b78a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:31.124802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341de05e-ac94-4a68-8271-851cc4b78a3c admin admin] PATH_INFO: `/v3/users/b33cad7cc1434b9f9b7aa41a5d188102` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:31.127180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341de05e-ac94-4a68-8271-851cc4b78a3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b33cad7cc1434b9f9b7aa41a5d188102)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:31.130050 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341de05e-ac94-4a68-8271-851cc4b78a3c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:31.158165 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:31.563513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-341de05e-ac94-4a68-8271-851cc4b78a3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b33cad7cc1434b9f9b7aa41a5d188102'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:31.574317 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-341de05e-ac94-4a68-8271-851cc4b78a3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b33cad7cc1434b9f9b7aa41a5d188102'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:31.658207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-341de05e-ac94-4a68-8271-851cc4b78a3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b33cad7cc1434b9f9b7aa41a5d188102'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:31.673558 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-341de05e-ac94-4a68-8271-851cc4b78a3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b33cad7cc1434b9f9b7aa41a5d188102'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:31.673926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-341de05e-ac94-4a68-8271-851cc4b78a3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b33cad7cc1434b9f9b7aa41a5d188102'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:31.689398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1005/2032] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:31 2022] DELETE /identity/v3/users/b33cad7cc1434b9f9b7aa41a5d188102 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:31.977180 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc569d7a-774b-4ff3-bc8a-57b8a6cee1e8 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:31.977664 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc569d7a-774b-4ff3-bc8a-57b8a6cee1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:31.977744 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc569d7a-774b-4ff3-bc8a-57b8a6cee1e8 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:31.985202 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1028/2033] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 18:46:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:46:32.029349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8be2ec-4763-455c-bed5-d71af3524515 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:32.030352 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8be2ec-4763-455c-bed5-d71af3524515 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:32.030639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8be2ec-4763-455c-bed5-d71af3524515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:32.052283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-2d8be2ec-4763-455c-bed5-d71af3524515 None None] MFA Rules not processed for user `aa971da983ea48c3b6d4c68a5d454bde`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:32.053889 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2d8be2ec-4763-455c-bed5-d71af3524515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:32.139094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1006/2034] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 18:46:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:32.158265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc569d7a-774b-4ff3-bc8a-57b8a6cee1e8 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:32.160196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-fc569d7a-774b-4ff3-bc8a-57b8a6cee1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:32.178933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8be2ec-4763-455c-bed5-d71af3524515 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:32.184290 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2d8be2ec-4763-455c-bed5-d71af3524515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:32.185807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc569d7a-774b-4ff3-bc8a-57b8a6cee1e8 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:32.200885 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9cdc6-ae6f-4eb8-bb6c-73149aae3909 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa971da983ea48c3b6d4c68a5d454bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:32.201816 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9cdc6-ae6f-4eb8-bb6c-73149aae3909 service placement] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:32.202201 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9cdc6-ae6f-4eb8-bb6c-73149aae3909 service placement] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:32.203954 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9cdc6-ae6f-4eb8-bb6c-73149aae3909 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:32.237599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9cdc6-ae6f-4eb8-bb6c-73149aae3909 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:32.239654 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9cdc6-ae6f-4eb8-bb6c-73149aae3909 service placement] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:32.254884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1029/2035] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:32.269114 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8be2ec-4763-455c-bed5-d71af3524515 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:32.276413 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86be88-1a4f-4fc5-8d55-43bd6bca29dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:32.277230 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86be88-1a4f-4fc5-8d55-43bd6bca29dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:32.277678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86be88-1a4f-4fc5-8d55-43bd6bca29dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:32.278004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86be88-1a4f-4fc5-8d55-43bd6bca29dd admin admin] PATH_INFO: `/v3/users/fa24cdd15afd4c9e8b34dbfa05a5db24` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:32.279671 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86be88-1a4f-4fc5-8d55-43bd6bca29dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa24cdd15afd4c9e8b34dbfa05a5db24)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:32.281969 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86be88-1a4f-4fc5-8d55-43bd6bca29dd admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:32.330998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9cdc6-ae6f-4eb8-bb6c-73149aae3909 service placement] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:32.337372 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-d1e9cdc6-ae6f-4eb8-bb6c-73149aae3909 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:32.360328 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9cdc6-ae6f-4eb8-bb6c-73149aae3909 service placement] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:32.365991 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb8dfb-be36-41cf-98de-0e4b51b44508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:32.366679 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb8dfb-be36-41cf-98de-0e4b51b44508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:32.366980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb8dfb-be36-41cf-98de-0e4b51b44508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:32.367256 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb8dfb-be36-41cf-98de-0e4b51b44508 admin admin] PATH_INFO: `/v3/projects/70a03f2a0bde4dd386baa58c47b6337d` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:32.368610 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb8dfb-be36-41cf-98de-0e4b51b44508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70a03f2a0bde4dd386baa58c47b6337d)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:32.370560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb8dfb-be36-41cf-98de-0e4b51b44508 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:32.444618 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0c86be88-1a4f-4fc5-8d55-43bd6bca29dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa24cdd15afd4c9e8b34dbfa05a5db24'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:32.445365 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0c86be88-1a4f-4fc5-8d55-43bd6bca29dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa24cdd15afd4c9e8b34dbfa05a5db24'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:32.475681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c0eb8dfb-be36-41cf-98de-0e4b51b44508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70a03f2a0bde4dd386baa58c47b6337d', 'request_id': 'req-c0eb8dfb-be36-41cf-98de-0e4b51b44508'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:32.482777 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c0eb8dfb-be36-41cf-98de-0e4b51b44508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70a03f2a0bde4dd386baa58c47b6337d', 'request_id': 'req-c0eb8dfb-be36-41cf-98de-0e4b51b44508'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:32.508887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0c86be88-1a4f-4fc5-8d55-43bd6bca29dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa24cdd15afd4c9e8b34dbfa05a5db24'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:32.528119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0c86be88-1a4f-4fc5-8d55-43bd6bca29dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa24cdd15afd4c9e8b34dbfa05a5db24'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:32.529598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0c86be88-1a4f-4fc5-8d55-43bd6bca29dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa24cdd15afd4c9e8b34dbfa05a5db24'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:32.545628 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1007/2036] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:32 2022] DELETE /identity/v3/users/fa24cdd15afd4c9e8b34dbfa05a5db24 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:32.564093 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c0eb8dfb-be36-41cf-98de-0e4b51b44508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70a03f2a0bde4dd386baa58c47b6337d', 'request_id': 'req-c0eb8dfb-be36-41cf-98de-0e4b51b44508'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:32.577592 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c0eb8dfb-be36-41cf-98de-0e4b51b44508 admin admin] The token cache is being invalidate because project 70a03f2a0bde4dd386baa58c47b6337d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:32.578152 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c0eb8dfb-be36-41cf-98de-0e4b51b44508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:32.579045 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c0eb8dfb-be36-41cf-98de-0e4b51b44508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:32.581476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1030/2037] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:32 2022] DELETE /identity/v3/projects/70a03f2a0bde4dd386baa58c47b6337d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:32.586993 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271b5b4-2a75-445f-9523-0b38fb5a34e5 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:32.587309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271b5b4-2a75-445f-9523-0b38fb5a34e5 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:32.587599 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271b5b4-2a75-445f-9523-0b38fb5a34e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:32.610895 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-3271b5b4-2a75-445f-9523-0b38fb5a34e5 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:32.612199 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-3271b5b4-2a75-445f-9523-0b38fb5a34e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:32.688744 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1008/2038] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:32.696979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1e389-a18a-45cd-a53a-2291229ca4b9 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:32.697399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1e389-a18a-45cd-a53a-2291229ca4b9 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:32.697786 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1e389-a18a-45cd-a53a-2291229ca4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:32.724767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-34d1e389-a18a-45cd-a53a-2291229ca4b9 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:32.726224 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-34d1e389-a18a-45cd-a53a-2291229ca4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:32.743548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1031/2039] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:32.749107 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271b5b4-2a75-445f-9523-0b38fb5a34e5 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:32.761490 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271b5b4-2a75-445f-9523-0b38fb5a34e5 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:32.766250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b1496-f943-441c-8254-27f65517c3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:32.766881 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b1496-f943-441c-8254-27f65517c3af admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:32.767160 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b1496-f943-441c-8254-27f65517c3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:32.767489 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b1496-f943-441c-8254-27f65517c3af admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:32.768194 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b1496-f943-441c-8254-27f65517c3af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:46:32.768501 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b1496-f943-441c-8254-27f65517c3af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:32.770150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b1496-f943-441c-8254-27f65517c3af admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:32.783327 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1009/2040] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:46:32.787744 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1e389-a18a-45cd-a53a-2291229ca4b9 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:32.798707 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1e389-a18a-45cd-a53a-2291229ca4b9 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:32.803597 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8944d7-6bdc-4534-830d-99317f31f0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:32.804372 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8944d7-6bdc-4534-830d-99317f31f0ed admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:32.804831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8944d7-6bdc-4534-830d-99317f31f0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:32.805277 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8944d7-6bdc-4534-830d-99317f31f0ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:32.805969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8944d7-6bdc-4534-830d-99317f31f0ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:32.807971 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8944d7-6bdc-4534-830d-99317f31f0ed admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:32.882463 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b1496-f943-441c-8254-27f65517c3af admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:32.884802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-316b1496-f943-441c-8254-27f65517c3af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:32.901184 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b1496-f943-441c-8254-27f65517c3af admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:32.908448 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6580e82-86fd-4006-8fce-7dc638d05abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:32.909128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6580e82-86fd-4006-8fce-7dc638d05abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:32.909413 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6580e82-86fd-4006-8fce-7dc638d05abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:32.909716 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6580e82-86fd-4006-8fce-7dc638d05abe admin admin] PATH_INFO: `/v3/projects/ed0f33af11414f889460ec4ed7179503` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:32.910964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6580e82-86fd-4006-8fce-7dc638d05abe admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed0f33af11414f889460ec4ed7179503)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:32.912942 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6580e82-86fd-4006-8fce-7dc638d05abe admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:32.932626 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1032/2041] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:46:32 2022] POST /identity/v3/projects => generated 355 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:32.935889 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8944d7-6bdc-4534-830d-99317f31f0ed admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:33.014123 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8944d7-6bdc-4534-830d-99317f31f0ed admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:33.020050 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900c3ab-7453-41df-bc55-c4f7c68e96fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:33.020751 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900c3ab-7453-41df-bc55-c4f7c68e96fb admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:33.021036 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900c3ab-7453-41df-bc55-c4f7c68e96fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:33.021308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900c3ab-7453-41df-bc55-c4f7c68e96fb admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:33.021977 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900c3ab-7453-41df-bc55-c4f7c68e96fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:33.023980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900c3ab-7453-41df-bc55-c4f7c68e96fb admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:33.040561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:33.058600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d6580e82-86fd-4006-8fce-7dc638d05abe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed0f33af11414f889460ec4ed7179503', 'request_id': 'req-d6580e82-86fd-4006-8fce-7dc638d05abe'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:33.064414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d6580e82-86fd-4006-8fce-7dc638d05abe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed0f33af11414f889460ec4ed7179503', 'request_id': 'req-d6580e82-86fd-4006-8fce-7dc638d05abe'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:33.196674 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:33.207495 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1033/2042] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:46:32 2022] POST /identity/v3/users => generated 278 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:33.212081 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900c3ab-7453-41df-bc55-c4f7c68e96fb admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:33.223177 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900c3ab-7453-41df-bc55-c4f7c68e96fb admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:33.246797 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d6580e82-86fd-4006-8fce-7dc638d05abe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed0f33af11414f889460ec4ed7179503', 'request_id': 'req-d6580e82-86fd-4006-8fce-7dc638d05abe'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:33.260784 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d6580e82-86fd-4006-8fce-7dc638d05abe admin admin] The token cache is being invalidate because project ed0f33af11414f889460ec4ed7179503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:33.260999 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d6580e82-86fd-4006-8fce-7dc638d05abe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:33.261814 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d6580e82-86fd-4006-8fce-7dc638d05abe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:33.263628 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1010/2043] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:32 2022] DELETE /identity/v3/projects/ed0f33af11414f889460ec4ed7179503 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:33.269108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d9cae-abb4-4f33-9be9-9aabf7a8afc0 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:33.269601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d9cae-abb4-4f33-9be9-9aabf7a8afc0 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:33.269962 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d9cae-abb4-4f33-9be9-9aabf7a8afc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:33.283703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89032ff-83c1-4bdb-a52d-778b86836dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:33.284347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89032ff-83c1-4bdb-a52d-778b86836dae admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:33.284636 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89032ff-83c1-4bdb-a52d-778b86836dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:33.284915 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89032ff-83c1-4bdb-a52d-778b86836dae admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:33.285618 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89032ff-83c1-4bdb-a52d-778b86836dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:33.287451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89032ff-83c1-4bdb-a52d-778b86836dae admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:33.291936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-729d9cae-abb4-4f33-9be9-9aabf7a8afc0 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:33.293260 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-729d9cae-abb4-4f33-9be9-9aabf7a8afc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:33.299821 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1034/2044] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:33.307633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89032ff-83c1-4bdb-a52d-778b86836dae admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:33.309981 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1011/2045] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:46:33.310140 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-f89032ff-83c1-4bdb-a52d-778b86836dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:33.318051 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be6fe1-f72e-449a-a42a-b012fe78d04f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:33.318420 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be6fe1-f72e-449a-a42a-b012fe78d04f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:33.318608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be6fe1-f72e-449a-a42a-b012fe78d04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:33.327419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89032ff-83c1-4bdb-a52d-778b86836dae admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:33.344034 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6843a-4315-4e18-8182-ed434a5d5497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:33.345451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6843a-4315-4e18-8182-ed434a5d5497 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:33.345754 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6843a-4315-4e18-8182-ed434a5d5497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:33.351780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6843a-4315-4e18-8182-ed434a5d5497 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:33.351984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-32be6fe1-f72e-449a-a42a-b012fe78d04f None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:33.352737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6843a-4315-4e18-8182-ed434a5d5497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:33.353434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-32be6fe1-f72e-449a-a42a-b012fe78d04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:33.354691 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6843a-4315-4e18-8182-ed434a5d5497 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:33.363892 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1012/2046] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:46:33.369204 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be6fe1-f72e-449a-a42a-b012fe78d04f None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:33.374512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1035/2047] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:46:33.380999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6843a-4315-4e18-8182-ed434a5d5497 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:33.381290 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be6fe1-f72e-449a-a42a-b012fe78d04f None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:33.387008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820012e6-124e-4aac-9af1-e02ada82faec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:33.387860 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820012e6-124e-4aac-9af1-e02ada82faec admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:33.388249 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820012e6-124e-4aac-9af1-e02ada82faec admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:33.388602 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820012e6-124e-4aac-9af1-e02ada82faec admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:33.389415 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820012e6-124e-4aac-9af1-e02ada82faec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:46:33.389732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820012e6-124e-4aac-9af1-e02ada82faec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:33.391931 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820012e6-124e-4aac-9af1-e02ada82faec admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:33.394489 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6843a-4315-4e18-8182-ed434a5d5497 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:33.399440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5e904-4724-4630-ad7a-49328ab1e31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:33.401650 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5e904-4724-4630-ad7a-49328ab1e31a admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:33.401650 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5e904-4724-4630-ad7a-49328ab1e31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:33.401650 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5e904-4724-4630-ad7a-49328ab1e31a admin admin] PATH_INFO: `/v3/projects/01242181c94347f2b4d520a07ae4e962/users/c420caff33cb43a89e8c1fa3a68de061/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:33.405024 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1013/2048] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:46:33.411555 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820012e6-124e-4aac-9af1-e02ada82faec admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:33.419346 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5e904-4724-4630-ad7a-49328ab1e31a admin admin] RBAC: Authorizing `identity:create_grant(project_id=01242181c94347f2b4d520a07ae4e962, user_id=c420caff33cb43a89e8c1fa3a68de061, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:33.421975 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820012e6-124e-4aac-9af1-e02ada82faec admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:33.422736 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5e904-4724-4630-ad7a-49328ab1e31a admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:33.427499 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17445a73-b7e3-4b81-b4cb-e9a97d471038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:33.428435 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17445a73-b7e3-4b81-b4cb-e9a97d471038 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:33.428775 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17445a73-b7e3-4b81-b4cb-e9a97d471038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:33.429057 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17445a73-b7e3-4b81-b4cb-e9a97d471038 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:33.436220 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17445a73-b7e3-4b81-b4cb-e9a97d471038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:33.436220 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17445a73-b7e3-4b81-b4cb-e9a97d471038 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:33.543779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1036/2049] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:33 2022] PUT /identity/v3/projects/01242181c94347f2b4d520a07ae4e962/users/c420caff33cb43a89e8c1fa3a68de061/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:33.550954 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1014/2050] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:46:33 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:46:33.556713 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd28727-c01c-4e68-9398-e15d0357639c None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:33.556713 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd28727-c01c-4e68-9398-e15d0357639c None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:33.556713 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd28727-c01c-4e68-9398-e15d0357639c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:33.557520 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17445a73-b7e3-4b81-b4cb-e9a97d471038 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:33.627213 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-8fd28727-c01c-4e68-9398-e15d0357639c None None] MFA Rules not processed for user `c420caff33cb43a89e8c1fa3a68de061`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:33.628631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-8fd28727-c01c-4e68-9398-e15d0357639c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:33.655591 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17445a73-b7e3-4b81-b4cb-e9a97d471038 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:33.662513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2782347-11e3-4d05-bcd8-c577e201c288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:33.663184 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2782347-11e3-4d05-bcd8-c577e201c288 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:33.663501 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2782347-11e3-4d05-bcd8-c577e201c288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:33.663962 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2782347-11e3-4d05-bcd8-c577e201c288 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:33.664649 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2782347-11e3-4d05-bcd8-c577e201c288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:33.666659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2782347-11e3-4d05-bcd8-c577e201c288 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:33.705586 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1037/2051] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:33 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:33.717796 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd28727-c01c-4e68-9398-e15d0357639c None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:33.731609 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd28727-c01c-4e68-9398-e15d0357639c None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:33.738337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9636f-7c1a-479c-87c2-b233807a2e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:33.738988 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9636f-7c1a-479c-87c2-b233807a2e0c admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:33.739296 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9636f-7c1a-479c-87c2-b233807a2e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:33.739590 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9636f-7c1a-479c-87c2-b233807a2e0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:33.740361 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9636f-7c1a-479c-87c2-b233807a2e0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:33.743427 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9636f-7c1a-479c-87c2-b233807a2e0c admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:33.776468 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1015/2052] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:46:33 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:46:33.780386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2782347-11e3-4d05-bcd8-c577e201c288 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:33.790925 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2782347-11e3-4d05-bcd8-c577e201c288 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:33.795734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e93f3a-0bea-4298-974e-ad91e8819b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:33.796349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e93f3a-0bea-4298-974e-ad91e8819b61 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:33.796743 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e93f3a-0bea-4298-974e-ad91e8819b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:33.797043 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e93f3a-0bea-4298-974e-ad91e8819b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:33.797904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e93f3a-0bea-4298-974e-ad91e8819b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:33.799551 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e93f3a-0bea-4298-974e-ad91e8819b61 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:33.810179 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1016/2053] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:46:33.814624 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e93f3a-0bea-4298-974e-ad91e8819b61 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:33.824374 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e93f3a-0bea-4298-974e-ad91e8819b61 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:33.829857 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ccc30-3ec1-4415-a7ba-541c73901ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:33.830414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ccc30-3ec1-4415-a7ba-541c73901ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:33.830701 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ccc30-3ec1-4415-a7ba-541c73901ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:33.831022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ccc30-3ec1-4415-a7ba-541c73901ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:33.831768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ccc30-3ec1-4415-a7ba-541c73901ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:33.835765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ccc30-3ec1-4415-a7ba-541c73901ad3 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:33.844678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1017/2054] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:46:33.848897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ccc30-3ec1-4415-a7ba-541c73901ad3 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:33.859838 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ccc30-3ec1-4415-a7ba-541c73901ad3 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:33.863097 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1038/2055] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:46:33 2022] POST /identity/v3/projects => generated 355 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:46:33.865380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e2125-4b39-4004-bfa8-4186fc889dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:33.866099 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e2125-4b39-4004-bfa8-4186fc889dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:33.866637 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e2125-4b39-4004-bfa8-4186fc889dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:33.866976 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e2125-4b39-4004-bfa8-4186fc889dbe admin admin] PATH_INFO: `/v3/projects/b8608020e66a45f8b345851ab5915482/users/5368240517584626bfe26d257ceb9b61/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:33.867861 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:33.869534 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9636f-7c1a-479c-87c2-b233807a2e0c admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:33.883890 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e2125-4b39-4004-bfa8-4186fc889dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8608020e66a45f8b345851ab5915482, user_id=5368240517584626bfe26d257ceb9b61, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:33.886600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e2125-4b39-4004-bfa8-4186fc889dbe admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:33.945506 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9636f-7c1a-479c-87c2-b233807a2e0c admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:33.951596 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcf2a6-f0ca-497b-9abd-899c0d880054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:33.952364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcf2a6-f0ca-497b-9abd-899c0d880054 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:33.952703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcf2a6-f0ca-497b-9abd-899c0d880054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:33.953786 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcf2a6-f0ca-497b-9abd-899c0d880054 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:33.954291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffcf2a6-f0ca-497b-9abd-899c0d880054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:33.956358 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffcf2a6-f0ca-497b-9abd-899c0d880054 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:33.979579 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1018/2056] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:33 2022] PUT /identity/v3/projects/b8608020e66a45f8b345851ab5915482/users/5368240517584626bfe26d257ceb9b61/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:33.983362 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266040e5-ce2e-41d6-b4cf-a6cd46cbb3cf None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:33.983728 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266040e5-ce2e-41d6-b4cf-a6cd46cbb3cf None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:33.984098 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266040e5-ce2e-41d6-b4cf-a6cd46cbb3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:34.014279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-266040e5-ce2e-41d6-b4cf-a6cd46cbb3cf None None] MFA Rules not processed for user `5368240517584626bfe26d257ceb9b61`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:34.015680 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-266040e5-ce2e-41d6-b4cf-a6cd46cbb3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:34.070007 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1039/2057] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:46:33 2022] POST /identity/v3/users => generated 284 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:46:34.071755 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcf2a6-f0ca-497b-9abd-899c0d880054 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:34.087674 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcf2a6-f0ca-497b-9abd-899c0d880054 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:34.101111 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1019/2058] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:46:34.105560 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266040e5-ce2e-41d6-b4cf-a6cd46cbb3cf None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:34.156673 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32a4ac-7c31-4f59-aae7-2779ccf315ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:34.157384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32a4ac-7c31-4f59-aae7-2779ccf315ac admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:34.157855 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32a4ac-7c31-4f59-aae7-2779ccf315ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:34.158134 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32a4ac-7c31-4f59-aae7-2779ccf315ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:34.158836 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32a4ac-7c31-4f59-aae7-2779ccf315ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:34.160587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32a4ac-7c31-4f59-aae7-2779ccf315ac admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:34.171302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1040/2059] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:34.175658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266040e5-ce2e-41d6-b4cf-a6cd46cbb3cf None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:34.176616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32a4ac-7c31-4f59-aae7-2779ccf315ac admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:34.180542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e4377-5d01-4e2f-8f5b-b7522c4df3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:34.181241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e4377-5d01-4e2f-8f5b-b7522c4df3d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:34.181636 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e4377-5d01-4e2f-8f5b-b7522c4df3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:34.181984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e4377-5d01-4e2f-8f5b-b7522c4df3d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:34.182768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e4377-5d01-4e2f-8f5b-b7522c4df3d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:34.184791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e4377-5d01-4e2f-8f5b-b7522c4df3d9 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:34.186053 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32a4ac-7c31-4f59-aae7-2779ccf315ac admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:34.192615 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f38a8-cc8f-4113-a600-7936e8ebcc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:34.193267 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f38a8-cc8f-4113-a600-7936e8ebcc32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:34.193618 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f38a8-cc8f-4113-a600-7936e8ebcc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:34.193966 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f38a8-cc8f-4113-a600-7936e8ebcc32 admin admin] PATH_INFO: `/v3/projects/515c0ffbca834ad9a1417f7c41ad7600/users/f94f54650ddc4ea187af827199b67e64/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:34.210303 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f38a8-cc8f-4113-a600-7936e8ebcc32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=515c0ffbca834ad9a1417f7c41ad7600, user_id=f94f54650ddc4ea187af827199b67e64, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:34.213382 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f38a8-cc8f-4113-a600-7936e8ebcc32 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:34.299131 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1041/2060] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:34 2022] PUT /identity/v3/projects/515c0ffbca834ad9a1417f7c41ad7600/users/f94f54650ddc4ea187af827199b67e64/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:34.303763 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f38a8-cc8f-4113-a600-7936e8ebcc32 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:34.303927 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1020/2061] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:46:34 2022] POST /identity/v3/projects => generated 375 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:46:34.305958 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e4377-5d01-4e2f-8f5b-b7522c4df3d9 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:34.372909 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e4377-5d01-4e2f-8f5b-b7522c4df3d9 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:34.374732 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f38a8-cc8f-4113-a600-7936e8ebcc32 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:34.377823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb6a1b-c7b4-4014-b275-654060ca7caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:34.378450 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb6a1b-c7b4-4014-b275-654060ca7caf admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:34.378730 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb6a1b-c7b4-4014-b275-654060ca7caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:34.379004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb6a1b-c7b4-4014-b275-654060ca7caf admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:34.379722 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb6a1b-c7b4-4014-b275-654060ca7caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:34.380837 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeb6e9-1696-4b65-a62b-6bd2ee14371d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:34.381770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeb6e9-1696-4b65-a62b-6bd2ee14371d admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:34.382065 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeb6e9-1696-4b65-a62b-6bd2ee14371d admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:34.382354 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeb6e9-1696-4b65-a62b-6bd2ee14371d admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:34.383197 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffeb6e9-1696-4b65-a62b-6bd2ee14371d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:34.384014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb6a1b-c7b4-4014-b275-654060ca7caf admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:34.385033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffeb6e9-1696-4b65-a62b-6bd2ee14371d admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:34.399978 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1042/2062] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:34.404447 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeb6e9-1696-4b65-a62b-6bd2ee14371d admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:34.419099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeb6e9-1696-4b65-a62b-6bd2ee14371d admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:34.424700 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f3b00-9a08-42f8-9964-31be132b459d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:34.427796 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f3b00-9a08-42f8-9964-31be132b459d admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:34.427796 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f3b00-9a08-42f8-9964-31be132b459d admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:34.427796 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f3b00-9a08-42f8-9964-31be132b459d admin admin] PATH_INFO: `/v3/projects/515c0ffbca834ad9a1417f7c41ad7600/users/f94f54650ddc4ea187af827199b67e64/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:34.428092 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f3b00-9a08-42f8-9964-31be132b459d admin admin] RBAC: Authorizing `identity:create_grant(project_id=515c0ffbca834ad9a1417f7c41ad7600, user_id=f94f54650ddc4ea187af827199b67e64, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:34.430749 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f3b00-9a08-42f8-9964-31be132b459d admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:34.441537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1043/2063] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:34 2022] PUT /identity/v3/projects/515c0ffbca834ad9a1417f7c41ad7600/users/f94f54650ddc4ea187af827199b67e64/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:34.453139 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de61b1-c3af-422e-8cc1-5c1ce368e772 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:34.453713 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de61b1-c3af-422e-8cc1-5c1ce368e772 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:34.453904 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de61b1-c3af-422e-8cc1-5c1ce368e772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:34.489024 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-f6de61b1-c3af-422e-8cc1-5c1ce368e772 None None] MFA Rules not processed for user `f94f54650ddc4ea187af827199b67e64`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:34.490309 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-f6de61b1-c3af-422e-8cc1-5c1ce368e772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:34.492938 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1021/2064] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:46:34 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:34.500815 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb6a1b-c7b4-4014-b275-654060ca7caf admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:34.507402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb6a1b-c7b4-4014-b275-654060ca7caf admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:34.532304 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:34.589353 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1044/2065] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:34 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:46:34.601492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de61b1-c3af-422e-8cc1-5c1ce368e772 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:34.602927 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-f6de61b1-c3af-422e-8cc1-5c1ce368e772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:34.607223 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9ad77-dc24-468a-a4a4-db4bd294b081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:34.608709 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9ad77-dc24-468a-a4a4-db4bd294b081 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:34.610147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9ad77-dc24-468a-a4a4-db4bd294b081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:34.610440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9ad77-dc24-468a-a4a4-db4bd294b081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:34.611290 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9ad77-dc24-468a-a4a4-db4bd294b081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:34.612920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9ad77-dc24-468a-a4a4-db4bd294b081 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:34.632523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1022/2066] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:46:34.640193 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9ad77-dc24-468a-a4a4-db4bd294b081 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:34.652428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9ad77-dc24-468a-a4a4-db4bd294b081 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:34.659133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a3e7d-9385-43ad-92f0-754d489b9b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:34.660749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a3e7d-9385-43ad-92f0-754d489b9b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:34.662447 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a3e7d-9385-43ad-92f0-754d489b9b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:34.662447 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a3e7d-9385-43ad-92f0-754d489b9b55 admin admin] PATH_INFO: `/v3/projects/aa7316fc98854a19b03f6bd8c7bd66b2/users/eb12b0544c274ada9a70cd25be402949/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:34.671472 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de61b1-c3af-422e-8cc1-5c1ce368e772 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:34.676199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4b476-fa7d-46cc-9049-664b91ead6b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:34.676838 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4b476-fa7d-46cc-9049-664b91ead6b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:34.677117 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4b476-fa7d-46cc-9049-664b91ead6b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:34.677391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4b476-fa7d-46cc-9049-664b91ead6b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:34.688157 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a3e7d-9385-43ad-92f0-754d489b9b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7316fc98854a19b03f6bd8c7bd66b2, user_id=eb12b0544c274ada9a70cd25be402949, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:34.689780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4b476-fa7d-46cc-9049-664b91ead6b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:34.691605 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4b476-fa7d-46cc-9049-664b91ead6b5 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:34.692896 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a3e7d-9385-43ad-92f0-754d489b9b55 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:34.708411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1045/2067] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:34 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:46:34.745528 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1023/2068] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:34 2022] PUT /identity/v3/projects/aa7316fc98854a19b03f6bd8c7bd66b2/users/eb12b0544c274ada9a70cd25be402949/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:34.750779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4b476-fa7d-46cc-9049-664b91ead6b5 service cinder] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:34.758649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:34.763110 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4b476-fa7d-46cc-9049-664b91ead6b5 service cinder] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:34.833594 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b0b4f-ecb0-48b8-8807-2e452c3c1c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:34.834303 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b0b4f-ecb0-48b8-8807-2e452c3c1c3a admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:34.834593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b0b4f-ecb0-48b8-8807-2e452c3c1c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:34.834869 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b0b4f-ecb0-48b8-8807-2e452c3c1c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:34.835886 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b0b4f-ecb0-48b8-8807-2e452c3c1c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:34.837608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b0b4f-ecb0-48b8-8807-2e452c3c1c3a admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:34.849411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1046/2069] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:34.853937 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a3e7d-9385-43ad-92f0-754d489b9b55 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:34.865517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a3e7d-9385-43ad-92f0-754d489b9b55 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:34.870309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea440d-204b-498e-8c93-ee136dc28b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:34.871051 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea440d-204b-498e-8c93-ee136dc28b65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:34.871284 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea440d-204b-498e-8c93-ee136dc28b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:34.871559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea440d-204b-498e-8c93-ee136dc28b65 admin admin] PATH_INFO: `/v3/projects/aa7316fc98854a19b03f6bd8c7bd66b2/users/eb12b0544c274ada9a70cd25be402949/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:34.873626 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea440d-204b-498e-8c93-ee136dc28b65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7316fc98854a19b03f6bd8c7bd66b2, user_id=eb12b0544c274ada9a70cd25be402949, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:34.877044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea440d-204b-498e-8c93-ee136dc28b65 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:34.888586 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1024/2070] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:34 2022] PUT /identity/v3/projects/aa7316fc98854a19b03f6bd8c7bd66b2/users/eb12b0544c274ada9a70cd25be402949/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:34.901750 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540ba33-4d6e-462b-bafe-26713851fae1 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:34.902289 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540ba33-4d6e-462b-bafe-26713851fae1 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:34.902753 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540ba33-4d6e-462b-bafe-26713851fae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:34.950360 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-1540ba33-4d6e-462b-bafe-26713851fae1 None None] MFA Rules not processed for user `eb12b0544c274ada9a70cd25be402949`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:34.950360 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-1540ba33-4d6e-462b-bafe-26713851fae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:34.952793 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea440d-204b-498e-8c93-ee136dc28b65 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:35.018247 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea440d-204b-498e-8c93-ee136dc28b65 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:35.023205 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1047/2071] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:35.024783 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2ae8c-044d-4379-9fa8-d9642bbea5d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:35.025425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2ae8c-044d-4379-9fa8-d9642bbea5d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:35.025713 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2ae8c-044d-4379-9fa8-d9642bbea5d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:35.025993 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2ae8c-044d-4379-9fa8-d9642bbea5d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:35.034984 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540ba33-4d6e-462b-bafe-26713851fae1 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:35.036573 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-1540ba33-4d6e-462b-bafe-26713851fae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:35.049935 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540ba33-4d6e-462b-bafe-26713851fae1 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:35.054432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a5491-a504-4351-84e5-f8bad7d23d76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:35.055112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a5491-a504-4351-84e5-f8bad7d23d76 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:35.055491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a5491-a504-4351-84e5-f8bad7d23d76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:35.055726 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a5491-a504-4351-84e5-f8bad7d23d76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:35.117543 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2ae8c-044d-4379-9fa8-d9642bbea5d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:35.119858 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2ae8c-044d-4379-9fa8-d9642bbea5d5 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:35.130597 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1025/2072] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:34 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:35.148179 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a5491-a504-4351-84e5-f8bad7d23d76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:35.149645 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a5491-a504-4351-84e5-f8bad7d23d76 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:35.160586 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1048/2073] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:46:35.449743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:35.524244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:INSERT=5,keystone:SELECT=86,keystone:DELETE=9 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:36.349046 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:36.723686 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:36.826539 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:37.834527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:37.897716 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:38.222843 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:38.262898 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:38.445743 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:38.692752 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2ae8c-044d-4379-9fa8-d9642bbea5d5 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:38.701235 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2ae8c-044d-4379-9fa8-d9642bbea5d5 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:38.705884 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d329629-7f5d-47ef-b9fb-e62f847378f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:38.706523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d329629-7f5d-47ef-b9fb-e62f847378f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:38.706802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d329629-7f5d-47ef-b9fb-e62f847378f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:38.707076 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d329629-7f5d-47ef-b9fb-e62f847378f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:38.717805 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d329629-7f5d-47ef-b9fb-e62f847378f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:38.719283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d329629-7f5d-47ef-b9fb-e62f847378f0 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:38.730858 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1026/2074] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:38.760591 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:39.089613 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:39.428786 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:39.643909 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:40.175215 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:40.497654 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:40.572073 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:41.621322 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:41.772339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:42.067566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:42.280504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:42.725642 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:43.046333 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:43.565985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:43.851741 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:43.992294 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:44.361963 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:44.707499 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:45.017738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:45.744217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:45.874336 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:46.301235 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:46.332112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a5491-a504-4351-84e5-f8bad7d23d76 service cinder] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:46.340996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a5491-a504-4351-84e5-f8bad7d23d76 service cinder] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:46.344598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8528b-173d-4c8a-88aa-2e20b6686ed2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:46.345232 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8528b-173d-4c8a-88aa-2e20b6686ed2 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:46.345615 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8528b-173d-4c8a-88aa-2e20b6686ed2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:46.345792 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8528b-173d-4c8a-88aa-2e20b6686ed2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:46.347746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-60c8528b-173d-4c8a-88aa-2e20b6686ed2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:46.415352 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8528b-173d-4c8a-88aa-2e20b6686ed2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:46.416741 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8528b-173d-4c8a-88aa-2e20b6686ed2 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:46.426578 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1049/2075] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:46 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:46.760225 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:47.520324 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:48.067073 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:48.474575 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:50.446535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d329629-7f5d-47ef-b9fb-e62f847378f0 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:50.448219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6d329629-7f5d-47ef-b9fb-e62f847378f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:50.526643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d329629-7f5d-47ef-b9fb-e62f847378f0 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:50.531544 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3de378-293b-4c3d-86d5-a76820df423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:50.532342 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3de378-293b-4c3d-86d5-a76820df423b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:50.533306 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3de378-293b-4c3d-86d5-a76820df423b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:50.533658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3de378-293b-4c3d-86d5-a76820df423b admin admin] PATH_INFO: `/v3/users/f01724d244584b4eb19a48c607b9728f` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:50.534969 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3de378-293b-4c3d-86d5-a76820df423b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01724d244584b4eb19a48c607b9728f)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:50.537868 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3de378-293b-4c3d-86d5-a76820df423b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:50.675429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:50.677852 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2a3de378-293b-4c3d-86d5-a76820df423b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01724d244584b4eb19a48c607b9728f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:50.678599 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2a3de378-293b-4c3d-86d5-a76820df423b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01724d244584b4eb19a48c607b9728f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:50.734931 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2a3de378-293b-4c3d-86d5-a76820df423b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01724d244584b4eb19a48c607b9728f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:50.750266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2a3de378-293b-4c3d-86d5-a76820df423b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01724d244584b4eb19a48c607b9728f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:50.751119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2a3de378-293b-4c3d-86d5-a76820df423b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01724d244584b4eb19a48c607b9728f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:50.764491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1027/2076] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:50 2022] DELETE /identity/v3/users/f01724d244584b4eb19a48c607b9728f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:50.769238 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fefdd-e315-4287-8bf9-ef40b6d342e9 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:50.769725 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fefdd-e315-4287-8bf9-ef40b6d342e9 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:50.769830 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fefdd-e315-4287-8bf9-ef40b6d342e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:50.790375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-4e7fefdd-e315-4287-8bf9-ef40b6d342e9 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:50.791647 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4e7fefdd-e315-4287-8bf9-ef40b6d342e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:50.857981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1050/2077] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:46:50.865329 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3de378-293b-4c3d-86d5-a76820df423b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:50.866837 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2a3de378-293b-4c3d-86d5-a76820df423b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:50.945601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3de378-293b-4c3d-86d5-a76820df423b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:50.947604 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc794f1d-406e-42df-b0c6-b24b0c81eae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:50.948245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc794f1d-406e-42df-b0c6-b24b0c81eae6 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:50.948534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc794f1d-406e-42df-b0c6-b24b0c81eae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:50.948812 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc794f1d-406e-42df-b0c6-b24b0c81eae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:50.969861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc794f1d-406e-42df-b0c6-b24b0c81eae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:50.971713 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc794f1d-406e-42df-b0c6-b24b0c81eae6 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:50.984446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1028/2078] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:51.451531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fefdd-e315-4287-8bf9-ef40b6d342e9 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:51.453014 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4e7fefdd-e315-4287-8bf9-ef40b6d342e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:51.468511 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fefdd-e315-4287-8bf9-ef40b6d342e9 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:51.473625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a58c55-cc4c-410c-9030-ba5b9f67c1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:51.474301 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a58c55-cc4c-410c-9030-ba5b9f67c1e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:51.474579 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a58c55-cc4c-410c-9030-ba5b9f67c1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:51.474860 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a58c55-cc4c-410c-9030-ba5b9f67c1e2 admin admin] PATH_INFO: `/v3/projects/62b1396061154423a6a018d6e0fba302` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:51.476114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a58c55-cc4c-410c-9030-ba5b9f67c1e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b1396061154423a6a018d6e0fba302)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:51.478074 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a58c55-cc4c-410c-9030-ba5b9f67c1e2 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:51.599617 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:51.602908 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d9a58c55-cc4c-410c-9030-ba5b9f67c1e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b1396061154423a6a018d6e0fba302', 'request_id': 'req-d9a58c55-cc4c-410c-9030-ba5b9f67c1e2'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:51.608737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d9a58c55-cc4c-410c-9030-ba5b9f67c1e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b1396061154423a6a018d6e0fba302', 'request_id': 'req-d9a58c55-cc4c-410c-9030-ba5b9f67c1e2'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:51.800957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d9a58c55-cc4c-410c-9030-ba5b9f67c1e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b1396061154423a6a018d6e0fba302', 'request_id': 'req-d9a58c55-cc4c-410c-9030-ba5b9f67c1e2'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:51.819593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d9a58c55-cc4c-410c-9030-ba5b9f67c1e2 admin admin] The token cache is being invalidate because project 62b1396061154423a6a018d6e0fba302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:51.820214 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d9a58c55-cc4c-410c-9030-ba5b9f67c1e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:51.821159 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d9a58c55-cc4c-410c-9030-ba5b9f67c1e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:51.823507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1051/2079] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:51 2022] DELETE /identity/v3/projects/62b1396061154423a6a018d6e0fba302 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:51.834310 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891521b-9433-49ae-ac0d-1803366dbe4a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:51.834816 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891521b-9433-49ae-ac0d-1803366dbe4a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:51.834941 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891521b-9433-49ae-ac0d-1803366dbe4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:51.859743 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b891521b-9433-49ae-ac0d-1803366dbe4a None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:51.861072 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b891521b-9433-49ae-ac0d-1803366dbe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:51.927809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1029/2080] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:51.935767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474d12d-76fd-4c04-bb77-45a24776fb21 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:51.936049 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474d12d-76fd-4c04-bb77-45a24776fb21 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:51.936323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474d12d-76fd-4c04-bb77-45a24776fb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:51.959560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-2474d12d-76fd-4c04-bb77-45a24776fb21 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:51.961055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2474d12d-76fd-4c04-bb77-45a24776fb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:51.969229 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1052/2081] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:51.973535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891521b-9433-49ae-ac0d-1803366dbe4a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:51.983448 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891521b-9433-49ae-ac0d-1803366dbe4a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:51.988629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa1acd-7d3c-43ec-a365-e30f7c17669f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:51.991537 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa1acd-7d3c-43ec-a365-e30f7c17669f admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:51.991537 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa1acd-7d3c-43ec-a365-e30f7c17669f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:51.991537 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa1acd-7d3c-43ec-a365-e30f7c17669f admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:51.991537 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa1acd-7d3c-43ec-a365-e30f7c17669f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:46:51.991537 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa1acd-7d3c-43ec-a365-e30f7c17669f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:51.993093 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa1acd-7d3c-43ec-a365-e30f7c17669f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:52.005825 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1030/2082] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:46:52.010367 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474d12d-76fd-4c04-bb77-45a24776fb21 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:52.019994 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474d12d-76fd-4c04-bb77-45a24776fb21 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:52.025446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e3cac-98b8-4048-9ca4-2bccec16bfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:52.026128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e3cac-98b8-4048-9ca4-2bccec16bfc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:52.026503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e3cac-98b8-4048-9ca4-2bccec16bfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:52.026830 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e3cac-98b8-4048-9ca4-2bccec16bfc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:52.028735 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e3cac-98b8-4048-9ca4-2bccec16bfc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:52.029547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e3cac-98b8-4048-9ca4-2bccec16bfc4 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:52.146405 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1053/2083] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:46:52 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:46:52.150761 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa1acd-7d3c-43ec-a365-e30f7c17669f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:52.163231 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa1acd-7d3c-43ec-a365-e30f7c17669f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:52.213382 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:52.222940 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f1ef9-4d5d-4c41-aca9-deb39a0ca975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:52.223855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f1ef9-4d5d-4c41-aca9-deb39a0ca975 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:52.224135 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f1ef9-4d5d-4c41-aca9-deb39a0ca975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:52.224451 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f1ef9-4d5d-4c41-aca9-deb39a0ca975 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:52.225116 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f1ef9-4d5d-4c41-aca9-deb39a0ca975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:52.227033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f1ef9-4d5d-4c41-aca9-deb39a0ca975 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:52.368520 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1031/2084] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:46:52 2022] POST /identity/v3/users => generated 287 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:52.370130 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e3cac-98b8-4048-9ca4-2bccec16bfc4 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:52.383020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e3cac-98b8-4048-9ca4-2bccec16bfc4 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:52.409336 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286039c7-331d-438c-829b-ce10b4b1cc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:52.410368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286039c7-331d-438c-829b-ce10b4b1cc18 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:52.411018 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286039c7-331d-438c-829b-ce10b4b1cc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:52.411338 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286039c7-331d-438c-829b-ce10b4b1cc18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:52.412121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286039c7-331d-438c-829b-ce10b4b1cc18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:52.414347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286039c7-331d-438c-829b-ce10b4b1cc18 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:52.426492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1054/2085] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:46:52.430855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f1ef9-4d5d-4c41-aca9-deb39a0ca975 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:52.443197 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f1ef9-4d5d-4c41-aca9-deb39a0ca975 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:52.450099 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a817ab-d494-4c81-8e60-6423d9408198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:52.450760 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a817ab-d494-4c81-8e60-6423d9408198 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:52.451050 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a817ab-d494-4c81-8e60-6423d9408198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:52.451368 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a817ab-d494-4c81-8e60-6423d9408198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:52.452118 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a817ab-d494-4c81-8e60-6423d9408198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:52.453792 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a817ab-d494-4c81-8e60-6423d9408198 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:52.468220 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1032/2086] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:52.472214 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286039c7-331d-438c-829b-ce10b4b1cc18 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:52.486407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286039c7-331d-438c-829b-ce10b4b1cc18 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:52.491437 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39de23e-d631-465e-9b6d-bd944c82bf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:52.492345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39de23e-d631-465e-9b6d-bd944c82bf59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:52.492487 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39de23e-d631-465e-9b6d-bd944c82bf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:52.492763 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39de23e-d631-465e-9b6d-bd944c82bf59 admin admin] PATH_INFO: `/v3/projects/65515d87a42a4d939b26cb53cdbd808b/users/78a1ae57bb2840efb7007b64b0024469/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:52.509086 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39de23e-d631-465e-9b6d-bd944c82bf59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65515d87a42a4d939b26cb53cdbd808b, user_id=78a1ae57bb2840efb7007b64b0024469, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:52.511905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39de23e-d631-465e-9b6d-bd944c82bf59 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:52.592932 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1055/2087] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:52 2022] PUT /identity/v3/projects/65515d87a42a4d939b26cb53cdbd808b/users/78a1ae57bb2840efb7007b64b0024469/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:52.604423 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8da227-927d-4d5c-8314-ee4c2af58c34 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:52.604780 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8da227-927d-4d5c-8314-ee4c2af58c34 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:52.605124 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8da227-927d-4d5c-8314-ee4c2af58c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:52.634838 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-7c8da227-927d-4d5c-8314-ee4c2af58c34 None None] MFA Rules not processed for user `78a1ae57bb2840efb7007b64b0024469`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:52.636105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7c8da227-927d-4d5c-8314-ee4c2af58c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:52.709562 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1033/2088] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:52.711010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39de23e-d631-465e-9b6d-bd944c82bf59 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:52.778382 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39de23e-d631-465e-9b6d-bd944c82bf59 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:52.782942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c3118-0189-4fa6-af28-c9ceaccdb161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:52.783622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c3118-0189-4fa6-af28-c9ceaccdb161 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:52.783907 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c3118-0189-4fa6-af28-c9ceaccdb161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:52.784180 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c3118-0189-4fa6-af28-c9ceaccdb161 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:52.784856 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c3118-0189-4fa6-af28-c9ceaccdb161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:52.787024 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c3118-0189-4fa6-af28-c9ceaccdb161 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:52.928968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1056/2089] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:46:52 2022] POST /identity/v3/projects => generated 375 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:52.934386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8da227-927d-4d5c-8314-ee4c2af58c34 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:52.959676 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8da227-927d-4d5c-8314-ee4c2af58c34 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:53.035328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589d7ed-0908-46be-811b-9a34fd48aca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:53.036784 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589d7ed-0908-46be-811b-9a34fd48aca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:53.037265 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589d7ed-0908-46be-811b-9a34fd48aca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:53.037547 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589d7ed-0908-46be-811b-9a34fd48aca2 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:53.038255 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589d7ed-0908-46be-811b-9a34fd48aca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:53.040336 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589d7ed-0908-46be-811b-9a34fd48aca2 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:53.155309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1034/2090] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:46:52 2022] POST /identity/v3/users => generated 294 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:46:53.158389 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c3118-0189-4fa6-af28-c9ceaccdb161 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:53.170213 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c3118-0189-4fa6-af28-c9ceaccdb161 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:53.174960 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c8754-74dd-41c8-8930-87e85681b5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:53.175621 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c8754-74dd-41c8-8930-87e85681b5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:53.175904 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c8754-74dd-41c8-8930-87e85681b5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:53.176260 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c8754-74dd-41c8-8930-87e85681b5e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:53.177107 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c8754-74dd-41c8-8930-87e85681b5e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:53.178724 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c8754-74dd-41c8-8930-87e85681b5e7 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:53.189837 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1057/2091] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:53.194718 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589d7ed-0908-46be-811b-9a34fd48aca2 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:53.205205 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589d7ed-0908-46be-811b-9a34fd48aca2 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:53.211381 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169d360-862a-417a-8be8-2a3cfcc71c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:53.212072 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169d360-862a-417a-8be8-2a3cfcc71c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:53.212456 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169d360-862a-417a-8be8-2a3cfcc71c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:53.212644 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169d360-862a-417a-8be8-2a3cfcc71c56 admin admin] PATH_INFO: `/v3/projects/b4837011139e474eb07ea4219f3a1692/users/8ed61e5f5bf140a890f992aaf132664e/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:53.230853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169d360-862a-417a-8be8-2a3cfcc71c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4837011139e474eb07ea4219f3a1692, user_id=8ed61e5f5bf140a890f992aaf132664e, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:53.243023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169d360-862a-417a-8be8-2a3cfcc71c56 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:53.344025 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1035/2092] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:53 2022] PUT /identity/v3/projects/b4837011139e474eb07ea4219f3a1692/users/8ed61e5f5bf140a890f992aaf132664e/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:53.350415 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c8754-74dd-41c8-8930-87e85681b5e7 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:53.360951 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c8754-74dd-41c8-8930-87e85681b5e7 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:53.409829 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:53.425736 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69400f9b-9ce3-42da-8c9c-a68fc28c97fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:53.426812 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69400f9b-9ce3-42da-8c9c-a68fc28c97fc admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:53.427096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69400f9b-9ce3-42da-8c9c-a68fc28c97fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:53.427398 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69400f9b-9ce3-42da-8c9c-a68fc28c97fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:53.428095 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69400f9b-9ce3-42da-8c9c-a68fc28c97fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:53.429770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69400f9b-9ce3-42da-8c9c-a68fc28c97fc admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:53.441382 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1058/2093] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:53.446352 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169d360-862a-417a-8be8-2a3cfcc71c56 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:53.457213 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169d360-862a-417a-8be8-2a3cfcc71c56 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:53.463064 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c44b45-6013-4d2b-b584-6d1335637b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:53.463807 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c44b45-6013-4d2b-b584-6d1335637b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:53.464087 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c44b45-6013-4d2b-b584-6d1335637b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:53.464366 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c44b45-6013-4d2b-b584-6d1335637b63 admin admin] PATH_INFO: `/v3/projects/b4837011139e474eb07ea4219f3a1692/users/8ed61e5f5bf140a890f992aaf132664e/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:53.466313 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c44b45-6013-4d2b-b584-6d1335637b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4837011139e474eb07ea4219f3a1692, user_id=8ed61e5f5bf140a890f992aaf132664e, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:53.469140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c44b45-6013-4d2b-b584-6d1335637b63 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:53.482299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1036/2094] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:53 2022] PUT /identity/v3/projects/b4837011139e474eb07ea4219f3a1692/users/8ed61e5f5bf140a890f992aaf132664e/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:53.557509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9e722-1ea0-4508-945e-6d12d16d7388 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:53.557874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9e722-1ea0-4508-945e-6d12d16d7388 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:53.558165 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9e722-1ea0-4508-945e-6d12d16d7388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:53.588866 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-2ed9e722-1ea0-4508-945e-6d12d16d7388 None None] MFA Rules not processed for user `8ed61e5f5bf140a890f992aaf132664e`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:53.590092 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2ed9e722-1ea0-4508-945e-6d12d16d7388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:53.663765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1059/2095] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:53.675352 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c44b45-6013-4d2b-b584-6d1335637b63 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:53.677586 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-51c44b45-6013-4d2b-b584-6d1335637b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:53.694046 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:53.740438 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c44b45-6013-4d2b-b584-6d1335637b63 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:53.745306 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a6dcd-617e-41c8-a70c-f97dcf702b02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:53.745927 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a6dcd-617e-41c8-a70c-f97dcf702b02 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:53.746211 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a6dcd-617e-41c8-a70c-f97dcf702b02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:53.746536 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a6dcd-617e-41c8-a70c-f97dcf702b02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:53.806184 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a6dcd-617e-41c8-a70c-f97dcf702b02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:53.807761 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a6dcd-617e-41c8-a70c-f97dcf702b02 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:53.817089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1037/2096] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:54.367364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9e722-1ea0-4508-945e-6d12d16d7388 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:54.368980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2ed9e722-1ea0-4508-945e-6d12d16d7388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:54.443853 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9e722-1ea0-4508-945e-6d12d16d7388 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:54.448416 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff404ff-b880-4cad-a657-ba0426552bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:54.449057 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff404ff-b880-4cad-a657-ba0426552bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:54.449340 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff404ff-b880-4cad-a657-ba0426552bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:54.449617 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff404ff-b880-4cad-a657-ba0426552bf1 admin admin] PATH_INFO: `/v3/users/5368240517584626bfe26d257ceb9b61` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:54.450829 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff404ff-b880-4cad-a657-ba0426552bf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5368240517584626bfe26d257ceb9b61)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:54.453603 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff404ff-b880-4cad-a657-ba0426552bf1 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:54.690257 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-aff404ff-b880-4cad-a657-ba0426552bf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5368240517584626bfe26d257ceb9b61'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:54.690976 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-aff404ff-b880-4cad-a657-ba0426552bf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5368240517584626bfe26d257ceb9b61'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:54.766057 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-aff404ff-b880-4cad-a657-ba0426552bf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5368240517584626bfe26d257ceb9b61'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:54.780128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:54.782148 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-aff404ff-b880-4cad-a657-ba0426552bf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5368240517584626bfe26d257ceb9b61'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:54.790656 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-aff404ff-b880-4cad-a657-ba0426552bf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5368240517584626bfe26d257ceb9b61'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:54.798357 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1060/2097] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:54 2022] DELETE /identity/v3/users/5368240517584626bfe26d257ceb9b61 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:54.803408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b782af4-e5e8-493d-be02-14575ad96c3a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:54.803978 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b782af4-e5e8-493d-be02-14575ad96c3a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:54.804073 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b782af4-e5e8-493d-be02-14575ad96c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:54.824284 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-1b782af4-e5e8-493d-be02-14575ad96c3a None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:54.825518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1b782af4-e5e8-493d-be02-14575ad96c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:54.901163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1038/2098] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:46:54.910927 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff404ff-b880-4cad-a657-ba0426552bf1 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:54.912401 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-aff404ff-b880-4cad-a657-ba0426552bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:54.971001 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff404ff-b880-4cad-a657-ba0426552bf1 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:54.975307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f75d6e-2e25-49ec-9f69-49795cedf15d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:54.975585 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f75d6e-2e25-49ec-9f69-49795cedf15d service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:54.976176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f75d6e-2e25-49ec-9f69-49795cedf15d service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:54.976628 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f75d6e-2e25-49ec-9f69-49795cedf15d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:54.987847 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f75d6e-2e25-49ec-9f69-49795cedf15d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:54.989922 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f75d6e-2e25-49ec-9f69-49795cedf15d service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:54.999793 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1061/2099] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:55.508833 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b782af4-e5e8-493d-be02-14575ad96c3a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:55.510356 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1b782af4-e5e8-493d-be02-14575ad96c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:55.524845 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b782af4-e5e8-493d-be02-14575ad96c3a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:55.530776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffb9d5-bfe6-49c0-a44c-c0e8078857ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:55.531804 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffb9d5-bfe6-49c0-a44c-c0e8078857ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:55.532091 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffb9d5-bfe6-49c0-a44c-c0e8078857ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:55.532369 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffb9d5-bfe6-49c0-a44c-c0e8078857ca admin admin] PATH_INFO: `/v3/projects/b8608020e66a45f8b345851ab5915482` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:55.533622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fffb9d5-bfe6-49c0-a44c-c0e8078857ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8608020e66a45f8b345851ab5915482)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:55.536376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fffb9d5-bfe6-49c0-a44c-c0e8078857ca admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:55.691530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2fffb9d5-bfe6-49c0-a44c-c0e8078857ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8608020e66a45f8b345851ab5915482', 'request_id': 'req-2fffb9d5-bfe6-49c0-a44c-c0e8078857ca'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:55.699138 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2fffb9d5-bfe6-49c0-a44c-c0e8078857ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8608020e66a45f8b345851ab5915482', 'request_id': 'req-2fffb9d5-bfe6-49c0-a44c-c0e8078857ca'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:55.704011 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:55.741195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f75d6e-2e25-49ec-9f69-49795cedf15d service neutron] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:55.748675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c5f75d6e-2e25-49ec-9f69-49795cedf15d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:55.757698 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f75d6e-2e25-49ec-9f69-49795cedf15d service neutron] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:55.850734 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691e6bf-17fa-4e6f-807e-c515fa56dd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:55.851490 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691e6bf-17fa-4e6f-807e-c515fa56dd26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:55.851846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691e6bf-17fa-4e6f-807e-c515fa56dd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:55.852199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691e6bf-17fa-4e6f-807e-c515fa56dd26 admin admin] PATH_INFO: `/v3/users/c420caff33cb43a89e8c1fa3a68de061` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:55.853861 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691e6bf-17fa-4e6f-807e-c515fa56dd26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c420caff33cb43a89e8c1fa3a68de061)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:55.856240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691e6bf-17fa-4e6f-807e-c515fa56dd26 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:55.919564 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2fffb9d5-bfe6-49c0-a44c-c0e8078857ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8608020e66a45f8b345851ab5915482', 'request_id': 'req-2fffb9d5-bfe6-49c0-a44c-c0e8078857ca'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:55.931938 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2fffb9d5-bfe6-49c0-a44c-c0e8078857ca admin admin] The token cache is being invalidate because project b8608020e66a45f8b345851ab5915482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:55.932235 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2fffb9d5-bfe6-49c0-a44c-c0e8078857ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:55.932940 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2fffb9d5-bfe6-49c0-a44c-c0e8078857ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:55.934505 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1039/2100] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:55 2022] DELETE /identity/v3/projects/b8608020e66a45f8b345851ab5915482 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:55.938412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffb9d5-bfe6-49c0-a44c-c0e8078857ca admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:55.939812 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2fffb9d5-bfe6-49c0-a44c-c0e8078857ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:55.953596 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffb9d5-bfe6-49c0-a44c-c0e8078857ca admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:55.961931 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978decad-7b36-4b12-8684-fa0471a928f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:55.962593 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978decad-7b36-4b12-8684-fa0471a928f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:55.962906 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978decad-7b36-4b12-8684-fa0471a928f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:55.963189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978decad-7b36-4b12-8684-fa0471a928f7 admin admin] PATH_INFO: `/v3/users/eb12b0544c274ada9a70cd25be402949` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:55.964844 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978decad-7b36-4b12-8684-fa0471a928f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb12b0544c274ada9a70cd25be402949)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:55.966768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978decad-7b36-4b12-8684-fa0471a928f7 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:56.169993 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0691e6bf-17fa-4e6f-807e-c515fa56dd26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c420caff33cb43a89e8c1fa3a68de061'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:56.170706 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0691e6bf-17fa-4e6f-807e-c515fa56dd26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c420caff33cb43a89e8c1fa3a68de061'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:56.236358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-978decad-7b36-4b12-8684-fa0471a928f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb12b0544c274ada9a70cd25be402949'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:56.237451 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-978decad-7b36-4b12-8684-fa0471a928f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb12b0544c274ada9a70cd25be402949'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:56.301752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0691e6bf-17fa-4e6f-807e-c515fa56dd26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c420caff33cb43a89e8c1fa3a68de061'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:56.317801 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0691e6bf-17fa-4e6f-807e-c515fa56dd26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c420caff33cb43a89e8c1fa3a68de061'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:56.325166 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0691e6bf-17fa-4e6f-807e-c515fa56dd26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c420caff33cb43a89e8c1fa3a68de061'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:56.331692 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1062/2101] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:55 2022] DELETE /identity/v3/users/c420caff33cb43a89e8c1fa3a68de061 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:56.337127 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d8d5a-f023-4181-bfda-5fba2515cc1b None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:56.337399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d8d5a-f023-4181-bfda-5fba2515cc1b None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:56.337682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d8d5a-f023-4181-bfda-5fba2515cc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:56.354956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:56.364299 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-5b5d8d5a-f023-4181-bfda-5fba2515cc1b None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:56.365787 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5b5d8d5a-f023-4181-bfda-5fba2515cc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:56.431247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1063/2102] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:46:56.441061 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d8d5a-f023-4181-bfda-5fba2515cc1b None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:56.443066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5b5d8d5a-f023-4181-bfda-5fba2515cc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:56.468604 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-978decad-7b36-4b12-8684-fa0471a928f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb12b0544c274ada9a70cd25be402949'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:56.491756 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-978decad-7b36-4b12-8684-fa0471a928f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb12b0544c274ada9a70cd25be402949'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:56.492514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-978decad-7b36-4b12-8684-fa0471a928f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb12b0544c274ada9a70cd25be402949'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:56.510082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1040/2103] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:55 2022] DELETE /identity/v3/users/eb12b0544c274ada9a70cd25be402949 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:56.522027 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d8d5a-f023-4181-bfda-5fba2515cc1b None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:56.583587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86af67-0a7c-4635-a96b-080750de8fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:56.584449 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86af67-0a7c-4635-a96b-080750de8fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:56.585148 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86af67-0a7c-4635-a96b-080750de8fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:56.585576 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86af67-0a7c-4635-a96b-080750de8fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:56.588820 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ec86af67-0a7c-4635-a96b-080750de8fc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:56.659966 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86af67-0a7c-4635-a96b-080750de8fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:56.661540 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86af67-0a7c-4635-a96b-080750de8fc5 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:56.671172 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1064/2104] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:46:57.058485 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978decad-7b36-4b12-8684-fa0471a928f7 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:57.060476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-978decad-7b36-4b12-8684-fa0471a928f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:57.077673 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978decad-7b36-4b12-8684-fa0471a928f7 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:57.086365 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ba4d1-15e8-4e4d-9f8b-9f43a7a859a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:57.088313 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ba4d1-15e8-4e4d-9f8b-9f43a7a859a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:57.088313 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ba4d1-15e8-4e4d-9f8b-9f43a7a859a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:57.088313 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ba4d1-15e8-4e4d-9f8b-9f43a7a859a8 admin admin] PATH_INFO: `/v3/projects/aa7316fc98854a19b03f6bd8c7bd66b2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:57.089690 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ba4d1-15e8-4e4d-9f8b-9f43a7a859a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa7316fc98854a19b03f6bd8c7bd66b2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:57.095293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ba4d1-15e8-4e4d-9f8b-9f43a7a859a8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:57.268182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86af67-0a7c-4635-a96b-080750de8fc5 service neutron] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:57.269616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ec86af67-0a7c-4635-a96b-080750de8fc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:57.287155 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86af67-0a7c-4635-a96b-080750de8fc5 service neutron] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:57.303841 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be7359-223d-4945-bdf8-da36dca308bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:57.304505 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be7359-223d-4945-bdf8-da36dca308bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:57.304786 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be7359-223d-4945-bdf8-da36dca308bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:57.305060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be7359-223d-4945-bdf8-da36dca308bb admin admin] PATH_INFO: `/v3/projects/01242181c94347f2b4d520a07ae4e962` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:57.312530 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be7359-223d-4945-bdf8-da36dca308bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=01242181c94347f2b4d520a07ae4e962)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:57.312530 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be7359-223d-4945-bdf8-da36dca308bb admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:57.320786 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-554ba4d1-15e8-4e4d-9f8b-9f43a7a859a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa7316fc98854a19b03f6bd8c7bd66b2', 'request_id': 'req-554ba4d1-15e8-4e4d-9f8b-9f43a7a859a8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:57.330926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-554ba4d1-15e8-4e4d-9f8b-9f43a7a859a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa7316fc98854a19b03f6bd8c7bd66b2', 'request_id': 'req-554ba4d1-15e8-4e4d-9f8b-9f43a7a859a8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:57.412763 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-554ba4d1-15e8-4e4d-9f8b-9f43a7a859a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa7316fc98854a19b03f6bd8c7bd66b2', 'request_id': 'req-554ba4d1-15e8-4e4d-9f8b-9f43a7a859a8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:57.428700 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-554ba4d1-15e8-4e4d-9f8b-9f43a7a859a8 admin admin] The token cache is being invalidate because project aa7316fc98854a19b03f6bd8c7bd66b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:57.430512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-554ba4d1-15e8-4e4d-9f8b-9f43a7a859a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:57.430512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-554ba4d1-15e8-4e4d-9f8b-9f43a7a859a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:57.434873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1041/2105] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:57 2022] DELETE /identity/v3/projects/aa7316fc98854a19b03f6bd8c7bd66b2 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:57.434873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ba4d1-15e8-4e4d-9f8b-9f43a7a859a8 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:57.435989 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-554ba4d1-15e8-4e4d-9f8b-9f43a7a859a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:57.445394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-06be7359-223d-4945-bdf8-da36dca308bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01242181c94347f2b4d520a07ae4e962', 'request_id': 'req-06be7359-223d-4945-bdf8-da36dca308bb'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:57.451143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-06be7359-223d-4945-bdf8-da36dca308bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01242181c94347f2b4d520a07ae4e962', 'request_id': 'req-06be7359-223d-4945-bdf8-da36dca308bb'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:57.484826 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:57.503521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ba4d1-15e8-4e4d-9f8b-9f43a7a859a8 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:57.531462 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-06be7359-223d-4945-bdf8-da36dca308bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01242181c94347f2b4d520a07ae4e962', 'request_id': 'req-06be7359-223d-4945-bdf8-da36dca308bb'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:57.545074 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-06be7359-223d-4945-bdf8-da36dca308bb admin admin] The token cache is being invalidate because project 01242181c94347f2b4d520a07ae4e962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:57.545425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-06be7359-223d-4945-bdf8-da36dca308bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:57.546115 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-06be7359-223d-4945-bdf8-da36dca308bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:57.547955 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1065/2106] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:57 2022] DELETE /identity/v3/projects/01242181c94347f2b4d520a07ae4e962 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:57.548982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc56c0-a7bb-4040-85a5-13dd9ade496c None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:57.549271 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc56c0-a7bb-4040-85a5-13dd9ade496c None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:57.549549 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc56c0-a7bb-4040-85a5-13dd9ade496c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:57.569873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35141545-372c-43c7-aba0-046f268e082b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:57.570534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35141545-372c-43c7-aba0-046f268e082b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:57.570826 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35141545-372c-43c7-aba0-046f268e082b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:57.571233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35141545-372c-43c7-aba0-046f268e082b admin admin] PATH_INFO: `/v3/users/78a1ae57bb2840efb7007b64b0024469` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:57.580936 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-3afc56c0-a7bb-4040-85a5-13dd9ade496c None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:57.581103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35141545-372c-43c7-aba0-046f268e082b admin admin] RBAC: Authorizing `identity:delete_user(user_id=78a1ae57bb2840efb7007b64b0024469)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:57.581198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-3afc56c0-a7bb-4040-85a5-13dd9ade496c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:57.581287 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35141545-372c-43c7-aba0-046f268e082b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:57.581417 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1066/2107] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:57.582213 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc56c0-a7bb-4040-85a5-13dd9ade496c None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:57.583495 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-3afc56c0-a7bb-4040-85a5-13dd9ade496c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:57.595297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc56c0-a7bb-4040-85a5-13dd9ade496c None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:57.600962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a57fd-a81a-4556-92c3-e2b7a1ea7276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:57.601613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a57fd-a81a-4556-92c3-e2b7a1ea7276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:57.601897 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a57fd-a81a-4556-92c3-e2b7a1ea7276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:57.602173 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a57fd-a81a-4556-92c3-e2b7a1ea7276 admin admin] PATH_INFO: `/v3/users/f94f54650ddc4ea187af827199b67e64` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:57.603381 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a57fd-a81a-4556-92c3-e2b7a1ea7276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f94f54650ddc4ea187af827199b67e64)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:57.605341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a57fd-a81a-4556-92c3-e2b7a1ea7276 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:57.631978 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:57.765590 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-35141545-372c-43c7-aba0-046f268e082b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78a1ae57bb2840efb7007b64b0024469'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:57.766283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-35141545-372c-43c7-aba0-046f268e082b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78a1ae57bb2840efb7007b64b0024469'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:57.857127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-35141545-372c-43c7-aba0-046f268e082b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78a1ae57bb2840efb7007b64b0024469'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:57.861368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c04a57fd-a81a-4556-92c3-e2b7a1ea7276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f94f54650ddc4ea187af827199b67e64'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:57.862024 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c04a57fd-a81a-4556-92c3-e2b7a1ea7276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f94f54650ddc4ea187af827199b67e64'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:57.870299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-35141545-372c-43c7-aba0-046f268e082b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78a1ae57bb2840efb7007b64b0024469'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:57.871016 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-35141545-372c-43c7-aba0-046f268e082b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78a1ae57bb2840efb7007b64b0024469'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:57.883754 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1042/2108] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:57 2022] DELETE /identity/v3/users/78a1ae57bb2840efb7007b64b0024469 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:57.885000 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877975bd-a5e9-42e7-9829-189a1fc97cd4 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:57.885290 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877975bd-a5e9-42e7-9829-189a1fc97cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:57.890445 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877975bd-a5e9-42e7-9829-189a1fc97cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:57.906499 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-877975bd-a5e9-42e7-9829-189a1fc97cd4 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:57.907762 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-877975bd-a5e9-42e7-9829-189a1fc97cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:57.966843 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1043/2109] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:57.969210 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645918f-def0-4a47-9d6b-c1a147a67c21 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:57.969840 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645918f-def0-4a47-9d6b-c1a147a67c21 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:57.970379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645918f-def0-4a47-9d6b-c1a147a67c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:57.972670 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c04a57fd-a81a-4556-92c3-e2b7a1ea7276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f94f54650ddc4ea187af827199b67e64'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:57.987125 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c04a57fd-a81a-4556-92c3-e2b7a1ea7276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f94f54650ddc4ea187af827199b67e64'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:57.992349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a645918f-def0-4a47-9d6b-c1a147a67c21 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:57.993726 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a645918f-def0-4a47-9d6b-c1a147a67c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:57.994877 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c04a57fd-a81a-4556-92c3-e2b7a1ea7276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f94f54650ddc4ea187af827199b67e64'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:58.002376 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1067/2110] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:57 2022] DELETE /identity/v3/users/f94f54650ddc4ea187af827199b67e64 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:58.005945 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1044/2111] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:58.006502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a57fd-a81a-4556-92c3-e2b7a1ea7276 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:58.008452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c04a57fd-a81a-4556-92c3-e2b7a1ea7276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:58.022160 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645918f-def0-4a47-9d6b-c1a147a67c21 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:58.023597 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a645918f-def0-4a47-9d6b-c1a147a67c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:58.108311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645918f-def0-4a47-9d6b-c1a147a67c21 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:58.121776 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a57fd-a81a-4556-92c3-e2b7a1ea7276 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:58.128642 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12552b4-2508-4ded-a308-1af861b2995e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:58.130213 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12552b4-2508-4ded-a308-1af861b2995e admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:58.131794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12552b4-2508-4ded-a308-1af861b2995e admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:58.132597 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12552b4-2508-4ded-a308-1af861b2995e admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:58.133938 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12552b4-2508-4ded-a308-1af861b2995e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:46:58.134416 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12552b4-2508-4ded-a308-1af861b2995e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:58.142374 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12552b4-2508-4ded-a308-1af861b2995e admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:58.152814 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1068/2112] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:46:58.158026 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12552b4-2508-4ded-a308-1af861b2995e admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:58.171306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12552b4-2508-4ded-a308-1af861b2995e admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:58.178824 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86eff5b-6e68-4e27-b016-948da3a8f089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:58.179081 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f1835-a51f-4dc9-84e4-25000188e32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:58.179673 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86eff5b-6e68-4e27-b016-948da3a8f089 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:58.179784 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f1835-a51f-4dc9-84e4-25000188e32c admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:58.180114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f1835-a51f-4dc9-84e4-25000188e32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:58.180217 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86eff5b-6e68-4e27-b016-948da3a8f089 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:58.180398 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f1835-a51f-4dc9-84e4-25000188e32c admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:58.180543 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86eff5b-6e68-4e27-b016-948da3a8f089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:58.181474 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f1835-a51f-4dc9-84e4-25000188e32c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:58.183485 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f1835-a51f-4dc9-84e4-25000188e32c admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:58.193028 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86eff5b-6e68-4e27-b016-948da3a8f089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:58.194645 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86eff5b-6e68-4e27-b016-948da3a8f089 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:58.225852 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1045/2113] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:46:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:46:58.238485 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:58.271192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1069/2114] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:46:58 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:58.275683 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86eff5b-6e68-4e27-b016-948da3a8f089 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:58.288928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86eff5b-6e68-4e27-b016-948da3a8f089 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:58.403385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3bcc0-52b6-4aa3-a60b-8301732c73b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:58.404541 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3bcc0-52b6-4aa3-a60b-8301732c73b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:58.404986 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3bcc0-52b6-4aa3-a60b-8301732c73b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:58.405507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3bcc0-52b6-4aa3-a60b-8301732c73b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:58.406545 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3bcc0-52b6-4aa3-a60b-8301732c73b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:58.408938 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3bcc0-52b6-4aa3-a60b-8301732c73b5 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:58.503111 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1046/2115] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:46:58 2022] POST /identity/v3/users => generated 285 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:58.507486 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f1835-a51f-4dc9-84e4-25000188e32c admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:58.521105 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f1835-a51f-4dc9-84e4-25000188e32c admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:58.526102 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13626d7d-9f73-4b6e-b850-1fcef89eb598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:58.526763 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13626d7d-9f73-4b6e-b850-1fcef89eb598 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:58.527187 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13626d7d-9f73-4b6e-b850-1fcef89eb598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:58.527536 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13626d7d-9f73-4b6e-b850-1fcef89eb598 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:58.528308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13626d7d-9f73-4b6e-b850-1fcef89eb598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:58.530018 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13626d7d-9f73-4b6e-b850-1fcef89eb598 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:58.541665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1070/2116] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:58.545827 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3bcc0-52b6-4aa3-a60b-8301732c73b5 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:58.558335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3bcc0-52b6-4aa3-a60b-8301732c73b5 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:58.563692 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c164427-b31d-40cc-80d1-f0c4f8c91245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:58.564323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c164427-b31d-40cc-80d1-f0c4f8c91245 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:58.564602 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c164427-b31d-40cc-80d1-f0c4f8c91245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:58.564876 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c164427-b31d-40cc-80d1-f0c4f8c91245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:58.565577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c164427-b31d-40cc-80d1-f0c4f8c91245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:58.567290 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c164427-b31d-40cc-80d1-f0c4f8c91245 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:58.578438 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1047/2117] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:58.585873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13626d7d-9f73-4b6e-b850-1fcef89eb598 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:58.589253 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c164427-b31d-40cc-80d1-f0c4f8c91245 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:58.593716 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4c164427-b31d-40cc-80d1-f0c4f8c91245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:58.597115 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13626d7d-9f73-4b6e-b850-1fcef89eb598 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:58.602920 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99640e07-1172-4f90-9e5b-864e6dfd4ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:58.603652 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99640e07-1172-4f90-9e5b-864e6dfd4ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:58.603951 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99640e07-1172-4f90-9e5b-864e6dfd4ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:58.604221 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99640e07-1172-4f90-9e5b-864e6dfd4ca8 admin admin] PATH_INFO: `/v3/projects/25c1a2ebe6d741089d59b5c265e079b4/users/75844b5637e2485fab4a4749246517b0/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:58.617168 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c164427-b31d-40cc-80d1-f0c4f8c91245 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:58.623356 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99640e07-1172-4f90-9e5b-864e6dfd4ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25c1a2ebe6d741089d59b5c265e079b4, user_id=75844b5637e2485fab4a4749246517b0, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:58.626216 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99640e07-1172-4f90-9e5b-864e6dfd4ca8 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:58.628935 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f0164-a1b8-405e-a487-758bba4e85ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:58.629953 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f0164-a1b8-405e-a487-758bba4e85ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:58.632295 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f0164-a1b8-405e-a487-758bba4e85ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:58.632680 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f0164-a1b8-405e-a487-758bba4e85ac admin admin] PATH_INFO: `/v3/projects/515c0ffbca834ad9a1417f7c41ad7600` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:58.639124 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f0164-a1b8-405e-a487-758bba4e85ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=515c0ffbca834ad9a1417f7c41ad7600)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:58.641194 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f0164-a1b8-405e-a487-758bba4e85ac admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:58.759770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1071/2118] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:58 2022] PUT /identity/v3/projects/25c1a2ebe6d741089d59b5c265e079b4/users/75844b5637e2485fab4a4749246517b0/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:58.772171 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9272b-079e-4191-a7d5-f40e2fa1be2b None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:58.772463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9272b-079e-4191-a7d5-f40e2fa1be2b None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:58.772781 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9272b-079e-4191-a7d5-f40e2fa1be2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:58.802799 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-a3b9272b-079e-4191-a7d5-f40e2fa1be2b None None] MFA Rules not processed for user `75844b5637e2485fab4a4749246517b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:58.804066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a3b9272b-079e-4191-a7d5-f40e2fa1be2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:58.832062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-851f0164-a1b8-405e-a487-758bba4e85ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '515c0ffbca834ad9a1417f7c41ad7600', 'request_id': 'req-851f0164-a1b8-405e-a487-758bba4e85ac'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:58.838697 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-851f0164-a1b8-405e-a487-758bba4e85ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '515c0ffbca834ad9a1417f7c41ad7600', 'request_id': 'req-851f0164-a1b8-405e-a487-758bba4e85ac'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:58.871361 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1072/2119] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:46:58.875794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9272b-079e-4191-a7d5-f40e2fa1be2b None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:58.920003 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-851f0164-a1b8-405e-a487-758bba4e85ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '515c0ffbca834ad9a1417f7c41ad7600', 'request_id': 'req-851f0164-a1b8-405e-a487-758bba4e85ac'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:58.934562 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-851f0164-a1b8-405e-a487-758bba4e85ac admin admin] The token cache is being invalidate because project 515c0ffbca834ad9a1417f7c41ad7600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:58.934854 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-851f0164-a1b8-405e-a487-758bba4e85ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:58.935649 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-851f0164-a1b8-405e-a487-758bba4e85ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:58.937569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1048/2120] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:58 2022] DELETE /identity/v3/projects/515c0ffbca834ad9a1417f7c41ad7600 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:58.938419 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f0164-a1b8-405e-a487-758bba4e85ac admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:58.939481 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-851f0164-a1b8-405e-a487-758bba4e85ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:58.942836 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9272b-079e-4191-a7d5-f40e2fa1be2b None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:59.001706 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba6a8e-8897-4096-8f97-4402fa9cdd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:59.002387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba6a8e-8897-4096-8f97-4402fa9cdd1c admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:59.002743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba6a8e-8897-4096-8f97-4402fa9cdd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:59.003024 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba6a8e-8897-4096-8f97-4402fa9cdd1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:59.003757 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba6a8e-8897-4096-8f97-4402fa9cdd1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:59.005778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba6a8e-8897-4096-8f97-4402fa9cdd1c admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:59.016756 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f0164-a1b8-405e-a487-758bba4e85ac admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:59.022308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4abef-8426-4880-b517-5909a5bcfc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:59.022953 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4abef-8426-4880-b517-5909a5bcfc11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:59.023232 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4abef-8426-4880-b517-5909a5bcfc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:59.023555 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4abef-8426-4880-b517-5909a5bcfc11 admin admin] PATH_INFO: `/v3/projects/65515d87a42a4d939b26cb53cdbd808b` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:59.024762 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4abef-8426-4880-b517-5909a5bcfc11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65515d87a42a4d939b26cb53cdbd808b)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:59.026733 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4abef-8426-4880-b517-5909a5bcfc11 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:59.054809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:59.122520 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1073/2121] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:46:58 2022] POST /identity/v3/projects => generated 369 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:46:59.123972 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270da569-54bd-4f77-a51b-f55fbe5c8a06 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:59.124257 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270da569-54bd-4f77-a51b-f55fbe5c8a06 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:59.124538 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270da569-54bd-4f77-a51b-f55fbe5c8a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:59.144354 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-270da569-54bd-4f77-a51b-f55fbe5c8a06 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:59.145915 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-270da569-54bd-4f77-a51b-f55fbe5c8a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:59.170418 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d9a4abef-8426-4880-b517-5909a5bcfc11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65515d87a42a4d939b26cb53cdbd808b', 'request_id': 'req-d9a4abef-8426-4880-b517-5909a5bcfc11'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:59.178031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d9a4abef-8426-4880-b517-5909a5bcfc11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65515d87a42a4d939b26cb53cdbd808b', 'request_id': 'req-d9a4abef-8426-4880-b517-5909a5bcfc11'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:59.210707 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1074/2122] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:59.211562 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270da569-54bd-4f77-a51b-f55fbe5c8a06 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:59.212832 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-270da569-54bd-4f77-a51b-f55fbe5c8a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:59.225420 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270da569-54bd-4f77-a51b-f55fbe5c8a06 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:59.266385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d9a4abef-8426-4880-b517-5909a5bcfc11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65515d87a42a4d939b26cb53cdbd808b', 'request_id': 'req-d9a4abef-8426-4880-b517-5909a5bcfc11'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:59.278198 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d9a4abef-8426-4880-b517-5909a5bcfc11 admin admin] The token cache is being invalidate because project 65515d87a42a4d939b26cb53cdbd808b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:46:59.278492 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d9a4abef-8426-4880-b517-5909a5bcfc11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:59.279152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d9a4abef-8426-4880-b517-5909a5bcfc11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:59.280795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1049/2123] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:46:58 2022] DELETE /identity/v3/projects/65515d87a42a4d939b26cb53cdbd808b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:59.281208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397c0ae-944b-4c20-b742-b278ea33f6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:59.281997 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397c0ae-944b-4c20-b742-b278ea33f6a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:59.282284 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397c0ae-944b-4c20-b742-b278ea33f6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:59.282559 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397c0ae-944b-4c20-b742-b278ea33f6a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:59.283221 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397c0ae-944b-4c20-b742-b278ea33f6a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:59.285159 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384db4a8-2849-4d82-b196-990be819f32f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:59.285336 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397c0ae-944b-4c20-b742-b278ea33f6a3 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:59.286555 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384db4a8-2849-4d82-b196-990be819f32f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:59.287071 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384db4a8-2849-4d82-b196-990be819f32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:59.307736 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-384db4a8-2849-4d82-b196-990be819f32f None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:46:59.308960 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-384db4a8-2849-4d82-b196-990be819f32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:59.316878 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1050/2124] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:46:59.318375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384db4a8-2849-4d82-b196-990be819f32f None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:59.319740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-384db4a8-2849-4d82-b196-990be819f32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:59.325595 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:59.331307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384db4a8-2849-4d82-b196-990be819f32f None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:59.336685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ca7d3-f53d-4bbd-b7a2-058bce33785a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:59.337308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ca7d3-f53d-4bbd-b7a2-058bce33785a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:59.337591 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ca7d3-f53d-4bbd-b7a2-058bce33785a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:59.337867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ca7d3-f53d-4bbd-b7a2-058bce33785a admin admin] PATH_INFO: `/v3/users/8ed61e5f5bf140a890f992aaf132664e` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:59.339015 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ca7d3-f53d-4bbd-b7a2-058bce33785a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed61e5f5bf140a890f992aaf132664e)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:59.341007 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ca7d3-f53d-4bbd-b7a2-058bce33785a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:59.355457 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1075/2125] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:46:59 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:59.356390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397c0ae-944b-4c20-b742-b278ea33f6a3 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:59.439897 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397c0ae-944b-4c20-b742-b278ea33f6a3 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:59.439897 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954e2a6-d5d3-4757-9a43-002f1f8e25ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:59.439897 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954e2a6-d5d3-4757-9a43-002f1f8e25ca admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:59.439897 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954e2a6-d5d3-4757-9a43-002f1f8e25ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:59.441051 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954e2a6-d5d3-4757-9a43-002f1f8e25ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:59.441051 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954e2a6-d5d3-4757-9a43-002f1f8e25ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:46:59.441051 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954e2a6-d5d3-4757-9a43-002f1f8e25ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:59.441051 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954e2a6-d5d3-4757-9a43-002f1f8e25ca admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:59.441051 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1076/2126] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:46:59.441051 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954e2a6-d5d3-4757-9a43-002f1f8e25ca admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:59.442154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-6954e2a6-d5d3-4757-9a43-002f1f8e25ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:59.460261 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954e2a6-d5d3-4757-9a43-002f1f8e25ca admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:59.466046 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7a2dd-e938-4476-974e-1edf30409f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:59.466802 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7a2dd-e938-4476-974e-1edf30409f9d admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:59.467335 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7a2dd-e938-4476-974e-1edf30409f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:59.467685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7a2dd-e938-4476-974e-1edf30409f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:59.468565 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7a2dd-e938-4476-974e-1edf30409f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:59.470611 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7a2dd-e938-4476-974e-1edf30409f9d admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:59.483921 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1077/2127] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:46:59.484670 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7a2dd-e938-4476-974e-1edf30409f9d admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:59.495702 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7a2dd-e938-4476-974e-1edf30409f9d admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:59.509470 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e8dbc-e2f7-4fc0-a92d-0d77b2d9ed5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:59.509470 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e8dbc-e2f7-4fc0-a92d-0d77b2d9ed5b admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:59.509470 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e8dbc-e2f7-4fc0-a92d-0d77b2d9ed5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:59.509470 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e8dbc-e2f7-4fc0-a92d-0d77b2d9ed5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:59.510200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e8dbc-e2f7-4fc0-a92d-0d77b2d9ed5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:59.510200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e8dbc-e2f7-4fc0-a92d-0d77b2d9ed5b admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:59.666321 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1078/2128] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:46:59 2022] POST /identity/v3/projects => generated 367 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:46:59.666321 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e8dbc-e2f7-4fc0-a92d-0d77b2d9ed5b admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:59.726653 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-3d2ca7d3-f53d-4bbd-b7a2-058bce33785a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed61e5f5bf140a890f992aaf132664e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:59.727379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-3d2ca7d3-f53d-4bbd-b7a2-058bce33785a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed61e5f5bf140a890f992aaf132664e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:59.728506 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e8dbc-e2f7-4fc0-a92d-0d77b2d9ed5b admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:59.733669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98b191-db4c-4699-ad40-510058a10e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:59.734341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98b191-db4c-4699-ad40-510058a10e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:59.734623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98b191-db4c-4699-ad40-510058a10e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:59.734899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98b191-db4c-4699-ad40-510058a10e3c admin admin] PATH_INFO: `/v3/projects/d30bc313844d46aba07b2685aa00a949/users/3eb3f8a08d054398953309a566cfac28/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:59.751974 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98b191-db4c-4699-ad40-510058a10e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30bc313844d46aba07b2685aa00a949, user_id=3eb3f8a08d054398953309a566cfac28, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:59.755240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98b191-db4c-4699-ad40-510058a10e3c admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:59.810878 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-3d2ca7d3-f53d-4bbd-b7a2-058bce33785a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed61e5f5bf140a890f992aaf132664e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:59.825792 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-3d2ca7d3-f53d-4bbd-b7a2-058bce33785a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed61e5f5bf140a890f992aaf132664e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:59.826928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-3d2ca7d3-f53d-4bbd-b7a2-058bce33785a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed61e5f5bf140a890f992aaf132664e'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:46:59.847138 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1051/2129] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:46:59 2022] DELETE /identity/v3/users/8ed61e5f5bf140a890f992aaf132664e => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:59.847318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1079/2130] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:59 2022] PUT /identity/v3/projects/d30bc313844d46aba07b2685aa00a949/users/3eb3f8a08d054398953309a566cfac28/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:46:59.851073 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98b191-db4c-4699-ad40-510058a10e3c admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:59.851546 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ca7d3-f53d-4bbd-b7a2-058bce33785a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:59.854861 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ca98b191-db4c-4699-ad40-510058a10e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:59.854998 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-3d2ca7d3-f53d-4bbd-b7a2-058bce33785a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:46:59.925234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98b191-db4c-4699-ad40-510058a10e3c admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:59.930397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ca7d3-f53d-4bbd-b7a2-058bce33785a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:59.931010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc767a-c6e7-4281-b8de-42812b4bd2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:59.931709 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc767a-c6e7-4281-b8de-42812b4bd2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:59.932068 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc767a-c6e7-4281-b8de-42812b4bd2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:59.932274 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc767a-c6e7-4281-b8de-42812b4bd2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:59.932982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc767a-c6e7-4281-b8de-42812b4bd2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:59.934611 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc767a-c6e7-4281-b8de-42812b4bd2b9 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:59.935471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f74c6f-0409-4de6-9f74-afb56ee55942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:59.936094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f74c6f-0409-4de6-9f74-afb56ee55942 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:59.936495 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f74c6f-0409-4de6-9f74-afb56ee55942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:59.936774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f74c6f-0409-4de6-9f74-afb56ee55942 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:59.937447 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f74c6f-0409-4de6-9f74-afb56ee55942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:59.939459 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f74c6f-0409-4de6-9f74-afb56ee55942 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:59.946473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1080/2131] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:46:59.950548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc767a-c6e7-4281-b8de-42812b4bd2b9 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:46:59.964137 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc767a-c6e7-4281-b8de-42812b4bd2b9 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:46:59.967207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645804ca-44d8-4bad-b89c-531914fce120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:46:59.967920 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645804ca-44d8-4bad-b89c-531914fce120 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:59.968230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645804ca-44d8-4bad-b89c-531914fce120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:59.968512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645804ca-44d8-4bad-b89c-531914fce120 admin admin] PATH_INFO: `/v3/projects/d30bc313844d46aba07b2685aa00a949/users/3eb3f8a08d054398953309a566cfac28/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:46:59.970493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645804ca-44d8-4bad-b89c-531914fce120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30bc313844d46aba07b2685aa00a949, user_id=3eb3f8a08d054398953309a566cfac28, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:46:59.973329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645804ca-44d8-4bad-b89c-531914fce120 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:46:59.977059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:46:59.983961 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1081/2132] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:46:59 2022] PUT /identity/v3/projects/d30bc313844d46aba07b2685aa00a949/users/3eb3f8a08d054398953309a566cfac28/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:46:59.994126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc3d08-423e-4781-8c85-9ba96f4018a5 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:46:59.994421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc3d08-423e-4781-8c85-9ba96f4018a5 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:46:59.994703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc3d08-423e-4781-8c85-9ba96f4018a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:00.022912 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-abbc3d08-423e-4781-8c85-9ba96f4018a5 None None] MFA Rules not processed for user `3eb3f8a08d054398953309a566cfac28`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:00.024221 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-abbc3d08-423e-4781-8c85-9ba96f4018a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:00.047315 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:00.063253 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1052/2133] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:46:59 2022] POST /identity/v3/users => generated 284 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:47:00.065031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f74c6f-0409-4de6-9f74-afb56ee55942 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:00.106224 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1082/2134] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:46:59 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:47:00.111788 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f74c6f-0409-4de6-9f74-afb56ee55942 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:00.125491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc3d08-423e-4781-8c85-9ba96f4018a5 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:00.127220 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-abbc3d08-423e-4781-8c85-9ba96f4018a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:00.182103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44719ddf-fd4d-4a80-88c2-afb239f556b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:00.182758 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44719ddf-fd4d-4a80-88c2-afb239f556b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:00.183046 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44719ddf-fd4d-4a80-88c2-afb239f556b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:00.183345 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44719ddf-fd4d-4a80-88c2-afb239f556b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:00.184070 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44719ddf-fd4d-4a80-88c2-afb239f556b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:00.185716 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44719ddf-fd4d-4a80-88c2-afb239f556b5 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:00.198105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1053/2135] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:47:00.202596 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44719ddf-fd4d-4a80-88c2-afb239f556b5 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:00.205776 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc3d08-423e-4781-8c85-9ba96f4018a5 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:00.213273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3c871-681b-429b-873c-a835cb83fd48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:00.213927 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3c871-681b-429b-873c-a835cb83fd48 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:00.214355 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3c871-681b-429b-873c-a835cb83fd48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:00.214519 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3c871-681b-429b-873c-a835cb83fd48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:00.215990 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44719ddf-fd4d-4a80-88c2-afb239f556b5 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:00.222731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b60df-5140-4e99-bd1d-c31297bcfc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:00.226653 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b60df-5140-4e99-bd1d-c31297bcfc53 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:00.226653 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b60df-5140-4e99-bd1d-c31297bcfc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:00.226653 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b60df-5140-4e99-bd1d-c31297bcfc53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:00.226653 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b60df-5140-4e99-bd1d-c31297bcfc53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:00.227496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b60df-5140-4e99-bd1d-c31297bcfc53 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:00.229704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3c871-681b-429b-873c-a835cb83fd48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:00.233189 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3c871-681b-429b-873c-a835cb83fd48 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:00.243428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1054/2136] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:47:00.245670 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b60df-5140-4e99-bd1d-c31297bcfc53 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:00.249054 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1083/2137] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:00 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:00.259048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b60df-5140-4e99-bd1d-c31297bcfc53 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:00.263825 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba4db9-ae33-428b-9d33-fd7265557111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:00.264570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba4db9-ae33-428b-9d33-fd7265557111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:00.264841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba4db9-ae33-428b-9d33-fd7265557111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:00.265119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba4db9-ae33-428b-9d33-fd7265557111 admin admin] PATH_INFO: `/v3/projects/2ed1f023d0694512a5dad8f4412c9bc9/users/236cd1c051b440ae9b4e44613de2a17c/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:00.280789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba4db9-ae33-428b-9d33-fd7265557111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed1f023d0694512a5dad8f4412c9bc9, user_id=236cd1c051b440ae9b4e44613de2a17c, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:00.284068 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba4db9-ae33-428b-9d33-fd7265557111 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:00.386471 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3c871-681b-429b-873c-a835cb83fd48 service cinder] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:00.389595 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4dc3c871-681b-429b-873c-a835cb83fd48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:00.390251 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1055/2138] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:47:00 2022] PUT /identity/v3/projects/2ed1f023d0694512a5dad8f4412c9bc9/users/236cd1c051b440ae9b4e44613de2a17c/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:00.402218 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd58e1-5080-4f45-aadd-22f9b4775ce9 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:00.402867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd58e1-5080-4f45-aadd-22f9b4775ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:00.403382 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd58e1-5080-4f45-aadd-22f9b4775ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:00.415992 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3c871-681b-429b-873c-a835cb83fd48 service cinder] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:00.436929 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-8dfd58e1-5080-4f45-aadd-22f9b4775ce9 None None] MFA Rules not processed for user `236cd1c051b440ae9b4e44613de2a17c`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:00.438281 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8dfd58e1-5080-4f45-aadd-22f9b4775ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:00.482095 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d25b5-b01d-4f79-81cc-c4cab54ab9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:00.482664 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d25b5-b01d-4f79-81cc-c4cab54ab9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:00.482949 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d25b5-b01d-4f79-81cc-c4cab54ab9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:00.483230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d25b5-b01d-4f79-81cc-c4cab54ab9e9 admin admin] PATH_INFO: `/v3/projects/b4837011139e474eb07ea4219f3a1692` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:00.484459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d25b5-b01d-4f79-81cc-c4cab54ab9e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4837011139e474eb07ea4219f3a1692)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:00.486422 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d25b5-b01d-4f79-81cc-c4cab54ab9e9 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:00.512482 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1056/2139] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:00.518670 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd58e1-5080-4f45-aadd-22f9b4775ce9 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:00.518670 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8dfd58e1-5080-4f45-aadd-22f9b4775ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:00.577762 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd58e1-5080-4f45-aadd-22f9b4775ce9 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:00.581512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7872c3-717a-4549-a28c-3e6ae3dd741e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:00.582121 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7872c3-717a-4549-a28c-3e6ae3dd741e service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:00.582438 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7872c3-717a-4549-a28c-3e6ae3dd741e service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:00.582718 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7872c3-717a-4549-a28c-3e6ae3dd741e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:00.584687 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cb7872c3-717a-4549-a28c-3e6ae3dd741e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:00.607857 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-103d25b5-b01d-4f79-81cc-c4cab54ab9e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4837011139e474eb07ea4219f3a1692', 'request_id': 'req-103d25b5-b01d-4f79-81cc-c4cab54ab9e9'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:00.614582 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-103d25b5-b01d-4f79-81cc-c4cab54ab9e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4837011139e474eb07ea4219f3a1692', 'request_id': 'req-103d25b5-b01d-4f79-81cc-c4cab54ab9e9'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:00.646358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7872c3-717a-4549-a28c-3e6ae3dd741e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:00.647976 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7872c3-717a-4549-a28c-3e6ae3dd741e service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:00.657775 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1057/2140] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:00 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:00.658211 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7872c3-717a-4549-a28c-3e6ae3dd741e service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:00.669618 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7872c3-717a-4549-a28c-3e6ae3dd741e service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:00.707082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-103d25b5-b01d-4f79-81cc-c4cab54ab9e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4837011139e474eb07ea4219f3a1692', 'request_id': 'req-103d25b5-b01d-4f79-81cc-c4cab54ab9e9'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:00.732475 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-103d25b5-b01d-4f79-81cc-c4cab54ab9e9 admin admin] The token cache is being invalidate because project b4837011139e474eb07ea4219f3a1692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:47:00.732475 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-103d25b5-b01d-4f79-81cc-c4cab54ab9e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:00.732475 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-103d25b5-b01d-4f79-81cc-c4cab54ab9e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:00.732475 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1084/2141] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:47:00 2022] DELETE /identity/v3/projects/b4837011139e474eb07ea4219f3a1692 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:00.737598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bd6e3-dc3a-45cb-88ce-27b048269685 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:00.737598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bd6e3-dc3a-45cb-88ce-27b048269685 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:00.737598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bd6e3-dc3a-45cb-88ce-27b048269685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:00.743407 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a42c35-e785-4f19-8a8e-a9feb205f01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:00.744038 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a42c35-e785-4f19-8a8e-a9feb205f01b admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:00.749480 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a42c35-e785-4f19-8a8e-a9feb205f01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:00.749480 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a42c35-e785-4f19-8a8e-a9feb205f01b admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:00.749480 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a42c35-e785-4f19-8a8e-a9feb205f01b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:00.749480 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a42c35-e785-4f19-8a8e-a9feb205f01b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:00.760019 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-b78bd6e3-dc3a-45cb-88ce-27b048269685 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:00.761234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b78bd6e3-dc3a-45cb-88ce-27b048269685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:00.770331 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1085/2142] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:00.778223 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f2511-af85-4edc-a9d2-d5415573e5e9 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:00.778223 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f2511-af85-4edc-a9d2-d5415573e5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:00.778502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f2511-af85-4edc-a9d2-d5415573e5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:00.798433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-fa8f2511-af85-4edc-a9d2-d5415573e5e9 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:00.799798 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-fa8f2511-af85-4edc-a9d2-d5415573e5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:00.808563 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1086/2143] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:47:00.812810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f2511-af85-4edc-a9d2-d5415573e5e9 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:00.822219 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f2511-af85-4edc-a9d2-d5415573e5e9 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:00.827234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d684fb-85f9-4b81-8794-cdfb400c6c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:00.827877 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d684fb-85f9-4b81-8794-cdfb400c6c59 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:00.828165 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d684fb-85f9-4b81-8794-cdfb400c6c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:00.828473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d684fb-85f9-4b81-8794-cdfb400c6c59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:00.829194 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d684fb-85f9-4b81-8794-cdfb400c6c59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:47:00.829494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d684fb-85f9-4b81-8794-cdfb400c6c59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:00.831109 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d684fb-85f9-4b81-8794-cdfb400c6c59 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:00.834502 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1058/2144] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:47:00 2022] POST /identity/v3/projects => generated 369 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:47:00.838563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a42c35-e785-4f19-8a8e-a9feb205f01b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:00.840342 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-46a42c35-e785-4f19-8a8e-a9feb205f01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:00.844285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1087/2145] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:47:00.849328 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d684fb-85f9-4b81-8794-cdfb400c6c59 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:00.859367 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d684fb-85f9-4b81-8794-cdfb400c6c59 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:00.907320 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a42c35-e785-4f19-8a8e-a9feb205f01b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:00.912576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe289642-d582-49fd-a3a9-38c136191a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:00.913221 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:00.913374 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe289642-d582-49fd-a3a9-38c136191a83 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:00.913529 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe289642-d582-49fd-a3a9-38c136191a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:00.913786 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe289642-d582-49fd-a3a9-38c136191a83 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:00.914463 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe289642-d582-49fd-a3a9-38c136191a83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:00.916932 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe289642-d582-49fd-a3a9-38c136191a83 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:00.925391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d5db0-b16e-4de6-9262-48150145f514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:00.925391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d5db0-b16e-4de6-9262-48150145f514 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:00.925391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d5db0-b16e-4de6-9262-48150145f514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:00.925391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d5db0-b16e-4de6-9262-48150145f514 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:00.925867 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d5db0-b16e-4de6-9262-48150145f514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:00.925867 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d5db0-b16e-4de6-9262-48150145f514 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:01.024801 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1059/2146] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:47:00 2022] POST /identity/v3/users => generated 291 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:47:01.028669 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe289642-d582-49fd-a3a9-38c136191a83 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:01.039359 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe289642-d582-49fd-a3a9-38c136191a83 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:01.044505 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f22e67-09df-4efd-b527-0266904c2513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:01.045127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f22e67-09df-4efd-b527-0266904c2513 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:01.051776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f22e67-09df-4efd-b527-0266904c2513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:01.051776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f22e67-09df-4efd-b527-0266904c2513 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:01.051776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f22e67-09df-4efd-b527-0266904c2513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:01.052286 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1088/2147] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:47:00 2022] POST /identity/v3/projects => generated 391 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:47:01.052410 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f22e67-09df-4efd-b527-0266904c2513 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:01.054800 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d5db0-b16e-4de6-9262-48150145f514 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:01.063741 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1060/2148] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:47:01.068400 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f22e67-09df-4efd-b527-0266904c2513 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:01.078399 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f22e67-09df-4efd-b527-0266904c2513 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:01.119076 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d5db0-b16e-4de6-9262-48150145f514 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:01.124214 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa0e3d-fe47-4c60-b46d-70514f6b5961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:01.124862 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa0e3d-fe47-4c60-b46d-70514f6b5961 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:01.125135 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa0e3d-fe47-4c60-b46d-70514f6b5961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:01.125412 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa0e3d-fe47-4c60-b46d-70514f6b5961 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:01.126098 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa0e3d-fe47-4c60-b46d-70514f6b5961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:01.128557 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa0e3d-fe47-4c60-b46d-70514f6b5961 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:01.138390 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:01.145758 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afde929-530d-4212-9776-a73183a385ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:01.146466 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afde929-530d-4212-9776-a73183a385ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:01.146745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afde929-530d-4212-9776-a73183a385ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:01.147019 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afde929-530d-4212-9776-a73183a385ba admin admin] PATH_INFO: `/v3/projects/4f0fd25b2f6f4338b6c71e45e1ccce90/users/2b46feff889541fc86d99245a0b2d1d3/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:01.164054 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afde929-530d-4212-9776-a73183a385ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0fd25b2f6f4338b6c71e45e1ccce90, user_id=2b46feff889541fc86d99245a0b2d1d3, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:01.166728 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afde929-530d-4212-9776-a73183a385ba admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:01.271413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1089/2149] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:47:01 2022] POST /identity/v3/users => generated 296 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:47:01.271634 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1061/2150] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:47:01 2022] PUT /identity/v3/projects/4f0fd25b2f6f4338b6c71e45e1ccce90/users/2b46feff889541fc86d99245a0b2d1d3/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:47:01.274063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa0e3d-fe47-4c60-b46d-70514f6b5961 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:01.278170 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afde929-530d-4212-9776-a73183a385ba admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:01.290259 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa0e3d-fe47-4c60-b46d-70514f6b5961 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:01.361335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afde929-530d-4212-9776-a73183a385ba admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:01.366457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedeb85-fd02-481b-8d7f-70ee98d683aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:01.367175 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedeb85-fd02-481b-8d7f-70ee98d683aa admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:01.367566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedeb85-fd02-481b-8d7f-70ee98d683aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:01.367842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedeb85-fd02-481b-8d7f-70ee98d683aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:01.368537 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cedeb85-fd02-481b-8d7f-70ee98d683aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:01.371137 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cedeb85-fd02-481b-8d7f-70ee98d683aa admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:01.382822 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1062/2151] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:47:01.383769 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de8b69-ea7e-4cbb-9bc8-634f1313955c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:01.384816 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de8b69-ea7e-4cbb-9bc8-634f1313955c admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:01.385349 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de8b69-ea7e-4cbb-9bc8-634f1313955c admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:01.385836 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de8b69-ea7e-4cbb-9bc8-634f1313955c admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:01.387120 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de8b69-ea7e-4cbb-9bc8-634f1313955c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:01.388973 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedeb85-fd02-481b-8d7f-70ee98d683aa admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:01.390025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de8b69-ea7e-4cbb-9bc8-634f1313955c admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:01.404463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1090/2152] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:47:01.407587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedeb85-fd02-481b-8d7f-70ee98d683aa admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:01.408266 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de8b69-ea7e-4cbb-9bc8-634f1313955c admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:01.415238 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c7c1a-91ae-4729-8250-74dcfd11134a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:01.415959 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c7c1a-91ae-4729-8250-74dcfd11134a admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:01.416240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c7c1a-91ae-4729-8250-74dcfd11134a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:01.416523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c7c1a-91ae-4729-8250-74dcfd11134a admin admin] PATH_INFO: `/v3/projects/4f0fd25b2f6f4338b6c71e45e1ccce90/users/2b46feff889541fc86d99245a0b2d1d3/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:01.418556 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c7c1a-91ae-4729-8250-74dcfd11134a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0fd25b2f6f4338b6c71e45e1ccce90, user_id=2b46feff889541fc86d99245a0b2d1d3, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:01.420099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de8b69-ea7e-4cbb-9bc8-634f1313955c admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:01.421262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c7c1a-91ae-4729-8250-74dcfd11134a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:01.426744 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143321b-98ee-45b7-adf1-a45df009ac46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:01.427532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143321b-98ee-45b7-adf1-a45df009ac46 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:01.427824 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143321b-98ee-45b7-adf1-a45df009ac46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:01.428108 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143321b-98ee-45b7-adf1-a45df009ac46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:01.429209 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143321b-98ee-45b7-adf1-a45df009ac46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:01.431292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143321b-98ee-45b7-adf1-a45df009ac46 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:01.442773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1063/2153] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:47:01 2022] PUT /identity/v3/projects/4f0fd25b2f6f4338b6c71e45e1ccce90/users/2b46feff889541fc86d99245a0b2d1d3/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:01.445734 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299a2d6-0fe6-4d29-95aa-ee0762c79fff None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:01.446371 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299a2d6-0fe6-4d29-95aa-ee0762c79fff None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:01.446817 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299a2d6-0fe6-4d29-95aa-ee0762c79fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:01.447868 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1091/2154] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:47:01.448904 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143321b-98ee-45b7-adf1-a45df009ac46 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:01.475377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143321b-98ee-45b7-adf1-a45df009ac46 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:01.490044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-9299a2d6-0fe6-4d29-95aa-ee0762c79fff None None] MFA Rules not processed for user `2b46feff889541fc86d99245a0b2d1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:01.492053 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9299a2d6-0fe6-4d29-95aa-ee0762c79fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:01.535321 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:01.563770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faee51-b24a-45f5-8406-effb112ec210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:01.564461 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faee51-b24a-45f5-8406-effb112ec210 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:01.564745 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faee51-b24a-45f5-8406-effb112ec210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:01.565023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faee51-b24a-45f5-8406-effb112ec210 admin admin] PATH_INFO: `/v3/projects/b5125c2433794f0e8992dc88197ecb8b/users/51048ffc21844e56bde461f1653a9862/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:01.583029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67faee51-b24a-45f5-8406-effb112ec210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5125c2433794f0e8992dc88197ecb8b, user_id=51048ffc21844e56bde461f1653a9862, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:01.586249 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67faee51-b24a-45f5-8406-effb112ec210 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:01.586563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1064/2155] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:01 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:47:01.597595 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299a2d6-0fe6-4d29-95aa-ee0762c79fff None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:01.600124 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9299a2d6-0fe6-4d29-95aa-ee0762c79fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:01.659045 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299a2d6-0fe6-4d29-95aa-ee0762c79fff None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:01.663881 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdb246-b145-4e36-a69e-519e16fac3e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:01.664553 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdb246-b145-4e36-a69e-519e16fac3e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:01.664833 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdb246-b145-4e36-a69e-519e16fac3e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:01.665106 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdb246-b145-4e36-a69e-519e16fac3e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:01.674320 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdb246-b145-4e36-a69e-519e16fac3e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:01.675801 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdb246-b145-4e36-a69e-519e16fac3e0 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:01.685244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1065/2156] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:01 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:47:01.749022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1092/2157] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:47:01 2022] PUT /identity/v3/projects/b5125c2433794f0e8992dc88197ecb8b/users/51048ffc21844e56bde461f1653a9862/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:01.762191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2aea37-6371-423e-902f-22bd21f873b2 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:01.762768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2aea37-6371-423e-902f-22bd21f873b2 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:01.763133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2aea37-6371-423e-902f-22bd21f873b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:01.801974 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-7c2aea37-6371-423e-902f-22bd21f873b2 None None] MFA Rules not processed for user `51048ffc21844e56bde461f1653a9862`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:01.803309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7c2aea37-6371-423e-902f-22bd21f873b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:01.884326 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1066/2158] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:01.896152 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faee51-b24a-45f5-8406-effb112ec210 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:01.955182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faee51-b24a-45f5-8406-effb112ec210 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:01.959152 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4082983-242b-4a78-927c-ebe6e9af7336 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:01.960196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4082983-242b-4a78-927c-ebe6e9af7336 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:01.960356 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4082983-242b-4a78-927c-ebe6e9af7336 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:01.960605 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4082983-242b-4a78-927c-ebe6e9af7336 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:01.997554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4082983-242b-4a78-927c-ebe6e9af7336 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:01.997554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4082983-242b-4a78-927c-ebe6e9af7336 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:01.997554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1093/2159] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:02.142404 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:02.782488 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:03.369540 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:03.908831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:04.468448 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:06.884366 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2aea37-6371-423e-902f-22bd21f873b2 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:06.885814 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7c2aea37-6371-423e-902f-22bd21f873b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:06.960035 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2aea37-6371-423e-902f-22bd21f873b2 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:06.964589 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38655c7a-803b-4c51-8efe-45fd440353a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:06.965265 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38655c7a-803b-4c51-8efe-45fd440353a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:06.965548 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38655c7a-803b-4c51-8efe-45fd440353a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:06.965826 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38655c7a-803b-4c51-8efe-45fd440353a7 admin admin] PATH_INFO: `/v3/users/75844b5637e2485fab4a4749246517b0` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:06.967047 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38655c7a-803b-4c51-8efe-45fd440353a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75844b5637e2485fab4a4749246517b0)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:06.969058 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38655c7a-803b-4c51-8efe-45fd440353a7 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:07.221065 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4082983-242b-4a78-927c-ebe6e9af7336 service cinder] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:07.232565 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4082983-242b-4a78-927c-ebe6e9af7336 service cinder] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:07.237272 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077edc1-e9d7-45c0-a535-21d1278d16b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:07.237949 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077edc1-e9d7-45c0-a535-21d1278d16b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:07.238201 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077edc1-e9d7-45c0-a535-21d1278d16b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:07.238579 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077edc1-e9d7-45c0-a535-21d1278d16b7 admin admin] PATH_INFO: `/v3/users/236cd1c051b440ae9b4e44613de2a17c` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:07.239882 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077edc1-e9d7-45c0-a535-21d1278d16b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=236cd1c051b440ae9b4e44613de2a17c)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:07.241855 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077edc1-e9d7-45c0-a535-21d1278d16b7 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:07.265605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-38655c7a-803b-4c51-8efe-45fd440353a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75844b5637e2485fab4a4749246517b0'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:07.265605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-38655c7a-803b-4c51-8efe-45fd440353a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75844b5637e2485fab4a4749246517b0'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:07.367828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-38655c7a-803b-4c51-8efe-45fd440353a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75844b5637e2485fab4a4749246517b0'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:07.387188 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-38655c7a-803b-4c51-8efe-45fd440353a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75844b5637e2485fab4a4749246517b0'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:07.387977 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-38655c7a-803b-4c51-8efe-45fd440353a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75844b5637e2485fab4a4749246517b0'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:07.406352 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1067/2160] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:47:06 2022] DELETE /identity/v3/users/75844b5637e2485fab4a4749246517b0 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:47:07.407912 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bd37c-f309-434e-ad1d-618bcd3decf0 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:07.408103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bd37c-f309-434e-ad1d-618bcd3decf0 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:07.408386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bd37c-f309-434e-ad1d-618bcd3decf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:07.432550 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0c2bd37c-f309-434e-ad1d-618bcd3decf0 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:07.433768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0c2bd37c-f309-434e-ad1d-618bcd3decf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:07.493997 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1068/2161] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:47:07.504805 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bd37c-f309-434e-ad1d-618bcd3decf0 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:07.506771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0c2bd37c-f309-434e-ad1d-618bcd3decf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:07.523082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:07.535179 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-5077edc1-e9d7-45c0-a535-21d1278d16b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '236cd1c051b440ae9b4e44613de2a17c'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:07.535179 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-5077edc1-e9d7-45c0-a535-21d1278d16b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '236cd1c051b440ae9b4e44613de2a17c'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:07.610059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bd37c-f309-434e-ad1d-618bcd3decf0 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:07.614785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3935991-31e5-4c48-a214-9964643f13cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:07.616011 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3935991-31e5-4c48-a214-9964643f13cf service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:07.617593 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3935991-31e5-4c48-a214-9964643f13cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:07.617971 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3935991-31e5-4c48-a214-9964643f13cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:07.628771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3935991-31e5-4c48-a214-9964643f13cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:07.630895 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3935991-31e5-4c48-a214-9964643f13cf service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:07.638913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-5077edc1-e9d7-45c0-a535-21d1278d16b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '236cd1c051b440ae9b4e44613de2a17c'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:07.642452 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1069/2162] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:47:07.657747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-5077edc1-e9d7-45c0-a535-21d1278d16b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '236cd1c051b440ae9b4e44613de2a17c'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:07.681050 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-5077edc1-e9d7-45c0-a535-21d1278d16b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '236cd1c051b440ae9b4e44613de2a17c'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:07.685487 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:07.694349 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1094/2163] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:47:07 2022] DELETE /identity/v3/users/236cd1c051b440ae9b4e44613de2a17c => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:47:07.696158 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300d08b-89b3-48c7-98e9-3f11c93024ce None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:07.696453 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300d08b-89b3-48c7-98e9-3f11c93024ce None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:07.696733 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300d08b-89b3-48c7-98e9-3f11c93024ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:07.725753 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-2300d08b-89b3-48c7-98e9-3f11c93024ce None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:07.727067 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2300d08b-89b3-48c7-98e9-3f11c93024ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:07.797072 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1070/2164] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:07.807395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077edc1-e9d7-45c0-a535-21d1278d16b7 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:07.809267 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5077edc1-e9d7-45c0-a535-21d1278d16b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:07.875191 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077edc1-e9d7-45c0-a535-21d1278d16b7 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:07.879770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c730b9-abc9-4841-bdec-600c9d1c03e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:07.880418 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c730b9-abc9-4841-bdec-600c9d1c03e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:07.880696 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c730b9-abc9-4841-bdec-600c9d1c03e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:07.880979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c730b9-abc9-4841-bdec-600c9d1c03e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:07.891519 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c730b9-abc9-4841-bdec-600c9d1c03e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:07.893079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c730b9-abc9-4841-bdec-600c9d1c03e4 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:07.904000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1095/2165] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:08.343414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300d08b-89b3-48c7-98e9-3f11c93024ce None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:08.343414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2300d08b-89b3-48c7-98e9-3f11c93024ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:08.353484 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300d08b-89b3-48c7-98e9-3f11c93024ce None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:08.360418 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65fa70-2f93-4750-b923-d5a7de114e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:08.361127 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65fa70-2f93-4750-b923-d5a7de114e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:08.361419 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65fa70-2f93-4750-b923-d5a7de114e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:08.361703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65fa70-2f93-4750-b923-d5a7de114e81 admin admin] PATH_INFO: `/v3/projects/25c1a2ebe6d741089d59b5c265e079b4` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:08.362899 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65fa70-2f93-4750-b923-d5a7de114e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25c1a2ebe6d741089d59b5c265e079b4)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:08.365670 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65fa70-2f93-4750-b923-d5a7de114e81 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:08.431127 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c730b9-abc9-4841-bdec-600c9d1c03e4 service neutron] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:08.433019 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-77c730b9-abc9-4841-bdec-600c9d1c03e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:08.449222 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c730b9-abc9-4841-bdec-600c9d1c03e4 service neutron] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:08.454499 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af098a9-01c8-432a-8722-5fc349ea15f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:08.456271 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af098a9-01c8-432a-8722-5fc349ea15f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:08.456569 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af098a9-01c8-432a-8722-5fc349ea15f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:08.456858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af098a9-01c8-432a-8722-5fc349ea15f6 admin admin] PATH_INFO: `/v3/projects/2ed1f023d0694512a5dad8f4412c9bc9` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:08.462389 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af098a9-01c8-432a-8722-5fc349ea15f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed1f023d0694512a5dad8f4412c9bc9)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:08.464427 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af098a9-01c8-432a-8722-5fc349ea15f6 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:08.480029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4a65fa70-2f93-4750-b923-d5a7de114e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25c1a2ebe6d741089d59b5c265e079b4', 'request_id': 'req-4a65fa70-2f93-4750-b923-d5a7de114e81'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:08.486191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4a65fa70-2f93-4750-b923-d5a7de114e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25c1a2ebe6d741089d59b5c265e079b4', 'request_id': 'req-4a65fa70-2f93-4750-b923-d5a7de114e81'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:08.569233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4a65fa70-2f93-4750-b923-d5a7de114e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25c1a2ebe6d741089d59b5c265e079b4', 'request_id': 'req-4a65fa70-2f93-4750-b923-d5a7de114e81'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:08.581348 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4a65fa70-2f93-4750-b923-d5a7de114e81 admin admin] The token cache is being invalidate because project 25c1a2ebe6d741089d59b5c265e079b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:47:08.581572 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4a65fa70-2f93-4750-b923-d5a7de114e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:08.582839 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4a65fa70-2f93-4750-b923-d5a7de114e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:08.585140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1071/2166] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:47:08 2022] DELETE /identity/v3/projects/25c1a2ebe6d741089d59b5c265e079b4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:08.587528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4af098a9-01c8-432a-8722-5fc349ea15f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed1f023d0694512a5dad8f4412c9bc9', 'request_id': 'req-4af098a9-01c8-432a-8722-5fc349ea15f6'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:08.589087 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65fa70-2f93-4750-b923-d5a7de114e81 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:08.590541 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4a65fa70-2f93-4750-b923-d5a7de114e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:08.593505 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4af098a9-01c8-432a-8722-5fc349ea15f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed1f023d0694512a5dad8f4412c9bc9', 'request_id': 'req-4af098a9-01c8-432a-8722-5fc349ea15f6'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:08.651952 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:08.656125 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65fa70-2f93-4750-b923-d5a7de114e81 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:08.667603 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4af098a9-01c8-432a-8722-5fc349ea15f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed1f023d0694512a5dad8f4412c9bc9', 'request_id': 'req-4af098a9-01c8-432a-8722-5fc349ea15f6'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:08.679653 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4af098a9-01c8-432a-8722-5fc349ea15f6 admin admin] The token cache is being invalidate because project 2ed1f023d0694512a5dad8f4412c9bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:47:08.679951 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4af098a9-01c8-432a-8722-5fc349ea15f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:08.680727 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4af098a9-01c8-432a-8722-5fc349ea15f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:08.682624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1096/2167] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:47:08 2022] DELETE /identity/v3/projects/2ed1f023d0694512a5dad8f4412c9bc9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:08.686393 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af098a9-01c8-432a-8722-5fc349ea15f6 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:08.687889 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4af098a9-01c8-432a-8722-5fc349ea15f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:08.726145 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff7513-89fe-4e9c-9eb5-4c42c7d43b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:08.726996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff7513-89fe-4e9c-9eb5-4c42c7d43b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:08.727646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff7513-89fe-4e9c-9eb5-4c42c7d43b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:08.728097 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff7513-89fe-4e9c-9eb5-4c42c7d43b94 admin admin] PATH_INFO: `/v3/users/3eb3f8a08d054398953309a566cfac28` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:08.729793 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff7513-89fe-4e9c-9eb5-4c42c7d43b94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eb3f8a08d054398953309a566cfac28)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:08.731912 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff7513-89fe-4e9c-9eb5-4c42c7d43b94 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:08.762363 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af098a9-01c8-432a-8722-5fc349ea15f6 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:08.767128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8db64a-c212-49ed-adc5-caace48a8b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:08.767803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8db64a-c212-49ed-adc5-caace48a8b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:08.768084 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8db64a-c212-49ed-adc5-caace48a8b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:08.768358 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8db64a-c212-49ed-adc5-caace48a8b88 admin admin] PATH_INFO: `/v3/users/2b46feff889541fc86d99245a0b2d1d3` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:08.769524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8db64a-c212-49ed-adc5-caace48a8b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b46feff889541fc86d99245a0b2d1d3)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:08.772241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8db64a-c212-49ed-adc5-caace48a8b88 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:08.955698 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b4ff7513-89fe-4e9c-9eb5-4c42c7d43b94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eb3f8a08d054398953309a566cfac28'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:08.956378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b4ff7513-89fe-4e9c-9eb5-4c42c7d43b94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eb3f8a08d054398953309a566cfac28'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:08.972423 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:08.988081 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0b8db64a-c212-49ed-adc5-caace48a8b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b46feff889541fc86d99245a0b2d1d3'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:08.988797 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0b8db64a-c212-49ed-adc5-caace48a8b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b46feff889541fc86d99245a0b2d1d3'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:09.021653 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b4ff7513-89fe-4e9c-9eb5-4c42c7d43b94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eb3f8a08d054398953309a566cfac28'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:09.039786 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b4ff7513-89fe-4e9c-9eb5-4c42c7d43b94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eb3f8a08d054398953309a566cfac28'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:09.039786 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b4ff7513-89fe-4e9c-9eb5-4c42c7d43b94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eb3f8a08d054398953309a566cfac28'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:09.058736 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1072/2168] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:47:08 2022] DELETE /identity/v3/users/3eb3f8a08d054398953309a566cfac28 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:09.089318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0b8db64a-c212-49ed-adc5-caace48a8b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b46feff889541fc86d99245a0b2d1d3'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:09.106740 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0b8db64a-c212-49ed-adc5-caace48a8b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b46feff889541fc86d99245a0b2d1d3'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:09.117297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0b8db64a-c212-49ed-adc5-caace48a8b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b46feff889541fc86d99245a0b2d1d3'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:09.125256 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1097/2169] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:47:08 2022] DELETE /identity/v3/users/2b46feff889541fc86d99245a0b2d1d3 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:09.660137 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff7513-89fe-4e9c-9eb5-4c42c7d43b94 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:09.668699 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b4ff7513-89fe-4e9c-9eb5-4c42c7d43b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:09.693784 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8db64a-c212-49ed-adc5-caace48a8b88 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:09.706467 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-0b8db64a-c212-49ed-adc5-caace48a8b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:09.758185 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff7513-89fe-4e9c-9eb5-4c42c7d43b94 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:09.791149 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8db64a-c212-49ed-adc5-caace48a8b88 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:09.801225 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7296c54-dd92-480d-8438-e4f98a50681c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:09.802077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7296c54-dd92-480d-8438-e4f98a50681c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:09.802375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7296c54-dd92-480d-8438-e4f98a50681c admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:09.803003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7296c54-dd92-480d-8438-e4f98a50681c admin admin] PATH_INFO: `/v3/projects/4f0fd25b2f6f4338b6c71e45e1ccce90` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:09.804299 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7296c54-dd92-480d-8438-e4f98a50681c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0fd25b2f6f4338b6c71e45e1ccce90)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:09.806312 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7296c54-dd92-480d-8438-e4f98a50681c admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:09.836194 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b96ae-f9dd-451d-a79d-8d5b3c93feb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:09.836858 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b96ae-f9dd-451d-a79d-8d5b3c93feb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:09.837151 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b96ae-f9dd-451d-a79d-8d5b3c93feb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:09.837552 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b96ae-f9dd-451d-a79d-8d5b3c93feb1 admin admin] PATH_INFO: `/v3/projects/d30bc313844d46aba07b2685aa00a949` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:09.838779 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b96ae-f9dd-451d-a79d-8d5b3c93feb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d30bc313844d46aba07b2685aa00a949)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:09.840762 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b96ae-f9dd-451d-a79d-8d5b3c93feb1 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:09.958655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ed4b96ae-f9dd-451d-a79d-8d5b3c93feb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd30bc313844d46aba07b2685aa00a949', 'request_id': 'req-ed4b96ae-f9dd-451d-a79d-8d5b3c93feb1'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:09.958655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ed4b96ae-f9dd-451d-a79d-8d5b3c93feb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd30bc313844d46aba07b2685aa00a949', 'request_id': 'req-ed4b96ae-f9dd-451d-a79d-8d5b3c93feb1'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:09.967630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-e7296c54-dd92-480d-8438-e4f98a50681c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0fd25b2f6f4338b6c71e45e1ccce90', 'request_id': 'req-e7296c54-dd92-480d-8438-e4f98a50681c'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:09.974079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-e7296c54-dd92-480d-8438-e4f98a50681c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0fd25b2f6f4338b6c71e45e1ccce90', 'request_id': 'req-e7296c54-dd92-480d-8438-e4f98a50681c'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:10.089362 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ed4b96ae-f9dd-451d-a79d-8d5b3c93feb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd30bc313844d46aba07b2685aa00a949', 'request_id': 'req-ed4b96ae-f9dd-451d-a79d-8d5b3c93feb1'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:10.102291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ed4b96ae-f9dd-451d-a79d-8d5b3c93feb1 admin admin] The token cache is being invalidate because project d30bc313844d46aba07b2685aa00a949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:47:10.102900 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ed4b96ae-f9dd-451d-a79d-8d5b3c93feb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:10.103605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ed4b96ae-f9dd-451d-a79d-8d5b3c93feb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:10.105163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1073/2170] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:47:09 2022] DELETE /identity/v3/projects/d30bc313844d46aba07b2685aa00a949 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:10.111551 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5eb93a-53a0-4aa0-9450-8bdadd18fe16 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:10.111845 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5eb93a-53a0-4aa0-9450-8bdadd18fe16 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:10.116390 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5eb93a-53a0-4aa0-9450-8bdadd18fe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:10.133857 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-df5eb93a-53a0-4aa0-9450-8bdadd18fe16 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:10.139032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-df5eb93a-53a0-4aa0-9450-8bdadd18fe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:10.181273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-e7296c54-dd92-480d-8438-e4f98a50681c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0fd25b2f6f4338b6c71e45e1ccce90', 'request_id': 'req-e7296c54-dd92-480d-8438-e4f98a50681c'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:10.196167 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-e7296c54-dd92-480d-8438-e4f98a50681c admin admin] The token cache is being invalidate because project 4f0fd25b2f6f4338b6c71e45e1ccce90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:47:10.196565 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-e7296c54-dd92-480d-8438-e4f98a50681c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:10.197218 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-e7296c54-dd92-480d-8438-e4f98a50681c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:10.198778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1098/2171] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:47:09 2022] DELETE /identity/v3/projects/4f0fd25b2f6f4338b6c71e45e1ccce90 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:47:10.203848 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1074/2172] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:10.203986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e01c-2714-4294-901b-b026b936ff43 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:10.204190 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e01c-2714-4294-901b-b026b936ff43 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:10.204642 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e01c-2714-4294-901b-b026b936ff43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:10.212692 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950ee32-4eda-41d6-94f0-2e4f245a23cf None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:10.214210 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:10.214781 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950ee32-4eda-41d6-94f0-2e4f245a23cf None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:10.215139 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950ee32-4eda-41d6-94f0-2e4f245a23cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:10.247084 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-f1f3e01c-2714-4294-901b-b026b936ff43 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:10.248566 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-f1f3e01c-2714-4294-901b-b026b936ff43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:10.257077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1099/2173] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:47:10.266127 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7986c-e045-4e5a-b354-2f1bbd451d20 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:10.266604 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7986c-e045-4e5a-b354-2f1bbd451d20 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:10.266894 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7986c-e045-4e5a-b354-2f1bbd451d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:10.267200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a950ee32-4eda-41d6-94f0-2e4f245a23cf None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:10.268531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a950ee32-4eda-41d6-94f0-2e4f245a23cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:10.279922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1075/2174] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:47:10.284429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950ee32-4eda-41d6-94f0-2e4f245a23cf None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:10.305797 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950ee32-4eda-41d6-94f0-2e4f245a23cf None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:10.312806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2deb7-a7cd-4d3e-b253-248f56c60c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:10.314120 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2deb7-a7cd-4d3e-b253-248f56c60c67 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:10.314607 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2deb7-a7cd-4d3e-b253-248f56c60c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:10.314736 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-eed7986c-e045-4e5a-b354-2f1bbd451d20 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:10.315283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2deb7-a7cd-4d3e-b253-248f56c60c67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:10.315916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-eed7986c-e045-4e5a-b354-2f1bbd451d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:10.318624 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2deb7-a7cd-4d3e-b253-248f56c60c67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:47:10.319255 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2deb7-a7cd-4d3e-b253-248f56c60c67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:10.321655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2deb7-a7cd-4d3e-b253-248f56c60c67 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:10.337834 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1100/2175] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:47:10.344329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7986c-e045-4e5a-b354-2f1bbd451d20 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:10.351300 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1076/2176] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:47:10.353179 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7986c-e045-4e5a-b354-2f1bbd451d20 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:10.355654 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2deb7-a7cd-4d3e-b253-248f56c60c67 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:10.362224 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656bf49-8f96-4325-944d-937de723a258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:10.362886 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656bf49-8f96-4325-944d-937de723a258 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:10.363231 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656bf49-8f96-4325-944d-937de723a258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:10.363777 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656bf49-8f96-4325-944d-937de723a258 admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:10.364809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656bf49-8f96-4325-944d-937de723a258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:47:10.365172 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656bf49-8f96-4325-944d-937de723a258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:10.367140 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656bf49-8f96-4325-944d-937de723a258 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:10.370240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2deb7-a7cd-4d3e-b253-248f56c60c67 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:10.378499 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec83da-7ae1-4e44-9f8d-881d7ddcab3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:10.383869 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec83da-7ae1-4e44-9f8d-881d7ddcab3e admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:10.384279 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec83da-7ae1-4e44-9f8d-881d7ddcab3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:10.384572 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec83da-7ae1-4e44-9f8d-881d7ddcab3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:10.385971 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec83da-7ae1-4e44-9f8d-881d7ddcab3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:10.387242 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1101/2177] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:47:10.388965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec83da-7ae1-4e44-9f8d-881d7ddcab3e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:10.391662 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656bf49-8f96-4325-944d-937de723a258 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:10.405441 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656bf49-8f96-4325-944d-937de723a258 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:10.412810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e881d7-1946-4cd8-97ba-c5be5c699aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:10.413584 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e881d7-1946-4cd8-97ba-c5be5c699aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:10.413940 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e881d7-1946-4cd8-97ba-c5be5c699aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:10.414329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e881d7-1946-4cd8-97ba-c5be5c699aa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:10.415402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e881d7-1946-4cd8-97ba-c5be5c699aa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:10.417783 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e881d7-1946-4cd8-97ba-c5be5c699aa3 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:10.510277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1077/2178] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:47:10 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:47:10.514494 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec83da-7ae1-4e44-9f8d-881d7ddcab3e admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:10.540995 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1102/2179] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:47:10 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:47:10.541933 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e881d7-1946-4cd8-97ba-c5be5c699aa3 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:10.584876 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec83da-7ae1-4e44-9f8d-881d7ddcab3e admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:10.609304 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e881d7-1946-4cd8-97ba-c5be5c699aa3 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:10.614958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f9a17-4625-4420-a4f2-b92bc6c1bffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:10.615898 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f9a17-4625-4420-a4f2-b92bc6c1bffe admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:10.616215 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f9a17-4625-4420-a4f2-b92bc6c1bffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:10.616492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f9a17-4625-4420-a4f2-b92bc6c1bffe admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:10.617162 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f9a17-4625-4420-a4f2-b92bc6c1bffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:10.619360 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f9a17-4625-4420-a4f2-b92bc6c1bffe admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:10.645248 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:10.650716 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b4d13-f9ab-4b49-8960-9ef9107b0d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:10.651381 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b4d13-f9ab-4b49-8960-9ef9107b0d4b admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:10.651669 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b4d13-f9ab-4b49-8960-9ef9107b0d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:10.651953 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b4d13-f9ab-4b49-8960-9ef9107b0d4b admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:10.652728 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b4d13-f9ab-4b49-8960-9ef9107b0d4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:10.654723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b4d13-f9ab-4b49-8960-9ef9107b0d4b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:10.715881 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1103/2180] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:47:10 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:47:10.717114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f9a17-4625-4420-a4f2-b92bc6c1bffe admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:10.727748 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f9a17-4625-4420-a4f2-b92bc6c1bffe admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:10.732253 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710eae5-482a-4670-80c9-0d9b2138ccc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:10.732879 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710eae5-482a-4670-80c9-0d9b2138ccc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:10.733220 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710eae5-482a-4670-80c9-0d9b2138ccc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:10.733515 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710eae5-482a-4670-80c9-0d9b2138ccc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:10.734606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710eae5-482a-4670-80c9-0d9b2138ccc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:10.736276 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710eae5-482a-4670-80c9-0d9b2138ccc7 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:10.746050 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1078/2181] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:47:10 2022] POST /identity/v3/users => generated 292 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:47:10.751862 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1104/2182] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:47:10.752035 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b4d13-f9ab-4b49-8960-9ef9107b0d4b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:10.753145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710eae5-482a-4670-80c9-0d9b2138ccc7 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:10.772284 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b4d13-f9ab-4b49-8960-9ef9107b0d4b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:10.772392 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710eae5-482a-4670-80c9-0d9b2138ccc7 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:10.772482 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d656d-ec85-43d6-ae19-06eaa218b870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:10.772602 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1ed69-964d-4fa9-8551-58bd47c5d611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:10.772707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d656d-ec85-43d6-ae19-06eaa218b870 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:10.772780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1ed69-964d-4fa9-8551-58bd47c5d611 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:10.772860 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d656d-ec85-43d6-ae19-06eaa218b870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:10.772933 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1ed69-964d-4fa9-8551-58bd47c5d611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:10.773010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d656d-ec85-43d6-ae19-06eaa218b870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:10.773098 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1ed69-964d-4fa9-8551-58bd47c5d611 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:10.773192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d656d-ec85-43d6-ae19-06eaa218b870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:10.773276 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1ed69-964d-4fa9-8551-58bd47c5d611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:10.774243 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1ed69-964d-4fa9-8551-58bd47c5d611 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:10.774570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d656d-ec85-43d6-ae19-06eaa218b870 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:10.786250 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1105/2183] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:47:10.790955 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1079/2184] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:47:10.792415 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1ed69-964d-4fa9-8551-58bd47c5d611 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:10.792555 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d656d-ec85-43d6-ae19-06eaa218b870 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:10.803863 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d656d-ec85-43d6-ae19-06eaa218b870 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:10.804495 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1ed69-964d-4fa9-8551-58bd47c5d611 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:10.809476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e15226-ef37-40da-ba41-c78e5f1cd151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:10.810170 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e15226-ef37-40da-ba41-c78e5f1cd151 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:10.810525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e15226-ef37-40da-ba41-c78e5f1cd151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:10.810891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e15226-ef37-40da-ba41-c78e5f1cd151 admin admin] PATH_INFO: `/v3/projects/7958344fd79149669192e77e5ef846fe/users/b3c97aade77b45a59ac9d0485f26f744/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:10.812139 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d7560-ca8e-4ae9-a98b-f3086e737b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:10.812835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d7560-ca8e-4ae9-a98b-f3086e737b71 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:10.813121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d7560-ca8e-4ae9-a98b-f3086e737b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:10.817981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d7560-ca8e-4ae9-a98b-f3086e737b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:10.817981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d7560-ca8e-4ae9-a98b-f3086e737b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:10.817981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d7560-ca8e-4ae9-a98b-f3086e737b71 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:10.828898 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1106/2185] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:47:10.829090 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e15226-ef37-40da-ba41-c78e5f1cd151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7958344fd79149669192e77e5ef846fe, user_id=b3c97aade77b45a59ac9d0485f26f744, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:10.831947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e15226-ef37-40da-ba41-c78e5f1cd151 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:10.833723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d7560-ca8e-4ae9-a98b-f3086e737b71 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:10.852763 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d7560-ca8e-4ae9-a98b-f3086e737b71 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:10.852763 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71700ffd-479e-4979-84a7-27f020d06a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:10.852763 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71700ffd-479e-4979-84a7-27f020d06a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:10.852763 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71700ffd-479e-4979-84a7-27f020d06a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:10.853052 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71700ffd-479e-4979-84a7-27f020d06a09 admin admin] PATH_INFO: `/v3/projects/4f2279b260664781a7bba8dd27495eb8/users/189b3fd531be4a1e8523dea037ca0b0b/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:10.866691 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71700ffd-479e-4979-84a7-27f020d06a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2279b260664781a7bba8dd27495eb8, user_id=189b3fd531be4a1e8523dea037ca0b0b, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:10.869642 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71700ffd-479e-4979-84a7-27f020d06a09 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:10.935167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1080/2186] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:47:10 2022] PUT /identity/v3/projects/7958344fd79149669192e77e5ef846fe/users/b3c97aade77b45a59ac9d0485f26f744/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:10.947174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1eb4d-c3c6-4435-9d88-0f62db1470fe None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:10.947507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1eb4d-c3c6-4435-9d88-0f62db1470fe None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:10.947785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1eb4d-c3c6-4435-9d88-0f62db1470fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:10.974390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1107/2187] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:47:10 2022] PUT /identity/v3/projects/4f2279b260664781a7bba8dd27495eb8/users/189b3fd531be4a1e8523dea037ca0b0b/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:10.985899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2968a-6ced-46b7-bedc-3c5a6e002691 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:10.986191 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2968a-6ced-46b7-bedc-3c5a6e002691 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:10.986473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2968a-6ced-46b7-bedc-3c5a6e002691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:10.990792 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5dd1eb4d-c3c6-4435-9d88-0f62db1470fe None None] MFA Rules not processed for user `b3c97aade77b45a59ac9d0485f26f744`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:10.992069 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5dd1eb4d-c3c6-4435-9d88-0f62db1470fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:11.015191 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-cde2968a-6ced-46b7-bedc-3c5a6e002691 None None] MFA Rules not processed for user `189b3fd531be4a1e8523dea037ca0b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:11.016485 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-cde2968a-6ced-46b7-bedc-3c5a6e002691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:11.058329 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1081/2188] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:47:11.063033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1eb4d-c3c6-4435-9d88-0f62db1470fe None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:11.088971 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1108/2189] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:47:11.093503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2968a-6ced-46b7-bedc-3c5a6e002691 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:11.142607 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1eb4d-c3c6-4435-9d88-0f62db1470fe None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:11.151454 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2456b-5bb2-44b8-8e71-f3ed3ede42e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:11.152223 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2456b-5bb2-44b8-8e71-f3ed3ede42e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:11.152512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2456b-5bb2-44b8-8e71-f3ed3ede42e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:11.152703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2456b-5bb2-44b8-8e71-f3ed3ede42e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:11.153376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2456b-5bb2-44b8-8e71-f3ed3ede42e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:11.155486 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2456b-5bb2-44b8-8e71-f3ed3ede42e2 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:11.177225 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2968a-6ced-46b7-bedc-3c5a6e002691 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:11.182161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ac202-2c14-446e-9253-6623b063549c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:11.182882 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ac202-2c14-446e-9253-6623b063549c admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:11.183166 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ac202-2c14-446e-9253-6623b063549c admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:11.183475 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ac202-2c14-446e-9253-6623b063549c admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:11.184316 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ac202-2c14-446e-9253-6623b063549c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:11.186193 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ac202-2c14-446e-9253-6623b063549c admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:11.295463 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1082/2190] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:47:11 2022] POST /identity/v3/projects => generated 387 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:47:11.296823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2456b-5bb2-44b8-8e71-f3ed3ede42e2 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:11.355153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1109/2191] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:47:11 2022] POST /identity/v3/projects => generated 385 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:47:11.358910 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ac202-2c14-446e-9253-6623b063549c admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:11.396158 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2456b-5bb2-44b8-8e71-f3ed3ede42e2 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:11.455432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ac202-2c14-446e-9253-6623b063549c admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:11.461959 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089f584-8180-4147-bdf8-2b8c23b04865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:11.462611 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089f584-8180-4147-bdf8-2b8c23b04865 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:11.462895 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089f584-8180-4147-bdf8-2b8c23b04865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:11.463177 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089f584-8180-4147-bdf8-2b8c23b04865 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:11.464179 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089f584-8180-4147-bdf8-2b8c23b04865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:11.466479 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089f584-8180-4147-bdf8-2b8c23b04865 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:11.485355 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73991f9-f31a-47e9-bb12-9bd9861ce7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:11.485996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73991f9-f31a-47e9-bb12-9bd9861ce7cc admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:11.486285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73991f9-f31a-47e9-bb12-9bd9861ce7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:11.486563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73991f9-f31a-47e9-bb12-9bd9861ce7cc admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:11.487239 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73991f9-f31a-47e9-bb12-9bd9861ce7cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:11.489485 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73991f9-f31a-47e9-bb12-9bd9861ce7cc admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:11.568265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1110/2192] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:47:11 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:47:11.572512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089f584-8180-4147-bdf8-2b8c23b04865 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:11.583772 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089f584-8180-4147-bdf8-2b8c23b04865 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:11.589220 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cf349-e765-4e56-aea2-f7436eaae6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:11.589925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cf349-e765-4e56-aea2-f7436eaae6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:11.590207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cf349-e765-4e56-aea2-f7436eaae6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:11.590480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cf349-e765-4e56-aea2-f7436eaae6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:11.591226 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5cf349-e765-4e56-aea2-f7436eaae6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:11.592997 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5cf349-e765-4e56-aea2-f7436eaae6e2 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:11.605251 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1111/2193] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:47:11.609615 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cf349-e765-4e56-aea2-f7436eaae6e2 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:11.615903 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1083/2194] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:47:11 2022] POST /identity/v3/users => generated 300 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:47:11.617145 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73991f9-f31a-47e9-bb12-9bd9861ce7cc admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:11.620699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cf349-e765-4e56-aea2-f7436eaae6e2 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:11.626168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72c30e-c062-4130-89fd-ef025464dd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:11.626834 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72c30e-c062-4130-89fd-ef025464dd6b admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:11.627115 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72c30e-c062-4130-89fd-ef025464dd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:11.627427 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72c30e-c062-4130-89fd-ef025464dd6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:11.628556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72c30e-c062-4130-89fd-ef025464dd6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:11.629942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72c30e-c062-4130-89fd-ef025464dd6b admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:11.637980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73991f9-f31a-47e9-bb12-9bd9861ce7cc admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:11.643319 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a8b21-0f2a-421f-8aba-b1f92de01f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:11.655288 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a8b21-0f2a-421f-8aba-b1f92de01f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:11.655288 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a8b21-0f2a-421f-8aba-b1f92de01f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:11.655288 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a8b21-0f2a-421f-8aba-b1f92de01f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:11.655288 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a8b21-0f2a-421f-8aba-b1f92de01f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:11.655288 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a8b21-0f2a-421f-8aba-b1f92de01f42 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:11.655884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1112/2195] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:47:11.655884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72c30e-c062-4130-89fd-ef025464dd6b admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:11.662015 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1084/2196] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:47:11.666277 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72c30e-c062-4130-89fd-ef025464dd6b admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:11.667705 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a8b21-0f2a-421f-8aba-b1f92de01f42 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:11.671161 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad249db-fe5b-4708-90bb-735a6ec39b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:11.671987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad249db-fe5b-4708-90bb-735a6ec39b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:11.672275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad249db-fe5b-4708-90bb-735a6ec39b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:11.672556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad249db-fe5b-4708-90bb-735a6ec39b40 admin admin] PATH_INFO: `/v3/projects/a6181ad03d3d4fb6b95361da91c6aa3a/users/26a685bf60de4fb687f25d67714dfbd1/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:11.677923 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a8b21-0f2a-421f-8aba-b1f92de01f42 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:11.682582 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98baa89-5524-4ad8-bc41-f64d45e33ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:11.683389 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98baa89-5524-4ad8-bc41-f64d45e33ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:11.683673 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98baa89-5524-4ad8-bc41-f64d45e33ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:11.683949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98baa89-5524-4ad8-bc41-f64d45e33ea4 admin admin] PATH_INFO: `/v3/projects/d9ae5280f627451ca0c68a57c0dcba56/users/c3659df61a5047fd8f2a7256a588f100/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:11.688197 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad249db-fe5b-4708-90bb-735a6ec39b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6181ad03d3d4fb6b95361da91c6aa3a, user_id=26a685bf60de4fb687f25d67714dfbd1, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:11.690959 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad249db-fe5b-4708-90bb-735a6ec39b40 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:11.699832 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98baa89-5524-4ad8-bc41-f64d45e33ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ae5280f627451ca0c68a57c0dcba56, user_id=c3659df61a5047fd8f2a7256a588f100, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:11.702534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98baa89-5524-4ad8-bc41-f64d45e33ea4 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:11.773664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:11.777880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1113/2197] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:47:11 2022] PUT /identity/v3/projects/a6181ad03d3d4fb6b95361da91c6aa3a/users/26a685bf60de4fb687f25d67714dfbd1/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:47:11.780221 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1085/2198] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:47:11 2022] PUT /identity/v3/projects/d9ae5280f627451ca0c68a57c0dcba56/users/c3659df61a5047fd8f2a7256a588f100/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:47:11.784420 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad249db-fe5b-4708-90bb-735a6ec39b40 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:11.789560 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0f615-5fd5-4df6-b07e-8ff996c2249a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:11.789856 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0f615-5fd5-4df6-b07e-8ff996c2249a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:11.790140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0f615-5fd5-4df6-b07e-8ff996c2249a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:11.820040 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c8c0f615-5fd5-4df6-b07e-8ff996c2249a None None] MFA Rules not processed for user `26a685bf60de4fb687f25d67714dfbd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:11.821329 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c8c0f615-5fd5-4df6-b07e-8ff996c2249a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:11.869350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad249db-fe5b-4708-90bb-735a6ec39b40 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:11.890189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1086/2199] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:47:11.894846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0f615-5fd5-4df6-b07e-8ff996c2249a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:11.930151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb667c97-a710-4a61-9f74-12c0b8535675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:11.931134 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb667c97-a710-4a61-9f74-12c0b8535675 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:11.931460 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb667c97-a710-4a61-9f74-12c0b8535675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:11.931744 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb667c97-a710-4a61-9f74-12c0b8535675 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:11.932459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb667c97-a710-4a61-9f74-12c0b8535675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:11.934153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb667c97-a710-4a61-9f74-12c0b8535675 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:11.945480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1114/2200] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:47:11.949992 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb667c97-a710-4a61-9f74-12c0b8535675 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:11.960201 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb667c97-a710-4a61-9f74-12c0b8535675 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:11.969537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270ff2f-d32d-42bc-b58c-aced355c5921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:11.970694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270ff2f-d32d-42bc-b58c-aced355c5921 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:11.970987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270ff2f-d32d-42bc-b58c-aced355c5921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:11.971525 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270ff2f-d32d-42bc-b58c-aced355c5921 admin admin] PATH_INFO: `/v3/projects/d9ae5280f627451ca0c68a57c0dcba56/users/c3659df61a5047fd8f2a7256a588f100/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:11.974206 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270ff2f-d32d-42bc-b58c-aced355c5921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ae5280f627451ca0c68a57c0dcba56, user_id=c3659df61a5047fd8f2a7256a588f100, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:11.977576 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270ff2f-d32d-42bc-b58c-aced355c5921 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:11.977715 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0f615-5fd5-4df6-b07e-8ff996c2249a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:11.983401 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34895a44-4dcd-4d04-a186-26fad1a15228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:11.984035 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34895a44-4dcd-4d04-a186-26fad1a15228 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:11.984533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34895a44-4dcd-4d04-a186-26fad1a15228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:11.984685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34895a44-4dcd-4d04-a186-26fad1a15228 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:11.985361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34895a44-4dcd-4d04-a186-26fad1a15228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:11.987284 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34895a44-4dcd-4d04-a186-26fad1a15228 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:11.989717 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1115/2201] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:47:11 2022] PUT /identity/v3/projects/d9ae5280f627451ca0c68a57c0dcba56/users/c3659df61a5047fd8f2a7256a588f100/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:12.000245 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a745d1-eca2-48e6-96a2-ae2205567eb3 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:12.000551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a745d1-eca2-48e6-96a2-ae2205567eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:12.000965 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a745d1-eca2-48e6-96a2-ae2205567eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:12.031046 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-b2a745d1-eca2-48e6-96a2-ae2205567eb3 None None] MFA Rules not processed for user `c3659df61a5047fd8f2a7256a588f100`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:12.032312 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b2a745d1-eca2-48e6-96a2-ae2205567eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:12.102261 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1116/2202] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:47:12.107208 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1087/2203] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:47:11 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:47:12.108361 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a745d1-eca2-48e6-96a2-ae2205567eb3 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:12.113679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34895a44-4dcd-4d04-a186-26fad1a15228 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:12.115414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-34895a44-4dcd-4d04-a186-26fad1a15228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:12.174002 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34895a44-4dcd-4d04-a186-26fad1a15228 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:12.174218 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a745d1-eca2-48e6-96a2-ae2205567eb3 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:12.178339 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe3837-1fa8-43fe-ad88-87e2209cab70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:12.178996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe3837-1fa8-43fe-ad88-87e2209cab70 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:12.179333 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe3837-1fa8-43fe-ad88-87e2209cab70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:12.179617 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe3837-1fa8-43fe-ad88-87e2209cab70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:12.233105 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ba923-45cc-4040-9d71-47bc8951a8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:12.233661 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ba923-45cc-4040-9d71-47bc8951a8b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:12.234007 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ba923-45cc-4040-9d71-47bc8951a8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:12.234225 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ba923-45cc-4040-9d71-47bc8951a8b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:12.234901 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ba923-45cc-4040-9d71-47bc8951a8b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:12.236900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ba923-45cc-4040-9d71-47bc8951a8b2 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:12.241345 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe3837-1fa8-43fe-ad88-87e2209cab70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:12.242847 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe3837-1fa8-43fe-ad88-87e2209cab70 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:12.253030 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1088/2204] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:47:12.256855 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:12.282593 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe3837-1fa8-43fe-ad88-87e2209cab70 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:12.295114 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe3837-1fa8-43fe-ad88-87e2209cab70 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:12.300163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7d16c-44d3-41af-81cf-e5b4f9cefb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:12.300868 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7d16c-44d3-41af-81cf-e5b4f9cefb79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:12.301159 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7d16c-44d3-41af-81cf-e5b4f9cefb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:12.301438 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7d16c-44d3-41af-81cf-e5b4f9cefb79 admin admin] PATH_INFO: `/v3/users/b3c97aade77b45a59ac9d0485f26f744` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:12.302792 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7d16c-44d3-41af-81cf-e5b4f9cefb79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3c97aade77b45a59ac9d0485f26f744)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:12.308401 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7d16c-44d3-41af-81cf-e5b4f9cefb79 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:12.361830 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1117/2205] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:47:12 2022] POST /identity/v3/users => generated 298 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:47:12.370721 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ba923-45cc-4040-9d71-47bc8951a8b2 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:12.386907 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ba923-45cc-4040-9d71-47bc8951a8b2 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:12.393142 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb43918-9649-45f0-879a-8df22619a10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:12.393747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43918-9649-45f0-879a-8df22619a10d admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:12.394042 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43918-9649-45f0-879a-8df22619a10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:12.394332 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43918-9649-45f0-879a-8df22619a10d admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:12.395669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb43918-9649-45f0-879a-8df22619a10d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:12.397503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb43918-9649-45f0-879a-8df22619a10d admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:12.412920 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1118/2206] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:47:12.414045 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb43918-9649-45f0-879a-8df22619a10d admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:12.426219 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb43918-9649-45f0-879a-8df22619a10d admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:12.432001 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633e04a-8422-4ddd-8091-ab9a3afe18f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:12.432691 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633e04a-8422-4ddd-8091-ab9a3afe18f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:12.433357 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633e04a-8422-4ddd-8091-ab9a3afe18f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:12.433357 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633e04a-8422-4ddd-8091-ab9a3afe18f3 admin admin] PATH_INFO: `/v3/projects/bcb5798c7ade4aa099779ee02557e683/users/7891c23f0f034f1f98275ab2aaf92254/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:12.451017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633e04a-8422-4ddd-8091-ab9a3afe18f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb5798c7ade4aa099779ee02557e683, user_id=7891c23f0f034f1f98275ab2aaf92254, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:12.454010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633e04a-8422-4ddd-8091-ab9a3afe18f3 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:12.562343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b2a7d16c-44d3-41af-81cf-e5b4f9cefb79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3c97aade77b45a59ac9d0485f26f744'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:12.563105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b2a7d16c-44d3-41af-81cf-e5b4f9cefb79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3c97aade77b45a59ac9d0485f26f744'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:12.563243 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1119/2207] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:47:12 2022] PUT /identity/v3/projects/bcb5798c7ade4aa099779ee02557e683/users/7891c23f0f034f1f98275ab2aaf92254/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:47:12.564355 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633e04a-8422-4ddd-8091-ab9a3afe18f3 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:12.628062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b2a7d16c-44d3-41af-81cf-e5b4f9cefb79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3c97aade77b45a59ac9d0485f26f744'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:12.651250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b2a7d16c-44d3-41af-81cf-e5b4f9cefb79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3c97aade77b45a59ac9d0485f26f744'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:12.652191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b2a7d16c-44d3-41af-81cf-e5b4f9cefb79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3c97aade77b45a59ac9d0485f26f744'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:12.664787 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633e04a-8422-4ddd-8091-ab9a3afe18f3 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:12.681034 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ba166-819c-4e1a-80fe-68eb5e7303c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:12.681034 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ba166-819c-4e1a-80fe-68eb5e7303c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:12.681034 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ba166-819c-4e1a-80fe-68eb5e7303c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:12.681034 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ba166-819c-4e1a-80fe-68eb5e7303c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:12.689031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ba166-819c-4e1a-80fe-68eb5e7303c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:12.689031 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ba166-819c-4e1a-80fe-68eb5e7303c4 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:12.694218 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1089/2208] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:47:12 2022] DELETE /identity/v3/users/b3c97aade77b45a59ac9d0485f26f744 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:12.699317 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071afa6f-75ca-46e8-9717-ee3050ccd593 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:12.699723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071afa6f-75ca-46e8-9717-ee3050ccd593 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:12.700105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071afa6f-75ca-46e8-9717-ee3050ccd593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:12.729982 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-071afa6f-75ca-46e8-9717-ee3050ccd593 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:12.732006 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-071afa6f-75ca-46e8-9717-ee3050ccd593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:12.746730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1120/2209] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:47:12.751189 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ba166-819c-4e1a-80fe-68eb5e7303c4 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:12.756487 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-f74ba166-819c-4e1a-80fe-68eb5e7303c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:12.806978 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ba166-819c-4e1a-80fe-68eb5e7303c4 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:12.808133 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:12.838827 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1090/2210] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:12.845415 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:12.850050 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071afa6f-75ca-46e8-9717-ee3050ccd593 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:12.855778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-071afa6f-75ca-46e8-9717-ee3050ccd593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:12.957870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071afa6f-75ca-46e8-9717-ee3050ccd593 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:12.958209 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fec5a7-99c1-4187-b7bf-53f339b4f17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:12.959095 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fec5a7-99c1-4187-b7bf-53f339b4f17d admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:12.959913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fec5a7-99c1-4187-b7bf-53f339b4f17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:12.960340 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fec5a7-99c1-4187-b7bf-53f339b4f17d admin admin] PATH_INFO: `/v3/projects/bcb5798c7ade4aa099779ee02557e683/users/7891c23f0f034f1f98275ab2aaf92254/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:12.962974 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fec5a7-99c1-4187-b7bf-53f339b4f17d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb5798c7ade4aa099779ee02557e683, user_id=7891c23f0f034f1f98275ab2aaf92254, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:12.963326 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7058f-51a2-4128-94a7-b6670bbb9474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:12.964540 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7058f-51a2-4128-94a7-b6670bbb9474 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:12.965495 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7058f-51a2-4128-94a7-b6670bbb9474 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:12.966193 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7058f-51a2-4128-94a7-b6670bbb9474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:12.969461 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fec5a7-99c1-4187-b7bf-53f339b4f17d admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:12.981117 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7058f-51a2-4128-94a7-b6670bbb9474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:12.984385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7058f-51a2-4128-94a7-b6670bbb9474 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:13.004735 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1121/2211] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:47:12 2022] PUT /identity/v3/projects/bcb5798c7ade4aa099779ee02557e683/users/7891c23f0f034f1f98275ab2aaf92254/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:13.010607 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902e933-1383-42ed-b839-8d0f2b2437a2 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:13.010963 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902e933-1383-42ed-b839-8d0f2b2437a2 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:13.011181 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902e933-1383-42ed-b839-8d0f2b2437a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:13.015462 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1091/2212] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:13.053197 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-4902e933-1383-42ed-b839-8d0f2b2437a2 None None] MFA Rules not processed for user `7891c23f0f034f1f98275ab2aaf92254`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:13.055842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4902e933-1383-42ed-b839-8d0f2b2437a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:13.093355 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:13.174412 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1122/2213] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:13.184771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:13.190647 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7058f-51a2-4128-94a7-b6670bbb9474 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:13.190647 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-90a7058f-51a2-4128-94a7-b6670bbb9474 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:13.263905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7058f-51a2-4128-94a7-b6670bbb9474 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:13.314236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b6740-2cc3-441e-ada3-4fcc8500eaca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:13.314895 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b6740-2cc3-441e-ada3-4fcc8500eaca service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:13.315211 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b6740-2cc3-441e-ada3-4fcc8500eaca service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:13.315549 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b6740-2cc3-441e-ada3-4fcc8500eaca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:13.318114 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d35b6740-2cc3-441e-ada3-4fcc8500eaca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:13.390764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:13.397613 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b6740-2cc3-441e-ada3-4fcc8500eaca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:13.399513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b6740-2cc3-441e-ada3-4fcc8500eaca service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:13.410738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1092/2214] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:47:13.479911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:13.732746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902e933-1383-42ed-b839-8d0f2b2437a2 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:13.734130 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4902e933-1383-42ed-b839-8d0f2b2437a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:13.811682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902e933-1383-42ed-b839-8d0f2b2437a2 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:13.814297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e23de5-bddf-4c7d-9ba3-676e11e913ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:13.815096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e23de5-bddf-4c7d-9ba3-676e11e913ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:13.815640 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e23de5-bddf-4c7d-9ba3-676e11e913ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:13.815989 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e23de5-bddf-4c7d-9ba3-676e11e913ee admin admin] PATH_INFO: `/v3/projects/7958344fd79149669192e77e5ef846fe` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:13.817762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e23de5-bddf-4c7d-9ba3-676e11e913ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=7958344fd79149669192e77e5ef846fe)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:13.820239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e23de5-bddf-4c7d-9ba3-676e11e913ee admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:13.823477 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:13.921364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-55e23de5-bddf-4c7d-9ba3-676e11e913ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7958344fd79149669192e77e5ef846fe', 'request_id': 'req-55e23de5-bddf-4c7d-9ba3-676e11e913ee'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:13.927337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-55e23de5-bddf-4c7d-9ba3-676e11e913ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7958344fd79149669192e77e5ef846fe', 'request_id': 'req-55e23de5-bddf-4c7d-9ba3-676e11e913ee'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:13.999437 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-55e23de5-bddf-4c7d-9ba3-676e11e913ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7958344fd79149669192e77e5ef846fe', 'request_id': 'req-55e23de5-bddf-4c7d-9ba3-676e11e913ee'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:14.011989 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:14.013793 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-55e23de5-bddf-4c7d-9ba3-676e11e913ee admin admin] The token cache is being invalidate because project 7958344fd79149669192e77e5ef846fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:47:14.014653 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-55e23de5-bddf-4c7d-9ba3-676e11e913ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:14.015468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-55e23de5-bddf-4c7d-9ba3-676e11e913ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:14.017250 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1123/2215] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:47:13 2022] DELETE /identity/v3/projects/7958344fd79149669192e77e5ef846fe => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:14.022205 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b6740-2cc3-441e-ada3-4fcc8500eaca service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:14.033091 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b6740-2cc3-441e-ada3-4fcc8500eaca service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:14.097015 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a9691-4660-4fdf-b7c4-ee2e2a280b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:14.097719 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a9691-4660-4fdf-b7c4-ee2e2a280b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:14.098189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a9691-4660-4fdf-b7c4-ee2e2a280b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:14.098802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a9691-4660-4fdf-b7c4-ee2e2a280b76 admin admin] PATH_INFO: `/v3/users/c3659df61a5047fd8f2a7256a588f100` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:14.107663 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a9691-4660-4fdf-b7c4-ee2e2a280b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3659df61a5047fd8f2a7256a588f100)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:14.110936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a9691-4660-4fdf-b7c4-ee2e2a280b76 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:14.251757 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c287801-2e0f-4b0d-bca6-9f3c1e2ead3e None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:14.252040 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c287801-2e0f-4b0d-bca6-9f3c1e2ead3e None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:14.252319 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c287801-2e0f-4b0d-bca6-9f3c1e2ead3e None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:14.254385 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1124/2216] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 18:47:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:47:14.295006 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3344f-7467-46be-b990-9b6da871125d None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:14.295401 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3344f-7467-46be-b990-9b6da871125d None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:14.295728 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3344f-7467-46be-b990-9b6da871125d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:14.318704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-dab3344f-7467-46be-b990-9b6da871125d None None] MFA Rules not processed for user `aa971da983ea48c3b6d4c68a5d454bde`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:14.320284 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-dab3344f-7467-46be-b990-9b6da871125d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:14.331789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0d2a9691-4660-4fdf-b7c4-ee2e2a280b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3659df61a5047fd8f2a7256a588f100'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:14.333424 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0d2a9691-4660-4fdf-b7c4-ee2e2a280b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3659df61a5047fd8f2a7256a588f100'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:14.413164 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1125/2217] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 18:47:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:47:14.426732 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3344f-7467-46be-b990-9b6da871125d None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:14.428248 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-dab3344f-7467-46be-b990-9b6da871125d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:14.439476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0d2a9691-4660-4fdf-b7c4-ee2e2a280b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3659df61a5047fd8f2a7256a588f100'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:14.444196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3344f-7467-46be-b990-9b6da871125d None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:14.451880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce905a3-c124-4ec9-bbda-c6c8e67cf8e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa971da983ea48c3b6d4c68a5d454bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:14.453414 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce905a3-c124-4ec9-bbda-c6c8e67cf8e2 service placement] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:14.454124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce905a3-c124-4ec9-bbda-c6c8e67cf8e2 service placement] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:14.454988 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce905a3-c124-4ec9-bbda-c6c8e67cf8e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:14.455619 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0d2a9691-4660-4fdf-b7c4-ee2e2a280b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3659df61a5047fd8f2a7256a588f100'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:14.456352 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0d2a9691-4660-4fdf-b7c4-ee2e2a280b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3659df61a5047fd8f2a7256a588f100'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:14.458374 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-dce905a3-c124-4ec9-bbda-c6c8e67cf8e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:14.471163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1093/2218] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:47:14 2022] DELETE /identity/v3/users/c3659df61a5047fd8f2a7256a588f100 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:14.487150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a9691-4660-4fdf-b7c4-ee2e2a280b76 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:14.487524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce905a3-c124-4ec9-bbda-c6c8e67cf8e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:14.491193 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0d2a9691-4660-4fdf-b7c4-ee2e2a280b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:14.496777 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce905a3-c124-4ec9-bbda-c6c8e67cf8e2 service placement] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:14.517680 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1126/2219] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:14.590651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a9691-4660-4fdf-b7c4-ee2e2a280b76 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:14.596445 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132779c-3b9c-423c-914d-273b7890e6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:14.597737 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132779c-3b9c-423c-914d-273b7890e6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:14.598257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132779c-3b9c-423c-914d-273b7890e6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:14.598598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132779c-3b9c-423c-914d-273b7890e6bb admin admin] PATH_INFO: `/v3/users/a5be4e5a6e1241f0b01b62953e66cc34` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:14.599920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132779c-3b9c-423c-914d-273b7890e6bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5be4e5a6e1241f0b01b62953e66cc34)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:14.603935 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132779c-3b9c-423c-914d-273b7890e6bb admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:14.826315 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6132779c-3b9c-423c-914d-273b7890e6bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5be4e5a6e1241f0b01b62953e66cc34'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:14.827004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6132779c-3b9c-423c-914d-273b7890e6bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5be4e5a6e1241f0b01b62953e66cc34'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:14.908881 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6132779c-3b9c-423c-914d-273b7890e6bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5be4e5a6e1241f0b01b62953e66cc34'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:14.915470 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce905a3-c124-4ec9-bbda-c6c8e67cf8e2 service placement] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:14.917581 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-dce905a3-c124-4ec9-bbda-c6c8e67cf8e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:14.925311 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6132779c-3b9c-423c-914d-273b7890e6bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5be4e5a6e1241f0b01b62953e66cc34'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:14.926587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6132779c-3b9c-423c-914d-273b7890e6bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5be4e5a6e1241f0b01b62953e66cc34'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:14.935842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce905a3-c124-4ec9-bbda-c6c8e67cf8e2 service placement] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:14.942124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae4e50-c317-4dac-90e2-9dd505bd741f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:14.943878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae4e50-c317-4dac-90e2-9dd505bd741f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:14.943878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae4e50-c317-4dac-90e2-9dd505bd741f admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:14.944405 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1094/2220] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:47:14 2022] DELETE /identity/v3/users/a5be4e5a6e1241f0b01b62953e66cc34 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:47:14.944500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae4e50-c317-4dac-90e2-9dd505bd741f admin admin] PATH_INFO: `/v3/projects/d9ae5280f627451ca0c68a57c0dcba56` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:14.945406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae4e50-c317-4dac-90e2-9dd505bd741f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9ae5280f627451ca0c68a57c0dcba56)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:14.947365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae4e50-c317-4dac-90e2-9dd505bd741f admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:15.137456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-48ae4e50-c317-4dac-90e2-9dd505bd741f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9ae5280f627451ca0c68a57c0dcba56', 'request_id': 'req-48ae4e50-c317-4dac-90e2-9dd505bd741f'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:15.143012 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-48ae4e50-c317-4dac-90e2-9dd505bd741f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9ae5280f627451ca0c68a57c0dcba56', 'request_id': 'req-48ae4e50-c317-4dac-90e2-9dd505bd741f'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:15.170099 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132779c-3b9c-423c-914d-273b7890e6bb admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:15.171535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6132779c-3b9c-423c-914d-273b7890e6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:15.210751 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-48ae4e50-c317-4dac-90e2-9dd505bd741f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9ae5280f627451ca0c68a57c0dcba56', 'request_id': 'req-48ae4e50-c317-4dac-90e2-9dd505bd741f'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:15.225121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-48ae4e50-c317-4dac-90e2-9dd505bd741f admin admin] The token cache is being invalidate because project d9ae5280f627451ca0c68a57c0dcba56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:47:15.225421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-48ae4e50-c317-4dac-90e2-9dd505bd741f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:15.228941 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-48ae4e50-c317-4dac-90e2-9dd505bd741f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:15.232057 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1127/2221] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:47:14 2022] DELETE /identity/v3/projects/d9ae5280f627451ca0c68a57c0dcba56 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:47:15.233015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae4e50-c317-4dac-90e2-9dd505bd741f admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:15.234375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-48ae4e50-c317-4dac-90e2-9dd505bd741f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:15.251421 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132779c-3b9c-423c-914d-273b7890e6bb admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:15.283650 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:15.321944 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae4e50-c317-4dac-90e2-9dd505bd741f admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:15.326334 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27b0f0-0644-48d0-ba99-742a3f82b737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:15.327332 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27b0f0-0644-48d0-ba99-742a3f82b737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:15.327825 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27b0f0-0644-48d0-ba99-742a3f82b737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:15.328309 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27b0f0-0644-48d0-ba99-742a3f82b737 admin admin] PATH_INFO: `/v3/projects/3e4ec9b59fb745e682eeede33ec29417` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:15.328818 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4d7bf-ed31-4a1c-a4aa-06e2f020f024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:15.329544 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4d7bf-ed31-4a1c-a4aa-06e2f020f024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:15.329791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4d7bf-ed31-4a1c-a4aa-06e2f020f024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:15.330071 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4d7bf-ed31-4a1c-a4aa-06e2f020f024 admin admin] PATH_INFO: `/v3/users/51048ffc21844e56bde461f1653a9862` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:15.330912 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27b0f0-0644-48d0-ba99-742a3f82b737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e4ec9b59fb745e682eeede33ec29417)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:15.331413 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4d7bf-ed31-4a1c-a4aa-06e2f020f024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51048ffc21844e56bde461f1653a9862)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:15.334853 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27b0f0-0644-48d0-ba99-742a3f82b737 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:15.334980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4d7bf-ed31-4a1c-a4aa-06e2f020f024 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:15.467417 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:15.511654 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-31c4d7bf-ed31-4a1c-a4aa-06e2f020f024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51048ffc21844e56bde461f1653a9862'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:15.512766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-31c4d7bf-ed31-4a1c-a4aa-06e2f020f024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51048ffc21844e56bde461f1653a9862'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:15.519410 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-fb27b0f0-0644-48d0-ba99-742a3f82b737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e4ec9b59fb745e682eeede33ec29417', 'request_id': 'req-fb27b0f0-0644-48d0-ba99-742a3f82b737'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:15.525564 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-fb27b0f0-0644-48d0-ba99-742a3f82b737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e4ec9b59fb745e682eeede33ec29417', 'request_id': 'req-fb27b0f0-0644-48d0-ba99-742a3f82b737'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:15.579354 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-31c4d7bf-ed31-4a1c-a4aa-06e2f020f024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51048ffc21844e56bde461f1653a9862'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:15.589484 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-31c4d7bf-ed31-4a1c-a4aa-06e2f020f024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51048ffc21844e56bde461f1653a9862'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:15.590206 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-31c4d7bf-ed31-4a1c-a4aa-06e2f020f024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51048ffc21844e56bde461f1653a9862'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:15.599057 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:15.604530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1095/2222] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:47:15 2022] DELETE /identity/v3/users/51048ffc21844e56bde461f1653a9862 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:47:15.605591 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc609f19-9a9a-4ae9-aacc-c1c821c0ebf5 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:15.605881 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc609f19-9a9a-4ae9-aacc-c1c821c0ebf5 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:15.606161 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc609f19-9a9a-4ae9-aacc-c1c821c0ebf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:15.640626 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-cc609f19-9a9a-4ae9-aacc-c1c821c0ebf5 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:15.641929 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cc609f19-9a9a-4ae9-aacc-c1c821c0ebf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:15.656413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-fb27b0f0-0644-48d0-ba99-742a3f82b737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e4ec9b59fb745e682eeede33ec29417', 'request_id': 'req-fb27b0f0-0644-48d0-ba99-742a3f82b737'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:15.673505 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-fb27b0f0-0644-48d0-ba99-742a3f82b737 admin admin] The token cache is being invalidate because project 3e4ec9b59fb745e682eeede33ec29417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:47:15.673798 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-fb27b0f0-0644-48d0-ba99-742a3f82b737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:15.674473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-fb27b0f0-0644-48d0-ba99-742a3f82b737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:15.679431 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1128/2223] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:47:15 2022] DELETE /identity/v3/projects/3e4ec9b59fb745e682eeede33ec29417 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:15.680581 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27b0f0-0644-48d0-ba99-742a3f82b737 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:15.682654 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-fb27b0f0-0644-48d0-ba99-742a3f82b737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:15.726097 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1096/2224] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:15.728791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824eeb1-4668-4e0a-89d8-2295412c4caf None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:15.729497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824eeb1-4668-4e0a-89d8-2295412c4caf None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:15.729991 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824eeb1-4668-4e0a-89d8-2295412c4caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:15.755848 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-9824eeb1-4668-4e0a-89d8-2295412c4caf None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:15.757088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9824eeb1-4668-4e0a-89d8-2295412c4caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:15.764074 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27b0f0-0644-48d0-ba99-742a3f82b737 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:15.767657 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1097/2225] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:15.771855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824eeb1-4668-4e0a-89d8-2295412c4caf None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:15.771855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9824eeb1-4668-4e0a-89d8-2295412c4caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:15.788561 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824eeb1-4668-4e0a-89d8-2295412c4caf None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:15.793992 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac492bb-6924-405b-a539-e2217650d307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:15.794676 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac492bb-6924-405b-a539-e2217650d307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:15.794958 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac492bb-6924-405b-a539-e2217650d307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:15.795347 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac492bb-6924-405b-a539-e2217650d307 admin admin] PATH_INFO: `/v3/users/0397787b459e45aab7f1250c826d465b` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:15.796937 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac492bb-6924-405b-a539-e2217650d307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0397787b459e45aab7f1250c826d465b)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:15.798928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac492bb-6924-405b-a539-e2217650d307 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:15.828190 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b833a8-7119-4a0f-91a3-5116ae6e2397 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:15.828821 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b833a8-7119-4a0f-91a3-5116ae6e2397 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:15.829104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b833a8-7119-4a0f-91a3-5116ae6e2397 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:15.829437 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b833a8-7119-4a0f-91a3-5116ae6e2397 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:15.831160 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a8b833a8-7119-4a0f-91a3-5116ae6e2397 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:15.906360 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b833a8-7119-4a0f-91a3-5116ae6e2397 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:15.907861 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b833a8-7119-4a0f-91a3-5116ae6e2397 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:15.917163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1129/2226] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:15.918554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bd645-98b3-4477-b3db-53d822c0819b None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:15.918851 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bd645-98b3-4477-b3db-53d822c0819b None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:15.919126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bd645-98b3-4477-b3db-53d822c0819b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:15.940893 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-cf9bd645-98b3-4477-b3db-53d822c0819b None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:15.942856 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-cf9bd645-98b3-4477-b3db-53d822c0819b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:15.952373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1130/2227] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:15.957657 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9bd645-98b3-4477-b3db-53d822c0819b None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:15.957657 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-cf9bd645-98b3-4477-b3db-53d822c0819b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:16.039732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2ac492bb-6924-405b-a539-e2217650d307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0397787b459e45aab7f1250c826d465b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:16.040732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2ac492bb-6924-405b-a539-e2217650d307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0397787b459e45aab7f1250c826d465b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:16.084911 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9bd645-98b3-4477-b3db-53d822c0819b None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:16.088802 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fa73f-b50f-43a7-bcc5-087cfa73d131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:16.089804 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fa73f-b50f-43a7-bcc5-087cfa73d131 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:16.090082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fa73f-b50f-43a7-bcc5-087cfa73d131 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:16.090354 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fa73f-b50f-43a7-bcc5-087cfa73d131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:16.105402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fa73f-b50f-43a7-bcc5-087cfa73d131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:16.107020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fa73f-b50f-43a7-bcc5-087cfa73d131 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:16.118919 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1131/2228] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:16.120493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fa73f-b50f-43a7-bcc5-087cfa73d131 service neutron] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:16.134747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fa73f-b50f-43a7-bcc5-087cfa73d131 service neutron] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:16.142163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce7781-3004-40d9-a078-a0e99416943b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:16.142796 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce7781-3004-40d9-a078-a0e99416943b admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:16.143083 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce7781-3004-40d9-a078-a0e99416943b admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:16.143385 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce7781-3004-40d9-a078-a0e99416943b admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:16.144096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce7781-3004-40d9-a078-a0e99416943b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:47:16.144453 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce7781-3004-40d9-a078-a0e99416943b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:16.146087 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce7781-3004-40d9-a078-a0e99416943b admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:16.164703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1132/2229] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:47:16.170707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2ac492bb-6924-405b-a539-e2217650d307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0397787b459e45aab7f1250c826d465b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:16.172771 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce7781-3004-40d9-a078-a0e99416943b admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:16.190954 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce7781-3004-40d9-a078-a0e99416943b admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:16.195399 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2ac492bb-6924-405b-a539-e2217650d307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0397787b459e45aab7f1250c826d465b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:16.196579 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2ac492bb-6924-405b-a539-e2217650d307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0397787b459e45aab7f1250c826d465b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:16.203575 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3980c0c-ba4a-401c-bafb-2a4477f6d7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:16.204297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3980c0c-ba4a-401c-bafb-2a4477f6d7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:16.204560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3980c0c-ba4a-401c-bafb-2a4477f6d7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:16.204842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3980c0c-ba4a-401c-bafb-2a4477f6d7e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:16.206137 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3980c0c-ba4a-401c-bafb-2a4477f6d7e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:16.208399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3980c0c-ba4a-401c-bafb-2a4477f6d7e8 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:16.219853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1098/2230] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:47:15 2022] DELETE /identity/v3/users/0397787b459e45aab7f1250c826d465b => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:16.266197 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:16.329499 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1133/2231] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:47:16 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:47:16.336736 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac492bb-6924-405b-a539-e2217650d307 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:16.336736 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2ac492bb-6924-405b-a539-e2217650d307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:16.465542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:16.483520 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac492bb-6924-405b-a539-e2217650d307 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:16.569903 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0291bb5-898c-47c7-8300-8ae0fb526f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:16.570541 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0291bb5-898c-47c7-8300-8ae0fb526f5f admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:16.570829 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0291bb5-898c-47c7-8300-8ae0fb526f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:16.571192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0291bb5-898c-47c7-8300-8ae0fb526f5f admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:16.572163 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0291bb5-898c-47c7-8300-8ae0fb526f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:16.574392 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0291bb5-898c-47c7-8300-8ae0fb526f5f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:16.698364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3980c0c-ba4a-401c-bafb-2a4477f6d7e8 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:16.698604 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1099/2232] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:47:16 2022] POST /identity/v3/users => generated 288 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:47:16.733141 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3980c0c-ba4a-401c-bafb-2a4477f6d7e8 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:16.745308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf91df-9c03-4a79-b2a9-e7f3b35cdd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:16.751685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf91df-9c03-4a79-b2a9-e7f3b35cdd6d admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:16.751685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf91df-9c03-4a79-b2a9-e7f3b35cdd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:16.751685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf91df-9c03-4a79-b2a9-e7f3b35cdd6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:16.751685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf91df-9c03-4a79-b2a9-e7f3b35cdd6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:16.754911 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf91df-9c03-4a79-b2a9-e7f3b35cdd6d admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:16.776226 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1134/2233] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:47:16.779178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0291bb5-898c-47c7-8300-8ae0fb526f5f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:16.793160 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0291bb5-898c-47c7-8300-8ae0fb526f5f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:16.799677 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0a87b-9662-45ee-af96-623b7a788c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:16.799677 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0a87b-9662-45ee-af96-623b7a788c9a admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:16.803441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0a87b-9662-45ee-af96-623b7a788c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:16.803441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0a87b-9662-45ee-af96-623b7a788c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:16.804491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0a87b-9662-45ee-af96-623b7a788c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:16.806203 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0a87b-9662-45ee-af96-623b7a788c9a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:16.825103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1100/2234] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:47:16.830319 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf91df-9c03-4a79-b2a9-e7f3b35cdd6d admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:16.873272 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf91df-9c03-4a79-b2a9-e7f3b35cdd6d admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:16.881568 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ab43c-91ef-4e52-a47e-c10a1037ed41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:16.882919 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ab43c-91ef-4e52-a47e-c10a1037ed41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:16.882919 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ab43c-91ef-4e52-a47e-c10a1037ed41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:16.883550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ab43c-91ef-4e52-a47e-c10a1037ed41 admin admin] PATH_INFO: `/v3/projects/6fa3abbcbc4d4ce4af9186860e40abd5/users/1b4f861dbc4f4d4f9c62749d3fef3313/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:16.922619 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ab43c-91ef-4e52-a47e-c10a1037ed41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa3abbcbc4d4ce4af9186860e40abd5, user_id=1b4f861dbc4f4d4f9c62749d3fef3313, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:16.927414 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ab43c-91ef-4e52-a47e-c10a1037ed41 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:17.009320 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0a87b-9662-45ee-af96-623b7a788c9a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:17.012052 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-39a0a87b-9662-45ee-af96-623b7a788c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:17.031866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0a87b-9662-45ee-af96-623b7a788c9a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:17.044029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1135/2235] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:47:16 2022] PUT /identity/v3/projects/6fa3abbcbc4d4ce4af9186860e40abd5/users/1b4f861dbc4f4d4f9c62749d3fef3313/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:17.065466 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a49d5-2c0f-45f9-9af9-07653642d00a None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:17.066709 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a49d5-2c0f-45f9-9af9-07653642d00a None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:17.068047 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a49d5-2c0f-45f9-9af9-07653642d00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:17.148568 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc8bbe-1491-498b-9088-a609e6604634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:17.148568 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc8bbe-1491-498b-9088-a609e6604634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:17.148568 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc8bbe-1491-498b-9088-a609e6604634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:17.148568 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc8bbe-1491-498b-9088-a609e6604634 admin admin] PATH_INFO: `/v3/projects/b5125c2433794f0e8992dc88197ecb8b` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:17.149136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc8bbe-1491-498b-9088-a609e6604634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5125c2433794f0e8992dc88197ecb8b)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:17.149748 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-e35a49d5-2c0f-45f9-9af9-07653642d00a None None] MFA Rules not processed for user `1b4f861dbc4f4d4f9c62749d3fef3313`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:17.150386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc8bbe-1491-498b-9088-a609e6604634 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:17.152482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e35a49d5-2c0f-45f9-9af9-07653642d00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:17.266720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1136/2236] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:17.269425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a49d5-2c0f-45f9-9af9-07653642d00a None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:17.270551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e35a49d5-2c0f-45f9-9af9-07653642d00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:17.285195 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a49d5-2c0f-45f9-9af9-07653642d00a None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:17.291002 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a769f7-be28-48cf-93d3-f016197acdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:17.291730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a769f7-be28-48cf-93d3-f016197acdbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:17.292016 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a769f7-be28-48cf-93d3-f016197acdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:17.292296 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a769f7-be28-48cf-93d3-f016197acdbc admin admin] PATH_INFO: `/v3/projects/bd38d6c84d0f4c9798c7c5b1f2180ca7` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:17.293623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a769f7-be28-48cf-93d3-f016197acdbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd38d6c84d0f4c9798c7c5b1f2180ca7)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:17.295913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a769f7-be28-48cf-93d3-f016197acdbc admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:17.307889 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b4fc8bbe-1491-498b-9088-a609e6604634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5125c2433794f0e8992dc88197ecb8b', 'request_id': 'req-b4fc8bbe-1491-498b-9088-a609e6604634'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:17.313916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b4fc8bbe-1491-498b-9088-a609e6604634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5125c2433794f0e8992dc88197ecb8b', 'request_id': 'req-b4fc8bbe-1491-498b-9088-a609e6604634'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:17.317025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:17.397458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b4fc8bbe-1491-498b-9088-a609e6604634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5125c2433794f0e8992dc88197ecb8b', 'request_id': 'req-b4fc8bbe-1491-498b-9088-a609e6604634'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:17.412605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b4fc8bbe-1491-498b-9088-a609e6604634 admin admin] The token cache is being invalidate because project b5125c2433794f0e8992dc88197ecb8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:47:17.412941 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b4fc8bbe-1491-498b-9088-a609e6604634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:17.413833 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-b4fc8bbe-1491-498b-9088-a609e6604634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:17.419216 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1101/2237] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:47:17 2022] DELETE /identity/v3/projects/b5125c2433794f0e8992dc88197ecb8b => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:47:17.433928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc8bbe-1491-498b-9088-a609e6604634 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:17.433928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b4fc8bbe-1491-498b-9088-a609e6604634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:17.433928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:17.436092 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d0a769f7-be28-48cf-93d3-f016197acdbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd38d6c84d0f4c9798c7c5b1f2180ca7', 'request_id': 'req-d0a769f7-be28-48cf-93d3-f016197acdbc'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:17.445619 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d0a769f7-be28-48cf-93d3-f016197acdbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd38d6c84d0f4c9798c7c5b1f2180ca7', 'request_id': 'req-d0a769f7-be28-48cf-93d3-f016197acdbc'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:17.501442 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc8bbe-1491-498b-9088-a609e6604634 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:17.508240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d0a769f7-be28-48cf-93d3-f016197acdbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd38d6c84d0f4c9798c7c5b1f2180ca7', 'request_id': 'req-d0a769f7-be28-48cf-93d3-f016197acdbc'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:17.543982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d0a769f7-be28-48cf-93d3-f016197acdbc admin admin] The token cache is being invalidate because project bd38d6c84d0f4c9798c7c5b1f2180ca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:47:17.544380 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d0a769f7-be28-48cf-93d3-f016197acdbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:17.545323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d0a769f7-be28-48cf-93d3-f016197acdbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:17.548054 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1137/2238] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:47:17 2022] DELETE /identity/v3/projects/bd38d6c84d0f4c9798c7c5b1f2180ca7 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:17.554533 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49929718-3189-4175-bfb9-5aed0de3d9eb None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:17.554837 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49929718-3189-4175-bfb9-5aed0de3d9eb None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:17.555288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49929718-3189-4175-bfb9-5aed0de3d9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:17.582676 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-49929718-3189-4175-bfb9-5aed0de3d9eb None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:17.584929 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-49929718-3189-4175-bfb9-5aed0de3d9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:17.599746 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd6324-68a4-4864-a56a-86c6261354a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:17.600558 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd6324-68a4-4864-a56a-86c6261354a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:17.600956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd6324-68a4-4864-a56a-86c6261354a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:17.601306 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd6324-68a4-4864-a56a-86c6261354a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:17.603664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-30fd6324-68a4-4864-a56a-86c6261354a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:17.687334 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1138/2239] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:17.696914 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296bfcf-900d-4923-8454-1b46f93f1840 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:17.697210 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296bfcf-900d-4923-8454-1b46f93f1840 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:17.697475 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296bfcf-900d-4923-8454-1b46f93f1840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:17.722297 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd6324-68a4-4864-a56a-86c6261354a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:17.722993 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-9296bfcf-900d-4923-8454-1b46f93f1840 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:17.724383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-9296bfcf-900d-4923-8454-1b46f93f1840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:17.726802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd6324-68a4-4864-a56a-86c6261354a9 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:17.735160 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1139/2240] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:17.744478 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1102/2241] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:17.745757 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296bfcf-900d-4923-8454-1b46f93f1840 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:17.757438 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296bfcf-900d-4923-8454-1b46f93f1840 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:17.764042 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1d2cf-0ad0-4758-99a7-300c4ab1c66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:17.764892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1d2cf-0ad0-4758-99a7-300c4ab1c66b admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:17.765179 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1d2cf-0ad0-4758-99a7-300c4ab1c66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:17.766068 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1d2cf-0ad0-4758-99a7-300c4ab1c66b admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:17.766809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1d2cf-0ad0-4758-99a7-300c4ab1c66b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:47:17.767119 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1d2cf-0ad0-4758-99a7-300c4ab1c66b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:17.770538 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1d2cf-0ad0-4758-99a7-300c4ab1c66b admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:17.791180 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1140/2242] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:47:17.791895 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd6324-68a4-4864-a56a-86c6261354a9 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:17.805128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd6324-68a4-4864-a56a-86c6261354a9 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:17.811203 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a58789-c598-4c51-9721-80d78a78f47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:17.811882 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a58789-c598-4c51-9721-80d78a78f47a admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:17.812171 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a58789-c598-4c51-9721-80d78a78f47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:17.812427 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a58789-c598-4c51-9721-80d78a78f47a admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:17.813192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a58789-c598-4c51-9721-80d78a78f47a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:17.815335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a58789-c598-4c51-9721-80d78a78f47a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:17.820432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1d2cf-0ad0-4758-99a7-300c4ab1c66b admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:17.822321 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5ab1d2cf-0ad0-4758-99a7-300c4ab1c66b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:17.836002 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1d2cf-0ad0-4758-99a7-300c4ab1c66b admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:17.840775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7dd51-4885-47c3-a5a5-7872eebb2c22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:17.841419 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7dd51-4885-47c3-a5a5-7872eebb2c22 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:17.841705 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7dd51-4885-47c3-a5a5-7872eebb2c22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:17.841990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7dd51-4885-47c3-a5a5-7872eebb2c22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:17.844073 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-1eb7dd51-4885-47c3-a5a5-7872eebb2c22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:17.939035 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7dd51-4885-47c3-a5a5-7872eebb2c22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:17.940538 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7dd51-4885-47c3-a5a5-7872eebb2c22 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:17.950184 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1103/2243] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:47:17 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:47:17.951747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1141/2244] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:47:17.954489 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a58789-c598-4c51-9721-80d78a78f47a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:18.020715 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a58789-c598-4c51-9721-80d78a78f47a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:18.028165 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3cc25-3693-4d5c-85bb-e1360c257aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:18.028824 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3cc25-3693-4d5c-85bb-e1360c257aaf admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:18.029092 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3cc25-3693-4d5c-85bb-e1360c257aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:18.029374 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3cc25-3693-4d5c-85bb-e1360c257aaf admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:18.030739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3cc25-3693-4d5c-85bb-e1360c257aaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:18.032080 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3cc25-3693-4d5c-85bb-e1360c257aaf admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:18.130321 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1104/2245] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:47:17 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:47:18.134381 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7dd51-4885-47c3-a5a5-7872eebb2c22 service cinder] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:18.145539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7dd51-4885-47c3-a5a5-7872eebb2c22 service cinder] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:18.150079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ce2e3-fab6-4f61-ac4b-77eaa91f3b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:18.150687 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ce2e3-fab6-4f61-ac4b-77eaa91f3b4d admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:18.150981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ce2e3-fab6-4f61-ac4b-77eaa91f3b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:18.151328 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ce2e3-fab6-4f61-ac4b-77eaa91f3b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:18.155153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ce2e3-fab6-4f61-ac4b-77eaa91f3b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:18.155153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ce2e3-fab6-4f61-ac4b-77eaa91f3b4d admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:18.165729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1142/2246] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:47:18.169074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3cc25-3693-4d5c-85bb-e1360c257aaf admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:18.180652 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3cc25-3693-4d5c-85bb-e1360c257aaf admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:18.186069 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d234c-edc0-4aeb-96c8-489ddcd56acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:18.186763 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d234c-edc0-4aeb-96c8-489ddcd56acf admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:18.187132 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d234c-edc0-4aeb-96c8-489ddcd56acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:18.187593 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d234c-edc0-4aeb-96c8-489ddcd56acf admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:18.188303 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d234c-edc0-4aeb-96c8-489ddcd56acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:18.190144 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d234c-edc0-4aeb-96c8-489ddcd56acf admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:18.200820 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1105/2247] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:47:18.205144 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ce2e3-fab6-4f61-ac4b-77eaa91f3b4d admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:18.216397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ce2e3-fab6-4f61-ac4b-77eaa91f3b4d admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:18.220984 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d156d9-cacd-4e46-bb22-199020298426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:18.221653 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d156d9-cacd-4e46-bb22-199020298426 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:18.221939 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d156d9-cacd-4e46-bb22-199020298426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:18.222217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d156d9-cacd-4e46-bb22-199020298426 admin admin] PATH_INFO: `/v3/projects/75c322da0da44e61bd9da3b50893d901/users/f7dba43ad98f415fb9538fb1ccd08d3d/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:18.226660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:18.238810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d156d9-cacd-4e46-bb22-199020298426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c322da0da44e61bd9da3b50893d901, user_id=f7dba43ad98f415fb9538fb1ccd08d3d, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:18.241545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d156d9-cacd-4e46-bb22-199020298426 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:18.337635 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1143/2248] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:47:18 2022] PUT /identity/v3/projects/75c322da0da44e61bd9da3b50893d901/users/f7dba43ad98f415fb9538fb1ccd08d3d/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:47:18.348208 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca7efb-990f-43cb-8c3c-ef25943249fb None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:18.349297 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca7efb-990f-43cb-8c3c-ef25943249fb None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:18.349297 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca7efb-990f-43cb-8c3c-ef25943249fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:18.400219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-beca7efb-990f-43cb-8c3c-ef25943249fb None None] MFA Rules not processed for user `f7dba43ad98f415fb9538fb1ccd08d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:18.401561 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-beca7efb-990f-43cb-8c3c-ef25943249fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:18.492172 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1106/2249] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:18.504361 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d156d9-cacd-4e46-bb22-199020298426 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:18.506898 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a5d156d9-cacd-4e46-bb22-199020298426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:18.530592 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:18.569251 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d156d9-cacd-4e46-bb22-199020298426 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:18.573137 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8737e4-b333-4236-a113-1ab057e238ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:18.573758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8737e4-b333-4236-a113-1ab057e238ec service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:18.574124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8737e4-b333-4236-a113-1ab057e238ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:18.574377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8737e4-b333-4236-a113-1ab057e238ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:18.585165 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8737e4-b333-4236-a113-1ab057e238ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:18.586614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8737e4-b333-4236-a113-1ab057e238ec service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:18.596011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1144/2250] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:18.616260 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca7efb-990f-43cb-8c3c-ef25943249fb None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:18.680886 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca7efb-990f-43cb-8c3c-ef25943249fb None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:18.685376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c114da-c814-4c85-b7a5-b010de30e97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:18.686017 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c114da-c814-4c85-b7a5-b010de30e97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:18.687021 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c114da-c814-4c85-b7a5-b010de30e97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:18.687341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c114da-c814-4c85-b7a5-b010de30e97e admin admin] PATH_INFO: `/v3/users/f7dba43ad98f415fb9538fb1ccd08d3d` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:18.688721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c114da-c814-4c85-b7a5-b010de30e97e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7dba43ad98f415fb9538fb1ccd08d3d)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:18.690717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c114da-c814-4c85-b7a5-b010de30e97e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:18.927486 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d4c114da-c814-4c85-b7a5-b010de30e97e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7dba43ad98f415fb9538fb1ccd08d3d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:18.928184 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d4c114da-c814-4c85-b7a5-b010de30e97e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7dba43ad98f415fb9538fb1ccd08d3d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:19.039852 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d4c114da-c814-4c85-b7a5-b010de30e97e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7dba43ad98f415fb9538fb1ccd08d3d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:19.057951 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d4c114da-c814-4c85-b7a5-b010de30e97e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7dba43ad98f415fb9538fb1ccd08d3d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:19.058703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d4c114da-c814-4c85-b7a5-b010de30e97e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7dba43ad98f415fb9538fb1ccd08d3d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:19.074096 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1107/2251] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:47:18 2022] DELETE /identity/v3/users/f7dba43ad98f415fb9538fb1ccd08d3d => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:19.078912 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5f17b-6840-4375-82d0-ec6a6a9c74ef None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:19.079411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5f17b-6840-4375-82d0-ec6a6a9c74ef None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:19.079555 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5f17b-6840-4375-82d0-ec6a6a9c74ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:19.099599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-e2f5f17b-6840-4375-82d0-ec6a6a9c74ef None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:19.100822 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e2f5f17b-6840-4375-82d0-ec6a6a9c74ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:19.162886 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1145/2252] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:19.188723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c114da-c814-4c85-b7a5-b010de30e97e admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:19.190090 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d4c114da-c814-4c85-b7a5-b010de30e97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:19.255517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c114da-c814-4c85-b7a5-b010de30e97e admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:19.259514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e82a5-0406-4359-9c05-d7094c1c77ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:19.260148 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e82a5-0406-4359-9c05-d7094c1c77ea service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:19.260601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e82a5-0406-4359-9c05-d7094c1c77ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:19.261973 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e82a5-0406-4359-9c05-d7094c1c77ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:19.273408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e82a5-0406-4359-9c05-d7094c1c77ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:19.274891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e82a5-0406-4359-9c05-d7094c1c77ea service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:19.289192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1108/2253] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:47:19.335543 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:19.506560 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:19.784737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5f17b-6840-4375-82d0-ec6a6a9c74ef None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:19.786844 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e2f5f17b-6840-4375-82d0-ec6a6a9c74ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:19.800145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5f17b-6840-4375-82d0-ec6a6a9c74ef None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:19.806347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af8f7f-ac8b-4561-8c8f-b122ddad2ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:19.806832 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af8f7f-ac8b-4561-8c8f-b122ddad2ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:19.807122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af8f7f-ac8b-4561-8c8f-b122ddad2ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:19.808708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af8f7f-ac8b-4561-8c8f-b122ddad2ff0 admin admin] PATH_INFO: `/v3/projects/75c322da0da44e61bd9da3b50893d901` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:19.810008 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af8f7f-ac8b-4561-8c8f-b122ddad2ff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75c322da0da44e61bd9da3b50893d901)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:19.812160 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af8f7f-ac8b-4561-8c8f-b122ddad2ff0 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:19.982507 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-48af8f7f-ac8b-4561-8c8f-b122ddad2ff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75c322da0da44e61bd9da3b50893d901', 'request_id': 'req-48af8f7f-ac8b-4561-8c8f-b122ddad2ff0'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:19.988185 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-48af8f7f-ac8b-4561-8c8f-b122ddad2ff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75c322da0da44e61bd9da3b50893d901', 'request_id': 'req-48af8f7f-ac8b-4561-8c8f-b122ddad2ff0'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:20.107808 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-48af8f7f-ac8b-4561-8c8f-b122ddad2ff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75c322da0da44e61bd9da3b50893d901', 'request_id': 'req-48af8f7f-ac8b-4561-8c8f-b122ddad2ff0'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:20.123719 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-48af8f7f-ac8b-4561-8c8f-b122ddad2ff0 admin admin] The token cache is being invalidate because project 75c322da0da44e61bd9da3b50893d901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:47:20.124430 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-48af8f7f-ac8b-4561-8c8f-b122ddad2ff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:20.125613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-48af8f7f-ac8b-4561-8c8f-b122ddad2ff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:20.134865 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1146/2254] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:47:19 2022] DELETE /identity/v3/projects/75c322da0da44e61bd9da3b50893d901 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:20.139527 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a16b33-f53c-4f82-99f5-f6748eaaed0d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:20.140074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a16b33-f53c-4f82-99f5-f6748eaaed0d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:20.140627 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a16b33-f53c-4f82-99f5-f6748eaaed0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:20.162498 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-22a16b33-f53c-4f82-99f5-f6748eaaed0d None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:20.163744 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-22a16b33-f53c-4f82-99f5-f6748eaaed0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:20.232741 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1109/2255] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:20.242600 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28056cea-0d05-4dbb-af6b-c78af157d79b None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:20.242993 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28056cea-0d05-4dbb-af6b-c78af157d79b None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:20.244011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28056cea-0d05-4dbb-af6b-c78af157d79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:20.267334 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-28056cea-0d05-4dbb-af6b-c78af157d79b None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:20.268573 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-28056cea-0d05-4dbb-af6b-c78af157d79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:20.277599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1147/2256] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:20.282182 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a16b33-f53c-4f82-99f5-f6748eaaed0d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:20.292735 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a16b33-f53c-4f82-99f5-f6748eaaed0d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:20.297640 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38592ea4-44a0-4345-b55b-caa16e06bdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:20.298274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38592ea4-44a0-4345-b55b-caa16e06bdcd admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:20.298736 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38592ea4-44a0-4345-b55b-caa16e06bdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:20.299180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38592ea4-44a0-4345-b55b-caa16e06bdcd admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:20.300197 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38592ea4-44a0-4345-b55b-caa16e06bdcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:47:20.300651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38592ea4-44a0-4345-b55b-caa16e06bdcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:20.307414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38592ea4-44a0-4345-b55b-caa16e06bdcd admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:20.326038 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1110/2257] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:47:20.327400 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28056cea-0d05-4dbb-af6b-c78af157d79b None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:20.338177 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:20.351316 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28056cea-0d05-4dbb-af6b-c78af157d79b None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:20.357087 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752fc0a0-3709-4c48-a61d-c6f0c8c1ac97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:20.357821 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fc0a0-3709-4c48-a61d-c6f0c8c1ac97 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:20.358109 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fc0a0-3709-4c48-a61d-c6f0c8c1ac97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:20.358426 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fc0a0-3709-4c48-a61d-c6f0c8c1ac97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:20.359055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752fc0a0-3709-4c48-a61d-c6f0c8c1ac97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:20.361765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752fc0a0-3709-4c48-a61d-c6f0c8c1ac97 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:20.452235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1148/2258] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:47:20 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:47:20.456487 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38592ea4-44a0-4345-b55b-caa16e06bdcd admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:20.467623 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38592ea4-44a0-4345-b55b-caa16e06bdcd admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:20.528171 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7634f-6531-4723-ab64-b16e3d07607b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:20.528885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7634f-6531-4723-ab64-b16e3d07607b admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:20.529223 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7634f-6531-4723-ab64-b16e3d07607b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:20.532399 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7634f-6531-4723-ab64-b16e3d07607b admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:20.532399 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7634f-6531-4723-ab64-b16e3d07607b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:20.532399 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7634f-6531-4723-ab64-b16e3d07607b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:20.651067 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1111/2259] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:47:20 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:47:20.655380 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752fc0a0-3709-4c48-a61d-c6f0c8c1ac97 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:20.666513 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752fc0a0-3709-4c48-a61d-c6f0c8c1ac97 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:20.672121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644d1a3-5f7e-422d-86d2-7eec6ab98285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:20.672739 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644d1a3-5f7e-422d-86d2-7eec6ab98285 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:20.673022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644d1a3-5f7e-422d-86d2-7eec6ab98285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:20.673301 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644d1a3-5f7e-422d-86d2-7eec6ab98285 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:20.673995 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644d1a3-5f7e-422d-86d2-7eec6ab98285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:20.675681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644d1a3-5f7e-422d-86d2-7eec6ab98285 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:20.687028 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1149/2260] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:47:20.692956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7634f-6531-4723-ab64-b16e3d07607b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:20.698251 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:20.704018 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7634f-6531-4723-ab64-b16e3d07607b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:20.709183 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3a924-3d0e-4273-ae0a-f976fa0f3aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:20.710113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3a924-3d0e-4273-ae0a-f976fa0f3aee admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:20.710354 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3a924-3d0e-4273-ae0a-f976fa0f3aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:20.710881 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3a924-3d0e-4273-ae0a-f976fa0f3aee admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:20.711424 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3a924-3d0e-4273-ae0a-f976fa0f3aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:20.713036 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3a924-3d0e-4273-ae0a-f976fa0f3aee admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:20.725724 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1112/2261] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:47:20.730001 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644d1a3-5f7e-422d-86d2-7eec6ab98285 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:20.741123 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644d1a3-5f7e-422d-86d2-7eec6ab98285 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:20.745778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea65040-9def-4215-bc6d-ca0786f52596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:20.746957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea65040-9def-4215-bc6d-ca0786f52596 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:20.746957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea65040-9def-4215-bc6d-ca0786f52596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:20.747176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea65040-9def-4215-bc6d-ca0786f52596 admin admin] PATH_INFO: `/v3/projects/dfee7aa176774a38bb2be09dd00e7bd6/users/d1c14fed33ef4a89818d81fc391e8bb5/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:20.764825 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea65040-9def-4215-bc6d-ca0786f52596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfee7aa176774a38bb2be09dd00e7bd6, user_id=d1c14fed33ef4a89818d81fc391e8bb5, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:20.767562 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea65040-9def-4215-bc6d-ca0786f52596 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:20.866247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1150/2262] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:47:20 2022] PUT /identity/v3/projects/dfee7aa176774a38bb2be09dd00e7bd6/users/d1c14fed33ef4a89818d81fc391e8bb5/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:47:20.882048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9638c6e-b326-43ff-966b-57af375e6f44 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:20.882581 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9638c6e-b326-43ff-966b-57af375e6f44 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:20.882960 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9638c6e-b326-43ff-966b-57af375e6f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:20.913263 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c9638c6e-b326-43ff-966b-57af375e6f44 None None] MFA Rules not processed for user `d1c14fed33ef4a89818d81fc391e8bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:20.914559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c9638c6e-b326-43ff-966b-57af375e6f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:20.986439 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1113/2263] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:20.997011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea65040-9def-4215-bc6d-ca0786f52596 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:20.998793 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-6ea65040-9def-4215-bc6d-ca0786f52596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:21.061325 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea65040-9def-4215-bc6d-ca0786f52596 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:21.065364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c75f5-7549-45e7-bb45-58b47bf2c882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:21.065672 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c75f5-7549-45e7-bb45-58b47bf2c882 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:21.066297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c75f5-7549-45e7-bb45-58b47bf2c882 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:21.066297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c75f5-7549-45e7-bb45-58b47bf2c882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:21.075494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c75f5-7549-45e7-bb45-58b47bf2c882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:21.076937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c75f5-7549-45e7-bb45-58b47bf2c882 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:21.086487 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1151/2264] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:23.213527 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9638c6e-b326-43ff-966b-57af375e6f44 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:23.215171 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c9638c6e-b326-43ff-966b-57af375e6f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:23.291565 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9638c6e-b326-43ff-966b-57af375e6f44 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:23.296506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b38e1-7b74-4208-9dbc-485fd4f44782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:23.297182 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b38e1-7b74-4208-9dbc-485fd4f44782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:23.297467 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b38e1-7b74-4208-9dbc-485fd4f44782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:23.297749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b38e1-7b74-4208-9dbc-485fd4f44782 admin admin] PATH_INFO: `/v3/users/189b3fd531be4a1e8523dea037ca0b0b` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:23.299030 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b38e1-7b74-4208-9dbc-485fd4f44782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=189b3fd531be4a1e8523dea037ca0b0b)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:23.301688 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b38e1-7b74-4208-9dbc-485fd4f44782 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:23.520608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-a65b38e1-7b74-4208-9dbc-485fd4f44782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '189b3fd531be4a1e8523dea037ca0b0b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:23.521269 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-a65b38e1-7b74-4208-9dbc-485fd4f44782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '189b3fd531be4a1e8523dea037ca0b0b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:23.587319 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-a65b38e1-7b74-4208-9dbc-485fd4f44782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '189b3fd531be4a1e8523dea037ca0b0b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:23.606028 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-a65b38e1-7b74-4208-9dbc-485fd4f44782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '189b3fd531be4a1e8523dea037ca0b0b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:23.607035 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-a65b38e1-7b74-4208-9dbc-485fd4f44782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '189b3fd531be4a1e8523dea037ca0b0b'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:23.621090 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:23.633353 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1114/2265] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:47:23 2022] DELETE /identity/v3/users/189b3fd531be4a1e8523dea037ca0b0b => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:23.637633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab28fc-acdc-4704-8f17-5a675fd65a1b None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:23.638119 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab28fc-acdc-4704-8f17-5a675fd65a1b None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:23.638237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab28fc-acdc-4704-8f17-5a675fd65a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:23.659418 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-56ab28fc-acdc-4704-8f17-5a675fd65a1b None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:23.661042 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-56ab28fc-acdc-4704-8f17-5a675fd65a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:23.735574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1152/2266] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:23.746017 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b38e1-7b74-4208-9dbc-485fd4f44782 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:23.747706 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a65b38e1-7b74-4208-9dbc-485fd4f44782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:23.820160 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b38e1-7b74-4208-9dbc-485fd4f44782 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:23.825670 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06081a7-1151-4895-8d8d-4457dc05c7d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:23.826541 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06081a7-1151-4895-8d8d-4457dc05c7d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:23.826768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06081a7-1151-4895-8d8d-4457dc05c7d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:23.831601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06081a7-1151-4895-8d8d-4457dc05c7d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:23.838405 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06081a7-1151-4895-8d8d-4457dc05c7d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:23.839949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06081a7-1151-4895-8d8d-4457dc05c7d6 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:23.851653 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1115/2267] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:24.429246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab28fc-acdc-4704-8f17-5a675fd65a1b None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:24.431250 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-56ab28fc-acdc-4704-8f17-5a675fd65a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:24.452313 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab28fc-acdc-4704-8f17-5a675fd65a1b None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:24.462047 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d6b33-e83f-4e2a-993e-9bf34b8d5580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:24.463679 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d6b33-e83f-4e2a-993e-9bf34b8d5580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:24.463923 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d6b33-e83f-4e2a-993e-9bf34b8d5580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:24.464593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d6b33-e83f-4e2a-993e-9bf34b8d5580 admin admin] PATH_INFO: `/v3/projects/4f2279b260664781a7bba8dd27495eb8` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:24.465735 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d6b33-e83f-4e2a-993e-9bf34b8d5580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2279b260664781a7bba8dd27495eb8)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:24.467899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d6b33-e83f-4e2a-993e-9bf34b8d5580 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:24.624682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:24.635955 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-091d6b33-e83f-4e2a-993e-9bf34b8d5580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2279b260664781a7bba8dd27495eb8', 'request_id': 'req-091d6b33-e83f-4e2a-993e-9bf34b8d5580'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:24.644845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-091d6b33-e83f-4e2a-993e-9bf34b8d5580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2279b260664781a7bba8dd27495eb8', 'request_id': 'req-091d6b33-e83f-4e2a-993e-9bf34b8d5580'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:24.747160 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-091d6b33-e83f-4e2a-993e-9bf34b8d5580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2279b260664781a7bba8dd27495eb8', 'request_id': 'req-091d6b33-e83f-4e2a-993e-9bf34b8d5580'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:24.759514 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-091d6b33-e83f-4e2a-993e-9bf34b8d5580 admin admin] The token cache is being invalidate because project 4f2279b260664781a7bba8dd27495eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:47:24.759806 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-091d6b33-e83f-4e2a-993e-9bf34b8d5580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:24.760465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-091d6b33-e83f-4e2a-993e-9bf34b8d5580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:24.762057 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1153/2268] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:47:24 2022] DELETE /identity/v3/projects/4f2279b260664781a7bba8dd27495eb8 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:24.766313 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06081a7-1151-4895-8d8d-4457dc05c7d6 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:24.776798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06081a7-1151-4895-8d8d-4457dc05c7d6 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:24.808386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb073497-80cc-48e6-897a-e0557780d218 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:24.808596 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb073497-80cc-48e6-897a-e0557780d218 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:24.808877 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb073497-80cc-48e6-897a-e0557780d218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:24.830559 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-bb073497-80cc-48e6-897a-e0557780d218 None None] MFA Rules not processed for user `b05240b3f0bf40789d476e4bdad8bea0`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:24.831838 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-bb073497-80cc-48e6-897a-e0557780d218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:24.841620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2943c-3f71-42ea-b9d1-3624bfb16c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:24.842262 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2943c-3f71-42ea-b9d1-3624bfb16c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:24.842547 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2943c-3f71-42ea-b9d1-3624bfb16c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:24.842816 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2943c-3f71-42ea-b9d1-3624bfb16c9d admin admin] PATH_INFO: `/v3/users/26a685bf60de4fb687f25d67714dfbd1` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:24.844090 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2943c-3f71-42ea-b9d1-3624bfb16c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=26a685bf60de4fb687f25d67714dfbd1)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:24.846078 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2943c-3f71-42ea-b9d1-3624bfb16c9d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:24.889425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1154/2269] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:47:25.164937 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cbb2943c-3f71-42ea-b9d1-3624bfb16c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26a685bf60de4fb687f25d67714dfbd1'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:25.165648 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cbb2943c-3f71-42ea-b9d1-3624bfb16c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26a685bf60de4fb687f25d67714dfbd1'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:25.290274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cbb2943c-3f71-42ea-b9d1-3624bfb16c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26a685bf60de4fb687f25d67714dfbd1'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:25.314220 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cbb2943c-3f71-42ea-b9d1-3624bfb16c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26a685bf60de4fb687f25d67714dfbd1'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:25.315137 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cbb2943c-3f71-42ea-b9d1-3624bfb16c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26a685bf60de4fb687f25d67714dfbd1'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:25.340343 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1116/2270] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:47:24 2022] DELETE /identity/v3/users/26a685bf60de4fb687f25d67714dfbd1 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:25.746746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb073497-80cc-48e6-897a-e0557780d218 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:25.747209 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-bb073497-80cc-48e6-897a-e0557780d218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:25.763709 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb073497-80cc-48e6-897a-e0557780d218 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:25.837497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2943c-3f71-42ea-b9d1-3624bfb16c9d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:25.839581 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cbb2943c-3f71-42ea-b9d1-3624bfb16c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:25.845254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb90aa-ec7e-4fc0-b923-1aff7b004398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:25.850178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb90aa-ec7e-4fc0-b923-1aff7b004398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:25.850178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb90aa-ec7e-4fc0-b923-1aff7b004398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:25.850178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb90aa-ec7e-4fc0-b923-1aff7b004398 admin admin] PATH_INFO: `/v3/users/d1c14fed33ef4a89818d81fc391e8bb5` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:25.850178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb90aa-ec7e-4fc0-b923-1aff7b004398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c14fed33ef4a89818d81fc391e8bb5)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:25.850178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb90aa-ec7e-4fc0-b923-1aff7b004398 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:25.865511 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2943c-3f71-42ea-b9d1-3624bfb16c9d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:25.878447 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c8bfb-adf3-41c6-a734-4fe607bf65ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:25.880232 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c8bfb-adf3-41c6-a734-4fe607bf65ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:25.880862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c8bfb-adf3-41c6-a734-4fe607bf65ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:25.881293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c8bfb-adf3-41c6-a734-4fe607bf65ff admin admin] PATH_INFO: `/v3/projects/a6181ad03d3d4fb6b95361da91c6aa3a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:25.882879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c8bfb-adf3-41c6-a734-4fe607bf65ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6181ad03d3d4fb6b95361da91c6aa3a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:25.885045 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c8bfb-adf3-41c6-a734-4fe607bf65ff admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:25.904117 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:26.058254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ffcb90aa-ec7e-4fc0-b923-1aff7b004398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c14fed33ef4a89818d81fc391e8bb5'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:26.059715 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ffcb90aa-ec7e-4fc0-b923-1aff7b004398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c14fed33ef4a89818d81fc391e8bb5'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:26.074166 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ee4c8bfb-adf3-41c6-a734-4fe607bf65ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6181ad03d3d4fb6b95361da91c6aa3a', 'request_id': 'req-ee4c8bfb-adf3-41c6-a734-4fe607bf65ff'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:26.083044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ee4c8bfb-adf3-41c6-a734-4fe607bf65ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6181ad03d3d4fb6b95361da91c6aa3a', 'request_id': 'req-ee4c8bfb-adf3-41c6-a734-4fe607bf65ff'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:26.170228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ffcb90aa-ec7e-4fc0-b923-1aff7b004398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c14fed33ef4a89818d81fc391e8bb5'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:26.188775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ffcb90aa-ec7e-4fc0-b923-1aff7b004398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c14fed33ef4a89818d81fc391e8bb5'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:26.197945 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ffcb90aa-ec7e-4fc0-b923-1aff7b004398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c14fed33ef4a89818d81fc391e8bb5'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:26.204597 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1155/2271] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:47:25 2022] DELETE /identity/v3/users/d1c14fed33ef4a89818d81fc391e8bb5 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:26.211475 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba52b7-d9be-4d80-bc83-ac102300b0aa None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:26.211765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba52b7-d9be-4d80-bc83-ac102300b0aa None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:26.212042 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba52b7-d9be-4d80-bc83-ac102300b0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:26.238301 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-caba52b7-d9be-4d80-bc83-ac102300b0aa None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:26.238584 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ee4c8bfb-adf3-41c6-a734-4fe607bf65ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6181ad03d3d4fb6b95361da91c6aa3a', 'request_id': 'req-ee4c8bfb-adf3-41c6-a734-4fe607bf65ff'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:26.239570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-caba52b7-d9be-4d80-bc83-ac102300b0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:26.257562 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ee4c8bfb-adf3-41c6-a734-4fe607bf65ff admin admin] The token cache is being invalidate because project a6181ad03d3d4fb6b95361da91c6aa3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:47:26.258106 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ee4c8bfb-adf3-41c6-a734-4fe607bf65ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:26.258974 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ee4c8bfb-adf3-41c6-a734-4fe607bf65ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:26.261253 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1117/2272] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:47:25 2022] DELETE /identity/v3/projects/a6181ad03d3d4fb6b95361da91c6aa3a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:47:26.265862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c8bfb-adf3-41c6-a734-4fe607bf65ff admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:26.267416 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ee4c8bfb-adf3-41c6-a734-4fe607bf65ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:26.320483 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1156/2273] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:47:26.342063 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba52b7-d9be-4d80-bc83-ac102300b0aa None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:26.348635 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-caba52b7-d9be-4d80-bc83-ac102300b0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:26.376519 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c8bfb-adf3-41c6-a734-4fe607bf65ff admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:26.383378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd87095-be51-4be9-9005-309a936db680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:26.384140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd87095-be51-4be9-9005-309a936db680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:26.384501 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd87095-be51-4be9-9005-309a936db680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:26.384860 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd87095-be51-4be9-9005-309a936db680 admin admin] PATH_INFO: `/v3/users/7891c23f0f034f1f98275ab2aaf92254` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:26.386388 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd87095-be51-4be9-9005-309a936db680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7891c23f0f034f1f98275ab2aaf92254)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:26.388841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd87095-be51-4be9-9005-309a936db680 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:26.389221 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:26.561105 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba52b7-d9be-4d80-bc83-ac102300b0aa None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:26.564920 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322e950-436a-4a16-9b86-a58bc0001d94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:26.565543 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322e950-436a-4a16-9b86-a58bc0001d94 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:26.565824 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322e950-436a-4a16-9b86-a58bc0001d94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:26.566104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322e950-436a-4a16-9b86-a58bc0001d94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:26.576503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322e950-436a-4a16-9b86-a58bc0001d94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:26.578084 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322e950-436a-4a16-9b86-a58bc0001d94 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:26.589476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1157/2274] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:26.681307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2cd87095-be51-4be9-9005-309a936db680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7891c23f0f034f1f98275ab2aaf92254'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:26.684596 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2cd87095-be51-4be9-9005-309a936db680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7891c23f0f034f1f98275ab2aaf92254'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:26.753835 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2cd87095-be51-4be9-9005-309a936db680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7891c23f0f034f1f98275ab2aaf92254'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:26.767357 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2cd87095-be51-4be9-9005-309a936db680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7891c23f0f034f1f98275ab2aaf92254'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:26.768068 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2cd87095-be51-4be9-9005-309a936db680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7891c23f0f034f1f98275ab2aaf92254'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:26.781334 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1118/2275] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:47:26 2022] DELETE /identity/v3/users/7891c23f0f034f1f98275ab2aaf92254 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:27.157502 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322e950-436a-4a16-9b86-a58bc0001d94 service neutron] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:27.159511 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2322e950-436a-4a16-9b86-a58bc0001d94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:27.173125 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322e950-436a-4a16-9b86-a58bc0001d94 service neutron] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:27.271692 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e6cc2-1c15-4674-9cca-46affe613983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:27.272641 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e6cc2-1c15-4674-9cca-46affe613983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:27.272997 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e6cc2-1c15-4674-9cca-46affe613983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:27.273340 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e6cc2-1c15-4674-9cca-46affe613983 admin admin] PATH_INFO: `/v3/projects/dfee7aa176774a38bb2be09dd00e7bd6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:27.274979 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e6cc2-1c15-4674-9cca-46affe613983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfee7aa176774a38bb2be09dd00e7bd6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:27.277009 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e6cc2-1c15-4674-9cca-46affe613983 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:27.315002 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd87095-be51-4be9-9005-309a936db680 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:27.317274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2cd87095-be51-4be9-9005-309a936db680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:27.357730 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd87095-be51-4be9-9005-309a936db680 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:27.365085 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472abbd-3528-41de-a9a9-a8ebdb371183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:27.368635 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472abbd-3528-41de-a9a9-a8ebdb371183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:27.368635 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472abbd-3528-41de-a9a9-a8ebdb371183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:27.368635 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472abbd-3528-41de-a9a9-a8ebdb371183 admin admin] PATH_INFO: `/v3/projects/bcb5798c7ade4aa099779ee02557e683` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:27.368635 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472abbd-3528-41de-a9a9-a8ebdb371183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb5798c7ade4aa099779ee02557e683)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:27.370736 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472abbd-3528-41de-a9a9-a8ebdb371183 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:27.451774 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-1d1e6cc2-1c15-4674-9cca-46affe613983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfee7aa176774a38bb2be09dd00e7bd6', 'request_id': 'req-1d1e6cc2-1c15-4674-9cca-46affe613983'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:27.458488 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-1d1e6cc2-1c15-4674-9cca-46affe613983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfee7aa176774a38bb2be09dd00e7bd6', 'request_id': 'req-1d1e6cc2-1c15-4674-9cca-46affe613983'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:27.513785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d472abbd-3528-41de-a9a9-a8ebdb371183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb5798c7ade4aa099779ee02557e683', 'request_id': 'req-d472abbd-3528-41de-a9a9-a8ebdb371183'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:27.527710 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d472abbd-3528-41de-a9a9-a8ebdb371183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb5798c7ade4aa099779ee02557e683', 'request_id': 'req-d472abbd-3528-41de-a9a9-a8ebdb371183'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:27.547089 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-1d1e6cc2-1c15-4674-9cca-46affe613983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfee7aa176774a38bb2be09dd00e7bd6', 'request_id': 'req-1d1e6cc2-1c15-4674-9cca-46affe613983'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:27.555705 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:27.579245 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-1d1e6cc2-1c15-4674-9cca-46affe613983 admin admin] The token cache is being invalidate because project dfee7aa176774a38bb2be09dd00e7bd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:47:27.579617 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-1d1e6cc2-1c15-4674-9cca-46affe613983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:27.581062 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-1d1e6cc2-1c15-4674-9cca-46affe613983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:27.583316 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1158/2276] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:47:27 2022] DELETE /identity/v3/projects/dfee7aa176774a38bb2be09dd00e7bd6 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:27.588347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102b4af-ff7d-4d50-a6e7-771a5eebe994 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:27.588808 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102b4af-ff7d-4d50-a6e7-771a5eebe994 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:27.588990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102b4af-ff7d-4d50-a6e7-771a5eebe994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:27.618551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-0102b4af-ff7d-4d50-a6e7-771a5eebe994 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:27.620022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-0102b4af-ff7d-4d50-a6e7-771a5eebe994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:27.647728 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d472abbd-3528-41de-a9a9-a8ebdb371183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb5798c7ade4aa099779ee02557e683', 'request_id': 'req-d472abbd-3528-41de-a9a9-a8ebdb371183'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:27.664306 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d472abbd-3528-41de-a9a9-a8ebdb371183 admin admin] The token cache is being invalidate because project bcb5798c7ade4aa099779ee02557e683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:47:27.664608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d472abbd-3528-41de-a9a9-a8ebdb371183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:27.676723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-d472abbd-3528-41de-a9a9-a8ebdb371183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:27.684778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1119/2277] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:47:27 2022] DELETE /identity/v3/projects/bcb5798c7ade4aa099779ee02557e683 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:47:27.689997 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9ab0d-bf1c-4bea-8bd3-d81d3ff97b5b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:27.693033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9ab0d-bf1c-4bea-8bd3-d81d3ff97b5b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:27.693033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9ab0d-bf1c-4bea-8bd3-d81d3ff97b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:27.705061 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1159/2278] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:47:27.713445 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffec265-e909-47ac-a8ce-089b181d5476 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:27.713731 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffec265-e909-47ac-a8ce-089b181d5476 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:27.714012 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffec265-e909-47ac-a8ce-089b181d5476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:27.723197 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-e4f9ab0d-bf1c-4bea-8bd3-d81d3ff97b5b None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:27.725537 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e4f9ab0d-bf1c-4bea-8bd3-d81d3ff97b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:27.735342 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-8ffec265-e909-47ac-a8ce-089b181d5476 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:27.736024 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1120/2279] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:27.741822 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-8ffec265-e909-47ac-a8ce-089b181d5476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:27.746602 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28acde9-1392-4e81-b53e-9285919882d8 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:27.754634 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28acde9-1392-4e81-b53e-9285919882d8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:27.754634 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28acde9-1392-4e81-b53e-9285919882d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:27.756190 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1160/2280] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:27.758313 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e8c63-102a-4aeb-8bba-b6a617d55f85 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:27.758738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e8c63-102a-4aeb-8bba-b6a617d55f85 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:27.758883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e8c63-102a-4aeb-8bba-b6a617d55f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:27.775074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f28acde9-1392-4e81-b53e-9285919882d8 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:27.776393 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f28acde9-1392-4e81-b53e-9285919882d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:27.779921 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-e18e8c63-102a-4aeb-8bba-b6a617d55f85 None None] MFA Rules not processed for user `5b4c4184e87b4dc5a4047310cd0122ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:27.781170 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e18e8c63-102a-4aeb-8bba-b6a617d55f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:27.786714 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1121/2281] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:27.786714 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28acde9-1392-4e81-b53e-9285919882d8 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:27.799200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28acde9-1392-4e81-b53e-9285919882d8 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:27.804972 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65d522-397f-4b35-9d8b-5e218ca03811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:27.805591 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65d522-397f-4b35-9d8b-5e218ca03811 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:27.806001 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65d522-397f-4b35-9d8b-5e218ca03811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:27.806277 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65d522-397f-4b35-9d8b-5e218ca03811 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:27.806853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65d522-397f-4b35-9d8b-5e218ca03811 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:47:27.807161 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65d522-397f-4b35-9d8b-5e218ca03811 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:27.809045 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65d522-397f-4b35-9d8b-5e218ca03811 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:27.821504 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1122/2282] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:47:27.822353 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65d522-397f-4b35-9d8b-5e218ca03811 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:27.837631 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65d522-397f-4b35-9d8b-5e218ca03811 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:27.843790 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40293e4e-698d-4ec5-8d46-36da238742f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:27.844531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40293e4e-698d-4ec5-8d46-36da238742f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:27.844769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40293e4e-698d-4ec5-8d46-36da238742f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:27.845054 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40293e4e-698d-4ec5-8d46-36da238742f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:27.846570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40293e4e-698d-4ec5-8d46-36da238742f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:47:27.846896 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40293e4e-698d-4ec5-8d46-36da238742f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:27.849438 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40293e4e-698d-4ec5-8d46-36da238742f8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:27.855708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1161/2283] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 18:47:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:27.857126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e8c63-102a-4aeb-8bba-b6a617d55f85 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:27.865076 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1123/2284] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:47:27.869025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:27.870751 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40293e4e-698d-4ec5-8d46-36da238742f8 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:27.880713 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e8c63-102a-4aeb-8bba-b6a617d55f85 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:27.885859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40293e4e-698d-4ec5-8d46-36da238742f8 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:27.890698 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde9425-6c0f-4ce6-8171-d14ecbe6d187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:27.891525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde9425-6c0f-4ce6-8171-d14ecbe6d187 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:27.891836 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde9425-6c0f-4ce6-8171-d14ecbe6d187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:27.891957 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aed94e-2d4f-46ca-bb79-8abad53b18b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:27.892168 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde9425-6c0f-4ce6-8171-d14ecbe6d187 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:27.893151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aed94e-2d4f-46ca-bb79-8abad53b18b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:27.893231 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde9425-6c0f-4ce6-8171-d14ecbe6d187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:27.893304 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aed94e-2d4f-46ca-bb79-8abad53b18b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:27.893304 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aed94e-2d4f-46ca-bb79-8abad53b18b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:27.894272 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aed94e-2d4f-46ca-bb79-8abad53b18b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:27.895643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde9425-6c0f-4ce6-8171-d14ecbe6d187 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:27.896912 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aed94e-2d4f-46ca-bb79-8abad53b18b2 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:28.007106 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1124/2285] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:47:27 2022] POST /identity/v3/projects => generated 363 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:47:28.011065 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde9425-6c0f-4ce6-8171-d14ecbe6d187 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:28.012786 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8cde9425-6c0f-4ce6-8171-d14ecbe6d187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:28.046568 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1162/2286] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:47:27 2022] POST /identity/v3/projects => generated 375 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:47:28.047553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aed94e-2d4f-46ca-bb79-8abad53b18b2 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:28.109510 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde9425-6c0f-4ce6-8171-d14ecbe6d187 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:28.143523 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aed94e-2d4f-46ca-bb79-8abad53b18b2 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:28.150535 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcebe6-e6c8-4880-934f-2e7b29106223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:28.151691 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcebe6-e6c8-4880-934f-2e7b29106223 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:28.152111 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcebe6-e6c8-4880-934f-2e7b29106223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:28.152394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcebe6-e6c8-4880-934f-2e7b29106223 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:28.153073 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fcebe6-e6c8-4880-934f-2e7b29106223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:28.155048 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fcebe6-e6c8-4880-934f-2e7b29106223 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:28.182764 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b4f1c-c0a9-40ee-9ef8-5527da181d4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7832398e97af4e539e10d1eef49f6d6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:28.185502 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b4f1c-c0a9-40ee-9ef8-5527da181d4b service swift] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:28.185502 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b4f1c-c0a9-40ee-9ef8-5527da181d4b service swift] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:28.185502 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b4f1c-c0a9-40ee-9ef8-5527da181d4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:28.243397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b4f1c-c0a9-40ee-9ef8-5527da181d4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:28.245087 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b4f1c-c0a9-40ee-9ef8-5527da181d4b service swift] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:28.253549 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1125/2287] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 18:47:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:47:28.255475 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b4f1c-c0a9-40ee-9ef8-5527da181d4b service swift] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:28.265804 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b4f1c-c0a9-40ee-9ef8-5527da181d4b service swift] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:28.271839 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0695b-8926-43e4-a7fd-bf209c35b56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:28.271839 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0695b-8926-43e4-a7fd-bf209c35b56f admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:28.272143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0695b-8926-43e4-a7fd-bf209c35b56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:28.272426 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0695b-8926-43e4-a7fd-bf209c35b56f admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:28.273095 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0695b-8926-43e4-a7fd-bf209c35b56f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:28.275099 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0695b-8926-43e4-a7fd-bf209c35b56f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:28.325495 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1163/2288] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:47:28 2022] POST /identity/v3/users => generated 282 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:47:28.329125 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcebe6-e6c8-4880-934f-2e7b29106223 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:28.354747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcebe6-e6c8-4880-934f-2e7b29106223 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:28.365444 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd18c0e-548c-49a8-8dc5-b498a0e28c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:28.368088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd18c0e-548c-49a8-8dc5-b498a0e28c3a admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:28.368541 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd18c0e-548c-49a8-8dc5-b498a0e28c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:28.369057 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd18c0e-548c-49a8-8dc5-b498a0e28c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:28.370061 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd18c0e-548c-49a8-8dc5-b498a0e28c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:28.371970 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd18c0e-548c-49a8-8dc5-b498a0e28c3a admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:28.385636 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1164/2289] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:47:28.391576 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd18c0e-548c-49a8-8dc5-b498a0e28c3a admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:28.403949 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd18c0e-548c-49a8-8dc5-b498a0e28c3a admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:28.420197 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d524c-d2f6-4980-8d3c-ff9931a165f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:28.420197 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d524c-d2f6-4980-8d3c-ff9931a165f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:28.420197 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d524c-d2f6-4980-8d3c-ff9931a165f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:28.420197 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d524c-d2f6-4980-8d3c-ff9931a165f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:28.421805 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d524c-d2f6-4980-8d3c-ff9931a165f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:28.421903 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1126/2290] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:47:28 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:47:28.422268 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d524c-d2f6-4980-8d3c-ff9931a165f6 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:28.423704 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0695b-8926-43e4-a7fd-bf209c35b56f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:28.435827 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0695b-8926-43e4-a7fd-bf209c35b56f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:28.451140 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1165/2291] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:47:28.453919 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d524c-d2f6-4980-8d3c-ff9931a165f6 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:28.473637 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d524c-d2f6-4980-8d3c-ff9931a165f6 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:28.477817 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca982edd-b89c-4fe4-a7e0-42ce803c7714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:28.483339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663564d6-324d-4b2c-a305-2fa41bc4d57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:28.483564 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca982edd-b89c-4fe4-a7e0-42ce803c7714 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:28.483956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca982edd-b89c-4fe4-a7e0-42ce803c7714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:28.484336 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca982edd-b89c-4fe4-a7e0-42ce803c7714 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:28.484797 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663564d6-324d-4b2c-a305-2fa41bc4d57f admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:28.485088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663564d6-324d-4b2c-a305-2fa41bc4d57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:28.485378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca982edd-b89c-4fe4-a7e0-42ce803c7714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:28.485875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663564d6-324d-4b2c-a305-2fa41bc4d57f admin admin] PATH_INFO: `/v3/projects/af66809545404dcc9b5339641d347751/users/6c18bb849735414b88dafa46d0ddb597/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:28.493133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca982edd-b89c-4fe4-a7e0-42ce803c7714 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:28.522817 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663564d6-324d-4b2c-a305-2fa41bc4d57f admin admin] RBAC: Authorizing `identity:create_grant(project_id=af66809545404dcc9b5339641d347751, user_id=6c18bb849735414b88dafa46d0ddb597, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:28.527991 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1127/2292] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:47:28.528157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663564d6-324d-4b2c-a305-2fa41bc4d57f admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:28.529208 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca982edd-b89c-4fe4-a7e0-42ce803c7714 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:28.554079 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca982edd-b89c-4fe4-a7e0-42ce803c7714 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:28.563084 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7b29e-f4bf-451f-8b84-5a443f71ec0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:28.563770 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7b29e-f4bf-451f-8b84-5a443f71ec0e admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:28.564119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7b29e-f4bf-451f-8b84-5a443f71ec0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:28.564468 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7b29e-f4bf-451f-8b84-5a443f71ec0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:28.565278 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7b29e-f4bf-451f-8b84-5a443f71ec0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:28.567142 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7b29e-f4bf-451f-8b84-5a443f71ec0e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:28.579342 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:28.580878 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1128/2293] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:47:28.586245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7b29e-f4bf-451f-8b84-5a443f71ec0e admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:28.601823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7b29e-f4bf-451f-8b84-5a443f71ec0e admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:28.610805 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001f785-6424-43e3-b3dd-d0389e46a373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:28.611763 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001f785-6424-43e3-b3dd-d0389e46a373 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:28.619443 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001f785-6424-43e3-b3dd-d0389e46a373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:28.619443 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001f785-6424-43e3-b3dd-d0389e46a373 admin admin] PATH_INFO: `/v3/projects/064ce5b429714278ae430a5731f3b88f/users/74f2b5f5f7e546abbe72ff75a40e7630/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:28.634158 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001f785-6424-43e3-b3dd-d0389e46a373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=064ce5b429714278ae430a5731f3b88f, user_id=74f2b5f5f7e546abbe72ff75a40e7630, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:28.637988 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001f785-6424-43e3-b3dd-d0389e46a373 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:28.652165 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1166/2294] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:47:28 2022] PUT /identity/v3/projects/af66809545404dcc9b5339641d347751/users/6c18bb849735414b88dafa46d0ddb597/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:28.668964 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17effb6-c1f4-46e9-81fb-a33868a8257a None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:28.669408 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17effb6-c1f4-46e9-81fb-a33868a8257a None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:28.670291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17effb6-c1f4-46e9-81fb-a33868a8257a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:28.718307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-a17effb6-c1f4-46e9-81fb-a33868a8257a None None] MFA Rules not processed for user `6c18bb849735414b88dafa46d0ddb597`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:28.719600 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a17effb6-c1f4-46e9-81fb-a33868a8257a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:28.759607 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1129/2295] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:47:28 2022] PUT /identity/v3/projects/064ce5b429714278ae430a5731f3b88f/users/74f2b5f5f7e546abbe72ff75a40e7630/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:28.789713 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:28.843490 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66934ff4-3605-40e3-b70a-73c11acb1059 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:28.850332 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66934ff4-3605-40e3-b70a-73c11acb1059 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:28.850332 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66934ff4-3605-40e3-b70a-73c11acb1059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:28.874215 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1167/2296] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:28.906329 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-66934ff4-3605-40e3-b70a-73c11acb1059 None None] MFA Rules not processed for user `74f2b5f5f7e546abbe72ff75a40e7630`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:28.907776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-66934ff4-3605-40e3-b70a-73c11acb1059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:28.912401 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17effb6-c1f4-46e9-81fb-a33868a8257a None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:28.915501 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a17effb6-c1f4-46e9-81fb-a33868a8257a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:29.054956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1130/2297] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:29.075687 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17effb6-c1f4-46e9-81fb-a33868a8257a None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:29.151217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56eae9-eb94-405f-9b23-41d27658eff3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:29.152218 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56eae9-eb94-405f-9b23-41d27658eff3 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:29.152705 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56eae9-eb94-405f-9b23-41d27658eff3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:29.153914 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56eae9-eb94-405f-9b23-41d27658eff3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:29.258264 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56eae9-eb94-405f-9b23-41d27658eff3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:29.261541 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56eae9-eb94-405f-9b23-41d27658eff3 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:29.278875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1168/2298] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:28 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:29.890620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66934ff4-3605-40e3-b70a-73c11acb1059 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:29.890620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-66934ff4-3605-40e3-b70a-73c11acb1059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:29.890620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66934ff4-3605-40e3-b70a-73c11acb1059 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:29.891341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f8cce-359e-4e17-811f-f754136dc97c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:29.891341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f8cce-359e-4e17-811f-f754136dc97c service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:29.891341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f8cce-359e-4e17-811f-f754136dc97c service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:29.891341 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f8cce-359e-4e17-811f-f754136dc97c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:29.891743 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f8cce-359e-4e17-811f-f754136dc97c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:29.891743 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f8cce-359e-4e17-811f-f754136dc97c service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:29.901334 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1131/2299] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:29.925954 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:35.782448 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56eae9-eb94-405f-9b23-41d27658eff3 service cinder] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:35.784070 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-be56eae9-eb94-405f-9b23-41d27658eff3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:35.898338 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56eae9-eb94-405f-9b23-41d27658eff3 service cinder] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:35.898338 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532248b0-7ebc-4ac5-b333-e3f3730d64ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:35.898338 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532248b0-7ebc-4ac5-b333-e3f3730d64ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:35.898338 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532248b0-7ebc-4ac5-b333-e3f3730d64ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:35.898820 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532248b0-7ebc-4ac5-b333-e3f3730d64ff admin admin] PATH_INFO: `/v3/users/1b4f861dbc4f4d4f9c62749d3fef3313` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:35.898820 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532248b0-7ebc-4ac5-b333-e3f3730d64ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b4f861dbc4f4d4f9c62749d3fef3313)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:35.898820 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532248b0-7ebc-4ac5-b333-e3f3730d64ff admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:36.462521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-532248b0-7ebc-4ac5-b333-e3f3730d64ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b4f861dbc4f4d4f9c62749d3fef3313'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:36.463456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-532248b0-7ebc-4ac5-b333-e3f3730d64ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b4f861dbc4f4d4f9c62749d3fef3313'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:36.572467 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-532248b0-7ebc-4ac5-b333-e3f3730d64ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b4f861dbc4f4d4f9c62749d3fef3313'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:36.596555 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-532248b0-7ebc-4ac5-b333-e3f3730d64ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b4f861dbc4f4d4f9c62749d3fef3313'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:36.607239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-532248b0-7ebc-4ac5-b333-e3f3730d64ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b4f861dbc4f4d4f9c62749d3fef3313'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:36.618560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1169/2300] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:47:35 2022] DELETE /identity/v3/users/1b4f861dbc4f4d4f9c62749d3fef3313 => generated 0 bytes in 834 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:36.624667 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2136e9-8f06-4080-be31-ce0d54f81ac2 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:36.625254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2136e9-8f06-4080-be31-ce0d54f81ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:36.625254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2136e9-8f06-4080-be31-ce0d54f81ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:36.640351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:36.665901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5f2136e9-8f06-4080-be31-ce0d54f81ac2 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:36.667820 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5f2136e9-8f06-4080-be31-ce0d54f81ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:36.771789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1132/2301] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:36.783065 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532248b0-7ebc-4ac5-b333-e3f3730d64ff admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:36.784635 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-532248b0-7ebc-4ac5-b333-e3f3730d64ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:36.804559 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:36.867684 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532248b0-7ebc-4ac5-b333-e3f3730d64ff admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:36.871577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22ca04-98ab-4b85-ad33-7078469f7b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:36.872210 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22ca04-98ab-4b85-ad33-7078469f7b1f service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:36.872592 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22ca04-98ab-4b85-ad33-7078469f7b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:36.873083 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22ca04-98ab-4b85-ad33-7078469f7b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:36.885473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22ca04-98ab-4b85-ad33-7078469f7b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:36.886931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22ca04-98ab-4b85-ad33-7078469f7b1f service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:36.900763 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1170/2302] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:37.542538 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2136e9-8f06-4080-be31-ce0d54f81ac2 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:37.544291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5f2136e9-8f06-4080-be31-ce0d54f81ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:37.563297 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2136e9-8f06-4080-be31-ce0d54f81ac2 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:37.569680 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c674e-b848-413b-94b8-fa020ad90166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:37.570478 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c674e-b848-413b-94b8-fa020ad90166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:37.570906 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c674e-b848-413b-94b8-fa020ad90166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:37.571531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c674e-b848-413b-94b8-fa020ad90166 admin admin] PATH_INFO: `/v3/projects/6fa3abbcbc4d4ce4af9186860e40abd5` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:37.573370 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c674e-b848-413b-94b8-fa020ad90166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa3abbcbc4d4ce4af9186860e40abd5)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:37.574933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c674e-b848-413b-94b8-fa020ad90166 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:37.797729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-057c674e-b848-413b-94b8-fa020ad90166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa3abbcbc4d4ce4af9186860e40abd5', 'request_id': 'req-057c674e-b848-413b-94b8-fa020ad90166'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:37.805935 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-057c674e-b848-413b-94b8-fa020ad90166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa3abbcbc4d4ce4af9186860e40abd5', 'request_id': 'req-057c674e-b848-413b-94b8-fa020ad90166'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:37.872868 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-057c674e-b848-413b-94b8-fa020ad90166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa3abbcbc4d4ce4af9186860e40abd5', 'request_id': 'req-057c674e-b848-413b-94b8-fa020ad90166'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:37.901271 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-057c674e-b848-413b-94b8-fa020ad90166 admin admin] The token cache is being invalidate because project 6fa3abbcbc4d4ce4af9186860e40abd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:47:37.901567 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-057c674e-b848-413b-94b8-fa020ad90166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:37.904310 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-057c674e-b848-413b-94b8-fa020ad90166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:37.907294 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1133/2303] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:47:37 2022] DELETE /identity/v3/projects/6fa3abbcbc4d4ce4af9186860e40abd5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:37.924727 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4289a3-d8cf-4b4b-859e-42b532df7889 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:37.925340 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4289a3-d8cf-4b4b-859e-42b532df7889 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:37.925340 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4289a3-d8cf-4b4b-859e-42b532df7889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:37.958494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-5c4289a3-d8cf-4b4b-859e-42b532df7889 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:37.960035 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5c4289a3-d8cf-4b4b-859e-42b532df7889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:38.051400 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1171/2304] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:38.062067 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ce565-66a4-4ec0-bf25-cfa8b9e3c0d1 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:38.063468 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ce565-66a4-4ec0-bf25-cfa8b9e3c0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:38.064055 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ce565-66a4-4ec0-bf25-cfa8b9e3c0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:38.092735 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-8e1ce565-66a4-4ec0-bf25-cfa8b9e3c0d1 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:38.095254 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8e1ce565-66a4-4ec0-bf25-cfa8b9e3c0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:38.108740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1134/2305] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:38.109536 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4289a3-d8cf-4b4b-859e-42b532df7889 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:38.126197 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4289a3-d8cf-4b4b-859e-42b532df7889 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:38.134906 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97682166-022c-43d2-a5da-344351981890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:38.135814 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97682166-022c-43d2-a5da-344351981890 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:38.136255 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97682166-022c-43d2-a5da-344351981890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:38.136713 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97682166-022c-43d2-a5da-344351981890 admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:38.137757 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97682166-022c-43d2-a5da-344351981890 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:47:38.138238 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97682166-022c-43d2-a5da-344351981890 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:38.139964 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97682166-022c-43d2-a5da-344351981890 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:38.159306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1172/2306] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:47:38.163735 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ce565-66a4-4ec0-bf25-cfa8b9e3c0d1 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:38.178508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ce565-66a4-4ec0-bf25-cfa8b9e3c0d1 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:38.186571 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bb0b2-d571-42ae-b1e5-acd09c8aba2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:38.187629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bb0b2-d571-42ae-b1e5-acd09c8aba2e admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:38.188166 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bb0b2-d571-42ae-b1e5-acd09c8aba2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:38.188664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bb0b2-d571-42ae-b1e5-acd09c8aba2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:38.189572 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bb0b2-d571-42ae-b1e5-acd09c8aba2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:38.193031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bb0b2-d571-42ae-b1e5-acd09c8aba2e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:38.363812 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1135/2307] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:47:38 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:47:38.373903 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97682166-022c-43d2-a5da-344351981890 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:38.386810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97682166-022c-43d2-a5da-344351981890 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:38.475059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ae5c0-0379-4bdc-afb1-df1f5a891a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:38.476003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ae5c0-0379-4bdc-afb1-df1f5a891a9b admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:38.476433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ae5c0-0379-4bdc-afb1-df1f5a891a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:38.477395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ae5c0-0379-4bdc-afb1-df1f5a891a9b admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:38.477688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ae5c0-0379-4bdc-afb1-df1f5a891a9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:38.480286 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ae5c0-0379-4bdc-afb1-df1f5a891a9b admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:38.630385 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1173/2308] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:47:38 2022] POST /identity/v3/users => generated 287 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:47:38.636316 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bb0b2-d571-42ae-b1e5-acd09c8aba2e admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:38.650639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bb0b2-d571-42ae-b1e5-acd09c8aba2e admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:38.656183 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a74d26-2097-4cd8-a13d-187ecd6e58b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:38.657609 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a74d26-2097-4cd8-a13d-187ecd6e58b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:38.658120 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a74d26-2097-4cd8-a13d-187ecd6e58b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:38.658649 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a74d26-2097-4cd8-a13d-187ecd6e58b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:38.659803 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a74d26-2097-4cd8-a13d-187ecd6e58b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:38.662529 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a74d26-2097-4cd8-a13d-187ecd6e58b9 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:38.685118 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1136/2309] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:47:38.689478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ae5c0-0379-4bdc-afb1-df1f5a891a9b admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:38.701705 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ae5c0-0379-4bdc-afb1-df1f5a891a9b admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:38.721983 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8b421-f033-4a5d-b3a5-953cc505dd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:38.723017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8b421-f033-4a5d-b3a5-953cc505dd62 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:38.723231 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8b421-f033-4a5d-b3a5-953cc505dd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:38.723570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8b421-f033-4a5d-b3a5-953cc505dd62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:38.724288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8b421-f033-4a5d-b3a5-953cc505dd62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:38.725929 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8b421-f033-4a5d-b3a5-953cc505dd62 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:38.759537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1174/2310] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:47:38.759687 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a74d26-2097-4cd8-a13d-187ecd6e58b9 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:38.776718 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a74d26-2097-4cd8-a13d-187ecd6e58b9 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:38.788718 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ef64a-594d-497b-90b1-037b4c1d65b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:38.796605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ef64a-594d-497b-90b1-037b4c1d65b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:38.797054 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ef64a-594d-497b-90b1-037b4c1d65b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:38.797353 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ef64a-594d-497b-90b1-037b4c1d65b7 admin admin] PATH_INFO: `/v3/projects/087c953588c2462cba6cf3a071e28a53/users/c09b1d84cda94d41a8835c99a7aaac4a/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:38.825778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ef64a-594d-497b-90b1-037b4c1d65b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=087c953588c2462cba6cf3a071e28a53, user_id=c09b1d84cda94d41a8835c99a7aaac4a, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:38.837975 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ef64a-594d-497b-90b1-037b4c1d65b7 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:38.947373 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1137/2311] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:47:38 2022] PUT /identity/v3/projects/087c953588c2462cba6cf3a071e28a53/users/c09b1d84cda94d41a8835c99a7aaac4a/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:38.950234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382d5ce-3882-4f5c-b0e2-5894f5504240 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:38.951074 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382d5ce-3882-4f5c-b0e2-5894f5504240 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:38.952303 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382d5ce-3882-4f5c-b0e2-5894f5504240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:38.974341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-3382d5ce-3882-4f5c-b0e2-5894f5504240 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:38.975985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-3382d5ce-3882-4f5c-b0e2-5894f5504240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:38.991426 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:39.134706 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ef64a-594d-497b-90b1-037b4c1d65b7 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:39.136540 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-177ef64a-594d-497b-90b1-037b4c1d65b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:39.142889 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1175/2312] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:39.196458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:39.250618 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ef64a-594d-497b-90b1-037b4c1d65b7 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:39.255492 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a08df-6ec1-4c0a-a722-2320b28fb061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:39.256543 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a08df-6ec1-4c0a-a722-2320b28fb061 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:39.257394 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a08df-6ec1-4c0a-a722-2320b28fb061 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:39.257828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a08df-6ec1-4c0a-a722-2320b28fb061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:39.273614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a08df-6ec1-4c0a-a722-2320b28fb061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:39.275461 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a08df-6ec1-4c0a-a722-2320b28fb061 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:39.301558 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1138/2313] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:41.870698 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b855cf-28cb-4805-a7b0-18c66193e866 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:41.871356 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b855cf-28cb-4805-a7b0-18c66193e866 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:41.871356 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b855cf-28cb-4805-a7b0-18c66193e866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:41.929297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-37b855cf-28cb-4805-a7b0-18c66193e866 None None] MFA Rules not processed for user `c09b1d84cda94d41a8835c99a7aaac4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:41.929297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-37b855cf-28cb-4805-a7b0-18c66193e866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:41.987051 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1176/2314] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:42.000471 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a08df-6ec1-4c0a-a722-2320b28fb061 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:42.002591 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-314a08df-6ec1-4c0a-a722-2320b28fb061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:42.080417 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a08df-6ec1-4c0a-a722-2320b28fb061 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:42.085887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4267135-1c64-4e4e-85e6-e10dfa303e0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:42.094223 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4267135-1c64-4e4e-85e6-e10dfa303e0c service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:42.094223 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4267135-1c64-4e4e-85e6-e10dfa303e0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:42.094223 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4267135-1c64-4e4e-85e6-e10dfa303e0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:42.096975 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4267135-1c64-4e4e-85e6-e10dfa303e0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:42.099337 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4267135-1c64-4e4e-85e6-e10dfa303e0c service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:42.109820 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1139/2315] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:44.022892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442065a-0bd9-4d9b-be38-2b8cebd1546f None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:44.023501 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442065a-0bd9-4d9b-be38-2b8cebd1546f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:44.023861 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442065a-0bd9-4d9b-be38-2b8cebd1546f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:44.045256 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-5442065a-0bd9-4d9b-be38-2b8cebd1546f None None] MFA Rules not processed for user `c09b1d84cda94d41a8835c99a7aaac4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:44.046752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5442065a-0bd9-4d9b-be38-2b8cebd1546f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:44.058674 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1177/2316] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:44.958137 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4267135-1c64-4e4e-85e6-e10dfa303e0c service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:44.960147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d4267135-1c64-4e4e-85e6-e10dfa303e0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:44.975630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4267135-1c64-4e4e-85e6-e10dfa303e0c service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:44.979973 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2b960-2894-40d5-a838-c817210ca6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:44.980625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2b960-2894-40d5-a838-c817210ca6af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:44.980947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2b960-2894-40d5-a838-c817210ca6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:44.981229 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2b960-2894-40d5-a838-c817210ca6af admin admin] PATH_INFO: `/v3/users/74f2b5f5f7e546abbe72ff75a40e7630` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:44.982410 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2b960-2894-40d5-a838-c817210ca6af admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f2b5f5f7e546abbe72ff75a40e7630)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:44.984402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2b960-2894-40d5-a838-c817210ca6af admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:45.221590 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-61f2b960-2894-40d5-a838-c817210ca6af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f2b5f5f7e546abbe72ff75a40e7630'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:45.222672 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-61f2b960-2894-40d5-a838-c817210ca6af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f2b5f5f7e546abbe72ff75a40e7630'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:45.330054 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-61f2b960-2894-40d5-a838-c817210ca6af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f2b5f5f7e546abbe72ff75a40e7630'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:45.349598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-61f2b960-2894-40d5-a838-c817210ca6af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f2b5f5f7e546abbe72ff75a40e7630'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:45.350809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-61f2b960-2894-40d5-a838-c817210ca6af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f2b5f5f7e546abbe72ff75a40e7630'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:45.366881 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1140/2317] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:47:44 2022] DELETE /identity/v3/users/74f2b5f5f7e546abbe72ff75a40e7630 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:47:45.371356 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f390e-2afb-43c8-86d5-4493e16c0898 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:45.371842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f390e-2afb-43c8-86d5-4493e16c0898 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:45.371939 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f390e-2afb-43c8-86d5-4493e16c0898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:45.411559 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-281f390e-2afb-43c8-86d5-4493e16c0898 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:45.413026 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-281f390e-2afb-43c8-86d5-4493e16c0898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:45.506106 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1178/2318] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:45.516503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2b960-2894-40d5-a838-c817210ca6af admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:45.518057 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-61f2b960-2894-40d5-a838-c817210ca6af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:45.567656 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:45.581864 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2b960-2894-40d5-a838-c817210ca6af admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:45.587616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd8528-6333-491a-88c2-86932a16eeae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:45.587616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd8528-6333-491a-88c2-86932a16eeae service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:45.587616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd8528-6333-491a-88c2-86932a16eeae service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:45.587616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd8528-6333-491a-88c2-86932a16eeae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:45.595886 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd8528-6333-491a-88c2-86932a16eeae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:45.597856 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd8528-6333-491a-88c2-86932a16eeae service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:45.607513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1141/2319] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:46.137805 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f390e-2afb-43c8-86d5-4493e16c0898 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:46.139246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-281f390e-2afb-43c8-86d5-4493e16c0898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:46.155322 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f390e-2afb-43c8-86d5-4493e16c0898 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:46.161217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173144e9-e185-4200-b03f-dd5c5a4959b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:46.161989 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173144e9-e185-4200-b03f-dd5c5a4959b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:46.162209 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173144e9-e185-4200-b03f-dd5c5a4959b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:46.162492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173144e9-e185-4200-b03f-dd5c5a4959b4 admin admin] PATH_INFO: `/v3/projects/064ce5b429714278ae430a5731f3b88f` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:46.164407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173144e9-e185-4200-b03f-dd5c5a4959b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=064ce5b429714278ae430a5731f3b88f)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:46.166779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173144e9-e185-4200-b03f-dd5c5a4959b4 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:46.318605 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:46.325449 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-173144e9-e185-4200-b03f-dd5c5a4959b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '064ce5b429714278ae430a5731f3b88f', 'request_id': 'req-173144e9-e185-4200-b03f-dd5c5a4959b4'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:46.330890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-173144e9-e185-4200-b03f-dd5c5a4959b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '064ce5b429714278ae430a5731f3b88f', 'request_id': 'req-173144e9-e185-4200-b03f-dd5c5a4959b4'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:46.427676 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-173144e9-e185-4200-b03f-dd5c5a4959b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '064ce5b429714278ae430a5731f3b88f', 'request_id': 'req-173144e9-e185-4200-b03f-dd5c5a4959b4'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:46.440125 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-173144e9-e185-4200-b03f-dd5c5a4959b4 admin admin] The token cache is being invalidate because project 064ce5b429714278ae430a5731f3b88f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:47:46.440125 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-173144e9-e185-4200-b03f-dd5c5a4959b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:46.440570 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-173144e9-e185-4200-b03f-dd5c5a4959b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:47:46.442749 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1179/2320] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:47:46 2022] DELETE /identity/v3/projects/064ce5b429714278ae430a5731f3b88f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:47:48.564936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7824e1-5ff7-4ddd-b642-513f3f114b7a None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:48.565506 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7824e1-5ff7-4ddd-b642-513f3f114b7a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:48.565712 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7824e1-5ff7-4ddd-b642-513f3f114b7a None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:48.568109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1142/2321] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 18:47:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:47:48.573810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ba143-c524-497d-94ba-32527f99f0e6 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:48.574310 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ba143-c524-497d-94ba-32527f99f0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:48.574393 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ba143-c524-497d-94ba-32527f99f0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:48.599494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-5b5ba143-c524-497d-94ba-32527f99f0e6 None None] MFA Rules not processed for user `be769d4dd016466f9174e7d5e47a2a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:48.600717 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5b5ba143-c524-497d-94ba-32527f99f0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:48.694928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1180/2322] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 18:47:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:48.711193 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7824e1-5ff7-4ddd-b642-513f3f114b7a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:48.713184 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ea7824e1-5ff7-4ddd-b642-513f3f114b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:48.787712 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7824e1-5ff7-4ddd-b642-513f3f114b7a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:48.791338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429745d-8f97-49c4-9d67-1ae41e25ecf9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49a34cd99ab47bb92af6ed2f82fefde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:48.791960 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429745d-8f97-49c4-9d67-1ae41e25ecf9 service glance] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:48.792244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429745d-8f97-49c4-9d67-1ae41e25ecf9 service glance] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:48.792525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429745d-8f97-49c4-9d67-1ae41e25ecf9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:48.804509 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429745d-8f97-49c4-9d67-1ae41e25ecf9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:48.805928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429745d-8f97-49c4-9d67-1ae41e25ecf9 service glance] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:48.817726 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1143/2323] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:49.059667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcd44f-e476-4505-9d20-692bee1abf2d None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:49.060200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcd44f-e476-4505-9d20-692bee1abf2d None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:49.060638 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcd44f-e476-4505-9d20-692bee1abf2d None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:49.062172 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1181/2324] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 18:47:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:47:49.068533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c07eb-7ff0-4db3-99cc-a9100909076f None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:49.069050 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c07eb-7ff0-4db3-99cc-a9100909076f None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:49.070881 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c07eb-7ff0-4db3-99cc-a9100909076f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:49.093234 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-4e7c07eb-7ff0-4db3-99cc-a9100909076f None None] MFA Rules not processed for user `ffee4a13d4fd4f86bd1c79b4535a0c55`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:49.094578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4e7c07eb-7ff0-4db3-99cc-a9100909076f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:49.151754 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1144/2325] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 18:47:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:49.166175 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dcd44f-e476-4505-9d20-692bee1abf2d None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:49.168273 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-70dcd44f-e476-4505-9d20-692bee1abf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:49.182521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dcd44f-e476-4505-9d20-692bee1abf2d None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:49.188503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9099c919-2277-400e-af33-56a08d70870b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:49.189334 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099c919-2277-400e-af33-56a08d70870b service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:49.190201 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099c919-2277-400e-af33-56a08d70870b service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:49.190201 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099c919-2277-400e-af33-56a08d70870b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:49.200127 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9099c919-2277-400e-af33-56a08d70870b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:49.201807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9099c919-2277-400e-af33-56a08d70870b service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:49.212458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1182/2326] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:49.338195 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a7f97-b32c-48d7-8000-c32d17aa46a4 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:49.338485 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a7f97-b32c-48d7-8000-c32d17aa46a4 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:49.338765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a7f97-b32c-48d7-8000-c32d17aa46a4 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:49.340273 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1145/2327] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 18:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:47:49.346146 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef0e97-7551-4b95-a866-b72f8f38786b None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:49.346467 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef0e97-7551-4b95-a866-b72f8f38786b None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:49.346773 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef0e97-7551-4b95-a866-b72f8f38786b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:49.368308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-c6ef0e97-7551-4b95-a866-b72f8f38786b None None] MFA Rules not processed for user `be769d4dd016466f9174e7d5e47a2a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:49.369528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c6ef0e97-7551-4b95-a866-b72f8f38786b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:49.379452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1183/2328] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 18:47:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:49.391713 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a7f97-b32c-48d7-8000-c32d17aa46a4 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:49.393523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8e1a7f97-b32c-48d7-8000-c32d17aa46a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:49.410478 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a7f97-b32c-48d7-8000-c32d17aa46a4 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:49.415244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6727ff-2967-4d25-9006-61a1ec6368b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:49.415959 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6727ff-2967-4d25-9006-61a1ec6368b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:49.416249 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6727ff-2967-4d25-9006-61a1ec6368b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:49.416551 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6727ff-2967-4d25-9006-61a1ec6368b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:49.456078 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6727ff-2967-4d25-9006-61a1ec6368b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:49.458923 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6727ff-2967-4d25-9006-61a1ec6368b9 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:49.470939 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1146/2329] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:54.063664 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676a7cc-0557-4af4-99f3-b73bd97bb54f None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:54.064178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676a7cc-0557-4af4-99f3-b73bd97bb54f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:54.064297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676a7cc-0557-4af4-99f3-b73bd97bb54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:54.091339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-c676a7cc-0557-4af4-99f3-b73bd97bb54f None None] MFA Rules not processed for user `5b4c4184e87b4dc5a4047310cd0122ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:47:54.092844 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c676a7cc-0557-4af4-99f3-b73bd97bb54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:54.152942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1184/2330] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 18:47:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:47:54.165695 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6727ff-2967-4d25-9006-61a1ec6368b9 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:54.167349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-be6727ff-2967-4d25-9006-61a1ec6368b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:54.244924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6727ff-2967-4d25-9006-61a1ec6368b9 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:54.251049 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0ce9c-07d3-45c8-924b-449126aa09a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7832398e97af4e539e10d1eef49f6d6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:54.251740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0ce9c-07d3-45c8-924b-449126aa09a0 service swift] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:54.252022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0ce9c-07d3-45c8-924b-449126aa09a0 service swift] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:54.252297 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0ce9c-07d3-45c8-924b-449126aa09a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:54.262824 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0ce9c-07d3-45c8-924b-449126aa09a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:54.264613 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0ce9c-07d3-45c8-924b-449126aa09a0 service swift] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:54.280099 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1147/2331] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 18:47:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:48:04.145985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=75,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:48:04.274585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:48:11.302153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676a7cc-0557-4af4-99f3-b73bd97bb54f None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:11.303636 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c676a7cc-0557-4af4-99f3-b73bd97bb54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:11.375742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676a7cc-0557-4af4-99f3-b73bd97bb54f None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:11.380558 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7bb9f-e284-42be-8894-3dd2534d03a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:11.381207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7bb9f-e284-42be-8894-3dd2534d03a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:11.381493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7bb9f-e284-42be-8894-3dd2534d03a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:11.381773 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7bb9f-e284-42be-8894-3dd2534d03a4 admin admin] PATH_INFO: `/v3/users/6c18bb849735414b88dafa46d0ddb597` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:11.383003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7bb9f-e284-42be-8894-3dd2534d03a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c18bb849735414b88dafa46d0ddb597)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:11.384993 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7bb9f-e284-42be-8894-3dd2534d03a4 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:11.565310 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-22e7bb9f-e284-42be-8894-3dd2534d03a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c18bb849735414b88dafa46d0ddb597'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:48:11.565954 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-22e7bb9f-e284-42be-8894-3dd2534d03a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c18bb849735414b88dafa46d0ddb597'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:48:11.642982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-22e7bb9f-e284-42be-8894-3dd2534d03a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c18bb849735414b88dafa46d0ddb597'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:48:11.656473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-22e7bb9f-e284-42be-8894-3dd2534d03a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c18bb849735414b88dafa46d0ddb597'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:48:11.665198 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-22e7bb9f-e284-42be-8894-3dd2534d03a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c18bb849735414b88dafa46d0ddb597'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:48:11.671732 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1185/2332] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:48:11 2022] DELETE /identity/v3/users/6c18bb849735414b88dafa46d0ddb597 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:48:11.681349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b73f6-320f-4ead-9789-c137e3dbbef7 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:11.681839 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b73f6-320f-4ead-9789-c137e3dbbef7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:11.681951 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b73f6-320f-4ead-9789-c137e3dbbef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:11.702839 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-8c8b73f6-320f-4ead-9789-c137e3dbbef7 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:48:11.704174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8c8b73f6-320f-4ead-9789-c137e3dbbef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:11.775894 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1148/2333] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:48:11.785699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7bb9f-e284-42be-8894-3dd2534d03a4 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:11.787142 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-22e7bb9f-e284-42be-8894-3dd2534d03a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:11.844803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7bb9f-e284-42be-8894-3dd2534d03a4 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:11.848809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb7406-a14c-4570-97e6-39e0bfa7c690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:11.849424 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb7406-a14c-4570-97e6-39e0bfa7c690 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:11.849705 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb7406-a14c-4570-97e6-39e0bfa7c690 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:11.849981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb7406-a14c-4570-97e6-39e0bfa7c690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:11.859358 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb7406-a14c-4570-97e6-39e0bfa7c690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:11.860816 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb7406-a14c-4570-97e6-39e0bfa7c690 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:11.871023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1186/2334] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:48:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:48:12.353620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b73f6-320f-4ead-9789-c137e3dbbef7 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:12.355043 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8c8b73f6-320f-4ead-9789-c137e3dbbef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:12.368280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b73f6-320f-4ead-9789-c137e3dbbef7 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:12.374767 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1d526-2b94-49c2-8c33-0d352d3ce9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:12.375610 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1d526-2b94-49c2-8c33-0d352d3ce9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:12.375940 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1d526-2b94-49c2-8c33-0d352d3ce9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:12.376260 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1d526-2b94-49c2-8c33-0d352d3ce9aa admin admin] PATH_INFO: `/v3/projects/af66809545404dcc9b5339641d347751` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:12.387290 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1d526-2b94-49c2-8c33-0d352d3ce9aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=af66809545404dcc9b5339641d347751)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:12.389361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1d526-2b94-49c2-8c33-0d352d3ce9aa admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:12.522539 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5bf1d526-2b94-49c2-8c33-0d352d3ce9aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af66809545404dcc9b5339641d347751', 'request_id': 'req-5bf1d526-2b94-49c2-8c33-0d352d3ce9aa'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:48:12.528923 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5bf1d526-2b94-49c2-8c33-0d352d3ce9aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af66809545404dcc9b5339641d347751', 'request_id': 'req-5bf1d526-2b94-49c2-8c33-0d352d3ce9aa'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:48:12.666040 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5bf1d526-2b94-49c2-8c33-0d352d3ce9aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af66809545404dcc9b5339641d347751', 'request_id': 'req-5bf1d526-2b94-49c2-8c33-0d352d3ce9aa'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:48:12.680300 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5bf1d526-2b94-49c2-8c33-0d352d3ce9aa admin admin] The token cache is being invalidate because project af66809545404dcc9b5339641d347751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:48:12.684671 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5bf1d526-2b94-49c2-8c33-0d352d3ce9aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:48:12.684671 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5bf1d526-2b94-49c2-8c33-0d352d3ce9aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:48:12.684671 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1149/2335] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:48:12 2022] DELETE /identity/v3/projects/af66809545404dcc9b5339641d347751 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:48:12.687808 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e44bc-6bda-488b-ab0c-11a2c43f8e23 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:12.688262 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e44bc-6bda-488b-ab0c-11a2c43f8e23 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:12.688693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e44bc-6bda-488b-ab0c-11a2c43f8e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:12.709253 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-465e44bc-6bda-488b-ab0c-11a2c43f8e23 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:48:12.710472 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-465e44bc-6bda-488b-ab0c-11a2c43f8e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:12.729067 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:48:12.777179 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1187/2336] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:48:12.786157 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fc43c-09cc-408e-be77-3a890b22763c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:12.786387 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fc43c-09cc-408e-be77-3a890b22763c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:12.786655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fc43c-09cc-408e-be77-3a890b22763c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:12.811714 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f57fc43c-09cc-408e-be77-3a890b22763c None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:48:12.812949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f57fc43c-09cc-408e-be77-3a890b22763c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:12.821272 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1150/2337] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:48:12.825620 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e44bc-6bda-488b-ab0c-11a2c43f8e23 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:12.836362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e44bc-6bda-488b-ab0c-11a2c43f8e23 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:12.841520 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ea414-e885-4d99-8ad4-e46c2096e2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:12.842135 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ea414-e885-4d99-8ad4-e46c2096e2ba admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:12.842417 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ea414-e885-4d99-8ad4-e46c2096e2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:12.842718 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ea414-e885-4d99-8ad4-e46c2096e2ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:12.843464 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ea414-e885-4d99-8ad4-e46c2096e2ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:48:12.843773 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ea414-e885-4d99-8ad4-e46c2096e2ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:12.845374 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ea414-e885-4d99-8ad4-e46c2096e2ba admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:12.857648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1188/2338] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:48:12.861976 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fc43c-09cc-408e-be77-3a890b22763c None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:12.872208 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fc43c-09cc-408e-be77-3a890b22763c None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:12.876968 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabe48f-5d62-4878-b8a0-9ab129d35699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:12.877583 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabe48f-5d62-4878-b8a0-9ab129d35699 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:12.877869 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabe48f-5d62-4878-b8a0-9ab129d35699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:12.878156 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabe48f-5d62-4878-b8a0-9ab129d35699 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:12.879543 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabe48f-5d62-4878-b8a0-9ab129d35699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:12.881467 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabe48f-5d62-4878-b8a0-9ab129d35699 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:12.962782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1151/2339] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:48:12 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:48:12.966956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ea414-e885-4d99-8ad4-e46c2096e2ba admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:12.976932 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ea414-e885-4d99-8ad4-e46c2096e2ba admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:13.043174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43836b1-65bc-4108-bb46-43177db36379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:13.043839 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43836b1-65bc-4108-bb46-43177db36379 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:13.044228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43836b1-65bc-4108-bb46-43177db36379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:13.044510 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43836b1-65bc-4108-bb46-43177db36379 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:13.045182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43836b1-65bc-4108-bb46-43177db36379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:13.047158 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43836b1-65bc-4108-bb46-43177db36379 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:13.145074 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1189/2340] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:48:12 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:48:13.146477 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabe48f-5d62-4878-b8a0-9ab129d35699 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:13.159737 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabe48f-5d62-4878-b8a0-9ab129d35699 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:13.165913 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42fb2c-7f4f-42d4-8603-4cebb2763e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:13.166543 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42fb2c-7f4f-42d4-8603-4cebb2763e93 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:13.166829 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42fb2c-7f4f-42d4-8603-4cebb2763e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:13.167108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42fb2c-7f4f-42d4-8603-4cebb2763e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:13.167855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42fb2c-7f4f-42d4-8603-4cebb2763e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:13.169479 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42fb2c-7f4f-42d4-8603-4cebb2763e93 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:13.181619 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1152/2341] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:48:13.185889 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43836b1-65bc-4108-bb46-43177db36379 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:13.196952 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43836b1-65bc-4108-bb46-43177db36379 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:13.202774 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525406a-1c6c-4f04-98dd-d977038ef329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:13.204595 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525406a-1c6c-4f04-98dd-d977038ef329 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:13.204595 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525406a-1c6c-4f04-98dd-d977038ef329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:13.204595 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525406a-1c6c-4f04-98dd-d977038ef329 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:13.204892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525406a-1c6c-4f04-98dd-d977038ef329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:13.206328 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525406a-1c6c-4f04-98dd-d977038ef329 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:13.222171 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1190/2342] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:48:13.224005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42fb2c-7f4f-42d4-8603-4cebb2763e93 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:13.235465 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42fb2c-7f4f-42d4-8603-4cebb2763e93 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:13.241169 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96767cdb-274e-4fb9-a169-9afdb32bc51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:13.241991 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96767cdb-274e-4fb9-a169-9afdb32bc51e admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:13.242315 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96767cdb-274e-4fb9-a169-9afdb32bc51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:13.242598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96767cdb-274e-4fb9-a169-9afdb32bc51e admin admin] PATH_INFO: `/v3/projects/d39a128880624f41a3da08ced4deb30b/users/b9323f7470b1422db5a96b1596324a04/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:13.258655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96767cdb-274e-4fb9-a169-9afdb32bc51e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39a128880624f41a3da08ced4deb30b, user_id=b9323f7470b1422db5a96b1596324a04, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:13.261389 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96767cdb-274e-4fb9-a169-9afdb32bc51e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:13.375991 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1153/2343] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:48:13 2022] PUT /identity/v3/projects/d39a128880624f41a3da08ced4deb30b/users/b9323f7470b1422db5a96b1596324a04/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:48:13.387110 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e728bb4-09de-4bc9-b67d-c8dc0ad2a438 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:13.388009 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e728bb4-09de-4bc9-b67d-c8dc0ad2a438 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:13.388394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e728bb4-09de-4bc9-b67d-c8dc0ad2a438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:13.419925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-6e728bb4-09de-4bc9-b67d-c8dc0ad2a438 None None] MFA Rules not processed for user `b9323f7470b1422db5a96b1596324a04`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:48:13.421177 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-6e728bb4-09de-4bc9-b67d-c8dc0ad2a438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:13.502407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1191/2344] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:48:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:48:13.513813 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96767cdb-274e-4fb9-a169-9afdb32bc51e admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:13.518890 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-96767cdb-274e-4fb9-a169-9afdb32bc51e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:13.541785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:48:13.591743 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96767cdb-274e-4fb9-a169-9afdb32bc51e admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:13.595690 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88badd4-1fcb-4e44-a6ed-e66e987cf8b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:13.596414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88badd4-1fcb-4e44-a6ed-e66e987cf8b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:13.596764 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88badd4-1fcb-4e44-a6ed-e66e987cf8b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:13.597109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88badd4-1fcb-4e44-a6ed-e66e987cf8b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:13.607853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88badd4-1fcb-4e44-a6ed-e66e987cf8b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:13.609369 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88badd4-1fcb-4e44-a6ed-e66e987cf8b9 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:13.619054 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1154/2345] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:48:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:48:14.736532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749be705-08f3-4c14-aebb-29bcdedf7de8 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:14.736997 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749be705-08f3-4c14-aebb-29bcdedf7de8 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:14.737090 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749be705-08f3-4c14-aebb-29bcdedf7de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:14.757204 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-749be705-08f3-4c14-aebb-29bcdedf7de8 None None] MFA Rules not processed for user `5b4c4184e87b4dc5a4047310cd0122ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:48:14.758441 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-749be705-08f3-4c14-aebb-29bcdedf7de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:14.771940 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:48:14.815411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1192/2346] 10.222.0.65 () {58 vars in 967 bytes} [Wed Jul 27 18:48:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:48:14.839002 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88badd4-1fcb-4e44-a6ed-e66e987cf8b9 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:14.840668 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c88badd4-1fcb-4e44-a6ed-e66e987cf8b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:14.912396 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88badd4-1fcb-4e44-a6ed-e66e987cf8b9 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:14.918489 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143049e-dff4-4ff6-bc50-22e5d9e28e00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7832398e97af4e539e10d1eef49f6d6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:14.919608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143049e-dff4-4ff6-bc50-22e5d9e28e00 service swift] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:14.920089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143049e-dff4-4ff6-bc50-22e5d9e28e00 service swift] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:14.920713 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143049e-dff4-4ff6-bc50-22e5d9e28e00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:14.933986 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143049e-dff4-4ff6-bc50-22e5d9e28e00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:14.936334 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143049e-dff4-4ff6-bc50-22e5d9e28e00 service swift] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:14.945915 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1155/2347] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 18:48:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:48:15.419181 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f948cc0-1f97-403b-91cb-676952187e87 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:15.419498 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f948cc0-1f97-403b-91cb-676952187e87 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:15.419855 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f948cc0-1f97-403b-91cb-676952187e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:15.459976 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-7f948cc0-1f97-403b-91cb-676952187e87 None None] MFA Rules not processed for user `b9323f7470b1422db5a96b1596324a04`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:48:15.461317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-7f948cc0-1f97-403b-91cb-676952187e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:15.473533 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1193/2348] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:48:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:48:15.831048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425f619-b392-4b31-9e82-adcef88fb1d9 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:15.831379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425f619-b392-4b31-9e82-adcef88fb1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:15.832243 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425f619-b392-4b31-9e82-adcef88fb1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:15.853007 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-d425f619-b392-4b31-9e82-adcef88fb1d9 None None] MFA Rules not processed for user `c09b1d84cda94d41a8835c99a7aaac4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:48:15.854167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d425f619-b392-4b31-9e82-adcef88fb1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:15.922040 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1156/2349] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:48:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:48:17.835669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f948cc0-1f97-403b-91cb-676952187e87 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:17.837166 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-7f948cc0-1f97-403b-91cb-676952187e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:17.908618 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f948cc0-1f97-403b-91cb-676952187e87 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:17.914564 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4660b4a-9a1d-4018-991f-9a9083781951 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa971da983ea48c3b6d4c68a5d454bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:17.915182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4660b4a-9a1d-4018-991f-9a9083781951 service placement] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:17.915653 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4660b4a-9a1d-4018-991f-9a9083781951 service placement] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:17.915927 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4660b4a-9a1d-4018-991f-9a9083781951 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:17.917706 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-d4660b4a-9a1d-4018-991f-9a9083781951 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:17.930052 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4660b4a-9a1d-4018-991f-9a9083781951 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:17.934515 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4660b4a-9a1d-4018-991f-9a9083781951 service placement] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:17.942678 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1194/2350] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:48:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:48:25.914622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=74 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:48:27.937783 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=52 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:48:39.370146 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f030bf3-1d11-4703-aebc-bdbc8bf09b34 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:39.370730 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f030bf3-1d11-4703-aebc-bdbc8bf09b34 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:39.370730 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f030bf3-1d11-4703-aebc-bdbc8bf09b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:39.395502 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5f030bf3-1d11-4703-aebc-bdbc8bf09b34 None None] MFA Rules not processed for user `5b4c4184e87b4dc5a4047310cd0122ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:48:39.396746 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5f030bf3-1d11-4703-aebc-bdbc8bf09b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:39.404172 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1157/2351] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 18:48:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:48:39.428023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4660b4a-9a1d-4018-991f-9a9083781951 service placement] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:39.440017 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4660b4a-9a1d-4018-991f-9a9083781951 service placement] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:39.449311 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8525db-abb1-4aeb-8739-b591e47927e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7832398e97af4e539e10d1eef49f6d6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:39.450358 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8525db-abb1-4aeb-8739-b591e47927e2 service swift] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:39.450858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8525db-abb1-4aeb-8739-b591e47927e2 service swift] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:39.451414 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8525db-abb1-4aeb-8739-b591e47927e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:39.466551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8525db-abb1-4aeb-8739-b591e47927e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:39.469587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8525db-abb1-4aeb-8739-b591e47927e2 service swift] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:39.486600 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1195/2352] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 18:48:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:48:39.602791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152960c-1228-4aef-8dd0-1e2c5318893e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:39.603804 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152960c-1228-4aef-8dd0-1e2c5318893e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:39.603804 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152960c-1228-4aef-8dd0-1e2c5318893e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:39.635187 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f152960c-1228-4aef-8dd0-1e2c5318893e None None] MFA Rules not processed for user `5b4c4184e87b4dc5a4047310cd0122ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:48:39.637231 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f152960c-1228-4aef-8dd0-1e2c5318893e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:39.671729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1158/2353] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 18:48:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:48:39.687877 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8525db-abb1-4aeb-8739-b591e47927e2 service swift] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:39.700180 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8525db-abb1-4aeb-8739-b591e47927e2 service swift] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:39.706522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cddc20-5821-4d09-9b73-2f8392293f3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7832398e97af4e539e10d1eef49f6d6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:39.707235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cddc20-5821-4d09-9b73-2f8392293f3a service swift] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:39.707858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cddc20-5821-4d09-9b73-2f8392293f3a service swift] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:39.708099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cddc20-5821-4d09-9b73-2f8392293f3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:39.717924 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cddc20-5821-4d09-9b73-2f8392293f3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:39.720090 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cddc20-5821-4d09-9b73-2f8392293f3a service swift] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:39.732156 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1196/2354] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 18:48:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:48:40.684306 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512537bd-931f-45ff-8290-94a46e42383a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:40.684876 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512537bd-931f-45ff-8290-94a46e42383a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:40.685225 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512537bd-931f-45ff-8290-94a46e42383a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:40.712005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-512537bd-931f-45ff-8290-94a46e42383a None None] MFA Rules not processed for user `5b4c4184e87b4dc5a4047310cd0122ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:48:40.714393 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-512537bd-931f-45ff-8290-94a46e42383a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:40.725738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1159/2355] 10.222.0.65 () {58 vars in 967 bytes} [Wed Jul 27 18:48:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:48:40.807802 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cddc20-5821-4d09-9b73-2f8392293f3a service swift] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:40.824115 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cddc20-5821-4d09-9b73-2f8392293f3a service swift] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:40.833132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c36de-711b-4168-9809-328564812b29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7832398e97af4e539e10d1eef49f6d6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:40.834854 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c36de-711b-4168-9809-328564812b29 service swift] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:40.835399 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c36de-711b-4168-9809-328564812b29 service swift] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:40.835873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c36de-711b-4168-9809-328564812b29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:40.848811 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c36de-711b-4168-9809-328564812b29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:40.850909 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c36de-711b-4168-9809-328564812b29 service swift] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:40.865801 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1197/2356] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 18:48:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:48:41.645535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e556c58-f282-4717-bc99-7fa06b175b78 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:41.646052 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e556c58-f282-4717-bc99-7fa06b175b78 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:41.646334 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e556c58-f282-4717-bc99-7fa06b175b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:41.678258 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0e556c58-f282-4717-bc99-7fa06b175b78 None None] MFA Rules not processed for user `5b4c4184e87b4dc5a4047310cd0122ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:48:41.681144 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0e556c58-f282-4717-bc99-7fa06b175b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:41.697858 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1160/2357] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 18:48:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:48:41.718346 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c36de-711b-4168-9809-328564812b29 service swift] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:41.732925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c36de-711b-4168-9809-328564812b29 service swift] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:41.739871 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1c1e4-3de5-455b-8d33-97eb56ee9784 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7832398e97af4e539e10d1eef49f6d6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:41.741153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1c1e4-3de5-455b-8d33-97eb56ee9784 service swift] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:41.741784 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1c1e4-3de5-455b-8d33-97eb56ee9784 service swift] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:41.742398 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1c1e4-3de5-455b-8d33-97eb56ee9784 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:41.754159 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1c1e4-3de5-455b-8d33-97eb56ee9784 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:41.757008 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1c1e4-3de5-455b-8d33-97eb56ee9784 service swift] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:41.769029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1198/2358] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 18:48:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:48:42.417121 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eab2d-05de-4e4a-b041-9b4c044b65bc None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:42.417458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eab2d-05de-4e4a-b041-9b4c044b65bc None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:42.417709 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eab2d-05de-4e4a-b041-9b4c044b65bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:42.439082 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-726eab2d-05de-4e4a-b041-9b4c044b65bc None None] MFA Rules not processed for user `5b4c4184e87b4dc5a4047310cd0122ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:48:42.440902 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-726eab2d-05de-4e4a-b041-9b4c044b65bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:42.449157 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1161/2359] 10.222.0.65 () {58 vars in 967 bytes} [Wed Jul 27 18:48:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:48:42.468735 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1c1e4-3de5-455b-8d33-97eb56ee9784 service swift] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:42.483061 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1c1e4-3de5-455b-8d33-97eb56ee9784 service swift] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:42.491057 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc538e1-f898-43fb-8547-426fd2413fe7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7832398e97af4e539e10d1eef49f6d6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:42.491837 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc538e1-f898-43fb-8547-426fd2413fe7 service swift] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:42.492235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc538e1-f898-43fb-8547-426fd2413fe7 service swift] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:42.492577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc538e1-f898-43fb-8547-426fd2413fe7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:42.504797 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc538e1-f898-43fb-8547-426fd2413fe7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:42.507075 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc538e1-f898-43fb-8547-426fd2413fe7 service swift] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:42.516763 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1199/2360] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 18:48:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:48:45.523590 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726eab2d-05de-4e4a-b041-9b4c044b65bc None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:45.636934 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726eab2d-05de-4e4a-b041-9b4c044b65bc None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:45.642879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc088a-3fb0-4995-b8b8-9a2e9ea4a340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:45.643573 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc088a-3fb0-4995-b8b8-9a2e9ea4a340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:45.643860 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc088a-3fb0-4995-b8b8-9a2e9ea4a340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:45.644227 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc088a-3fb0-4995-b8b8-9a2e9ea4a340 admin admin] PATH_INFO: `/v3/users/b9323f7470b1422db5a96b1596324a04` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:45.646028 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc088a-3fb0-4995-b8b8-9a2e9ea4a340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9323f7470b1422db5a96b1596324a04)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:45.648142 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc088a-3fb0-4995-b8b8-9a2e9ea4a340 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:45.841139 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-82cc088a-3fb0-4995-b8b8-9a2e9ea4a340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9323f7470b1422db5a96b1596324a04'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:48:45.841919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-82cc088a-3fb0-4995-b8b8-9a2e9ea4a340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9323f7470b1422db5a96b1596324a04'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:48:45.939768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-82cc088a-3fb0-4995-b8b8-9a2e9ea4a340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9323f7470b1422db5a96b1596324a04'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:48:45.958696 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-82cc088a-3fb0-4995-b8b8-9a2e9ea4a340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9323f7470b1422db5a96b1596324a04'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:48:45.959519 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-82cc088a-3fb0-4995-b8b8-9a2e9ea4a340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9323f7470b1422db5a96b1596324a04'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:48:45.974715 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1162/2361] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:48:45 2022] DELETE /identity/v3/users/b9323f7470b1422db5a96b1596324a04 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:48:45.979915 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039eae1-547c-4b92-91b7-f61a6267d733 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:45.980470 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039eae1-547c-4b92-91b7-f61a6267d733 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:45.980611 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039eae1-547c-4b92-91b7-f61a6267d733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:46.006723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-b039eae1-547c-4b92-91b7-f61a6267d733 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:48:46.008931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b039eae1-547c-4b92-91b7-f61a6267d733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:46.111640 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1200/2362] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:48:46.122541 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc088a-3fb0-4995-b8b8-9a2e9ea4a340 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:46.124401 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-82cc088a-3fb0-4995-b8b8-9a2e9ea4a340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:46.213253 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:48:46.224586 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc088a-3fb0-4995-b8b8-9a2e9ea4a340 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:46.237433 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea5b00-b88b-46cc-baf0-c536b86591d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:46.238259 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea5b00-b88b-46cc-baf0-c536b86591d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:46.238540 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea5b00-b88b-46cc-baf0-c536b86591d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:46.238829 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea5b00-b88b-46cc-baf0-c536b86591d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:46.253264 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea5b00-b88b-46cc-baf0-c536b86591d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:46.256924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea5b00-b88b-46cc-baf0-c536b86591d6 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:46.271156 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1163/2363] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:48:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:48:46.667683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039eae1-547c-4b92-91b7-f61a6267d733 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:46.669213 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b039eae1-547c-4b92-91b7-f61a6267d733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:46.687873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039eae1-547c-4b92-91b7-f61a6267d733 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:46.700622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71029a-9600-4834-8359-220b61a91479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:46.701491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71029a-9600-4834-8359-220b61a91479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:46.701772 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71029a-9600-4834-8359-220b61a91479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:46.702100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71029a-9600-4834-8359-220b61a91479 admin admin] PATH_INFO: `/v3/projects/d39a128880624f41a3da08ced4deb30b` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:46.703745 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71029a-9600-4834-8359-220b61a91479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d39a128880624f41a3da08ced4deb30b)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:46.705826 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71029a-9600-4834-8359-220b61a91479 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:46.823622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-7a71029a-9600-4834-8359-220b61a91479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd39a128880624f41a3da08ced4deb30b', 'request_id': 'req-7a71029a-9600-4834-8359-220b61a91479'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:48:46.832844 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-7a71029a-9600-4834-8359-220b61a91479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd39a128880624f41a3da08ced4deb30b', 'request_id': 'req-7a71029a-9600-4834-8359-220b61a91479'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:48:46.882229 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-7a71029a-9600-4834-8359-220b61a91479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd39a128880624f41a3da08ced4deb30b', 'request_id': 'req-7a71029a-9600-4834-8359-220b61a91479'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:48:46.903683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-7a71029a-9600-4834-8359-220b61a91479 admin admin] The token cache is being invalidate because project d39a128880624f41a3da08ced4deb30b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:48:46.904390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-7a71029a-9600-4834-8359-220b61a91479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:48:46.905104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-7a71029a-9600-4834-8359-220b61a91479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:48:46.910276 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1201/2364] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:48:46 2022] DELETE /identity/v3/projects/d39a128880624f41a3da08ced4deb30b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:48:46.912614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99793bb3-9680-4da3-ba16-58499c8fad01 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:46.913215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99793bb3-9680-4da3-ba16-58499c8fad01 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:46.913215 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99793bb3-9680-4da3-ba16-58499c8fad01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:46.937620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-99793bb3-9680-4da3-ba16-58499c8fad01 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:48:46.938308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-99793bb3-9680-4da3-ba16-58499c8fad01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:47.032643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1164/2365] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:48:47.033663 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cb016-be35-4e71-9830-de7c5da2cc09 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:47.034234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cb016-be35-4e71-9830-de7c5da2cc09 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:47.034234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cb016-be35-4e71-9830-de7c5da2cc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:47.059724 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-032cb016-be35-4e71-9830-de7c5da2cc09 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:48:47.061764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-032cb016-be35-4e71-9830-de7c5da2cc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:47.077470 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1202/2366] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:48:47.081453 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99793bb3-9680-4da3-ba16-58499c8fad01 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:47.093306 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99793bb3-9680-4da3-ba16-58499c8fad01 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:47.098205 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c3738-56b2-4064-910e-6c8c4c92c673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:47.098849 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c3738-56b2-4064-910e-6c8c4c92c673 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:47.099134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c3738-56b2-4064-910e-6c8c4c92c673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:47.099501 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c3738-56b2-4064-910e-6c8c4c92c673 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:47.100225 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c3738-56b2-4064-910e-6c8c4c92c673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:48:47.100538 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c3738-56b2-4064-910e-6c8c4c92c673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:47.102203 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c3738-56b2-4064-910e-6c8c4c92c673 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:47.115941 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1165/2367] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:48:47.120955 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cb016-be35-4e71-9830-de7c5da2cc09 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:47.136707 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cb016-be35-4e71-9830-de7c5da2cc09 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:47.145329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf0de8-b06a-448a-b258-574b22eacb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:47.146229 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf0de8-b06a-448a-b258-574b22eacb91 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:47.146523 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf0de8-b06a-448a-b258-574b22eacb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:47.146799 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf0de8-b06a-448a-b258-574b22eacb91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:47.147515 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf0de8-b06a-448a-b258-574b22eacb91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:47.149479 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf0de8-b06a-448a-b258-574b22eacb91 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:47.164703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:48:47.249146 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1203/2368] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:48:47 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:48:47.250753 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c3738-56b2-4064-910e-6c8c4c92c673 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:47.264197 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c3738-56b2-4064-910e-6c8c4c92c673 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:47.335899 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6f97c-184f-4e0b-abf7-93d6bb2edfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:47.336606 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6f97c-184f-4e0b-abf7-93d6bb2edfcb admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:47.337044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6f97c-184f-4e0b-abf7-93d6bb2edfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:47.337337 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6f97c-184f-4e0b-abf7-93d6bb2edfcb admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:47.338008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6f97c-184f-4e0b-abf7-93d6bb2edfcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:47.340160 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6f97c-184f-4e0b-abf7-93d6bb2edfcb admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:47.414714 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1166/2369] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:48:47 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:48:47.418993 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf0de8-b06a-448a-b258-574b22eacb91 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:47.430654 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf0de8-b06a-448a-b258-574b22eacb91 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:47.435834 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df66165-3654-4660-82cf-41004909e9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:47.436650 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df66165-3654-4660-82cf-41004909e9af admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:47.436940 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df66165-3654-4660-82cf-41004909e9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:47.437223 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df66165-3654-4660-82cf-41004909e9af admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:47.437965 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df66165-3654-4660-82cf-41004909e9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:47.439712 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df66165-3654-4660-82cf-41004909e9af admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:47.453045 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1204/2370] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:48:47.457902 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6f97c-184f-4e0b-abf7-93d6bb2edfcb admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:47.468917 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6f97c-184f-4e0b-abf7-93d6bb2edfcb admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:47.474238 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26107a4-a615-425d-9269-bea494dc1f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:47.474933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26107a4-a615-425d-9269-bea494dc1f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:47.475238 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26107a4-a615-425d-9269-bea494dc1f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:47.475835 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26107a4-a615-425d-9269-bea494dc1f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:47.476714 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26107a4-a615-425d-9269-bea494dc1f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:47.478481 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26107a4-a615-425d-9269-bea494dc1f05 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:47.494537 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1167/2371] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:48:47.499279 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df66165-3654-4660-82cf-41004909e9af admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:47.514537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df66165-3654-4660-82cf-41004909e9af admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:47.520146 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbbd94-9a17-4d86-877d-2396e5a04508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:47.520833 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbbd94-9a17-4d86-877d-2396e5a04508 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:47.521120 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbbd94-9a17-4d86-877d-2396e5a04508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:47.521454 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbbd94-9a17-4d86-877d-2396e5a04508 admin admin] PATH_INFO: `/v3/projects/f16dd5b6c48548a9909d6b2d9bef715f/users/868f014b54ad407e8c8f5656d1cc8484/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:47.541404 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbbd94-9a17-4d86-877d-2396e5a04508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16dd5b6c48548a9909d6b2d9bef715f, user_id=868f014b54ad407e8c8f5656d1cc8484, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:47.544770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbbd94-9a17-4d86-877d-2396e5a04508 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:47.634329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1205/2372] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:48:47 2022] PUT /identity/v3/projects/f16dd5b6c48548a9909d6b2d9bef715f/users/868f014b54ad407e8c8f5656d1cc8484/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:48:47.640029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7dac9-0319-473d-a9b3-6a8e16e884b7 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:47.640302 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7dac9-0319-473d-a9b3-6a8e16e884b7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:47.640594 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7dac9-0319-473d-a9b3-6a8e16e884b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:47.663558 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-69a7dac9-0319-473d-a9b3-6a8e16e884b7 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:48:47.664805 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-69a7dac9-0319-473d-a9b3-6a8e16e884b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:47.734409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:48:47.748287 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1168/2373] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:48:47.763424 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbbd94-9a17-4d86-877d-2396e5a04508 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:47.765406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-02bbbd94-9a17-4d86-877d-2396e5a04508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:47.832187 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbbd94-9a17-4d86-877d-2396e5a04508 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:47.836563 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e6eff-a52d-42da-9c04-01b6da5dc8dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:47.837300 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e6eff-a52d-42da-9c04-01b6da5dc8dd service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:47.837690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e6eff-a52d-42da-9c04-01b6da5dc8dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:47.838070 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e6eff-a52d-42da-9c04-01b6da5dc8dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:47.850345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e6eff-a52d-42da-9c04-01b6da5dc8dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:47.852140 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e6eff-a52d-42da-9c04-01b6da5dc8dd service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:47.864878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1206/2374] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:48:53.380580 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e7139-d397-494e-8d75-7282a89723a4 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:53.381250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e7139-d397-494e-8d75-7282a89723a4 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:53.381250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e7139-d397-494e-8d75-7282a89723a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:53.407387 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-d00e7139-d397-494e-8d75-7282a89723a4 None None] MFA Rules not processed for user `b05240b3f0bf40789d476e4bdad8bea0`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:48:53.409087 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d00e7139-d397-494e-8d75-7282a89723a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:53.484826 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1169/2375] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:48:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:48:54.734873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a89ae-ffef-44ce-98dc-affee557b7a2 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:54.735439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a89ae-ffef-44ce-98dc-affee557b7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:54.735536 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a89ae-ffef-44ce-98dc-affee557b7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:54.789583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-cb2a89ae-ffef-44ce-98dc-affee557b7a2 None None] MFA Rules not processed for user `868f014b54ad407e8c8f5656d1cc8484`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:48:54.791297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-cb2a89ae-ffef-44ce-98dc-affee557b7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:54.934062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e7139-d397-494e-8d75-7282a89723a4 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:54.939368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1207/2376] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:48:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:48:54.961016 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e7139-d397-494e-8d75-7282a89723a4 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:54.970830 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca710c17-b423-4675-8861-49ec629f1e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:54.971992 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca710c17-b423-4675-8861-49ec629f1e8d admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:54.989135 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca710c17-b423-4675-8861-49ec629f1e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:54.989135 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca710c17-b423-4675-8861-49ec629f1e8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:54.989135 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca710c17-b423-4675-8861-49ec629f1e8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:54.989135 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca710c17-b423-4675-8861-49ec629f1e8d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:55.096274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1170/2377] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:48:54 2022] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:48:55.099032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a89ae-ffef-44ce-98dc-affee557b7a2 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:55.115577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a89ae-ffef-44ce-98dc-affee557b7a2 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:55.179665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:48:55.199650 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd761f-3f94-4f10-9999-b5356ae0269f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:55.200659 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd761f-3f94-4f10-9999-b5356ae0269f admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:55.201124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd761f-3f94-4f10-9999-b5356ae0269f admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:55.201634 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd761f-3f94-4f10-9999-b5356ae0269f admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:55.202322 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd761f-3f94-4f10-9999-b5356ae0269f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:55.206213 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd761f-3f94-4f10-9999-b5356ae0269f admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:55.311082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1208/2378] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:48:55 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:48:55.315833 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca710c17-b423-4675-8861-49ec629f1e8d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:55.329550 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca710c17-b423-4675-8861-49ec629f1e8d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:55.335943 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8275be-d556-48fb-a5c1-172e52ea8497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:55.336879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8275be-d556-48fb-a5c1-172e52ea8497 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:55.337446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8275be-d556-48fb-a5c1-172e52ea8497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:55.337937 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8275be-d556-48fb-a5c1-172e52ea8497 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:55.338891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8275be-d556-48fb-a5c1-172e52ea8497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:55.342815 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8275be-d556-48fb-a5c1-172e52ea8497 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:55.366130 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1171/2379] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:48:55.367057 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd761f-3f94-4f10-9999-b5356ae0269f admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:55.382413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd761f-3f94-4f10-9999-b5356ae0269f admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:55.387916 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0efcb-fbfe-47be-89e9-ebae3c6d9c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:55.388719 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0efcb-fbfe-47be-89e9-ebae3c6d9c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:55.389168 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0efcb-fbfe-47be-89e9-ebae3c6d9c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:55.393094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0efcb-fbfe-47be-89e9-ebae3c6d9c33 admin admin] PATH_INFO: `/v3/projects/d1d735afd8e9406c86e926c8fddb783d/users/646e798fdc7140aab56af751d180da45/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:55.410292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0efcb-fbfe-47be-89e9-ebae3c6d9c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d735afd8e9406c86e926c8fddb783d, user_id=646e798fdc7140aab56af751d180da45, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:55.413003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0efcb-fbfe-47be-89e9-ebae3c6d9c33 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:55.473571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1209/2380] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:48:55 2022] PUT /identity/v3/projects/d1d735afd8e9406c86e926c8fddb783d/users/646e798fdc7140aab56af751d180da45/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:48:55.478444 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8275be-d556-48fb-a5c1-172e52ea8497 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:55.492203 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8275be-d556-48fb-a5c1-172e52ea8497 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:55.676830 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461754b-004e-4079-a4cf-287de5952f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:55.677802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461754b-004e-4079-a4cf-287de5952f83 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:55.678252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461754b-004e-4079-a4cf-287de5952f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:55.678762 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461754b-004e-4079-a4cf-287de5952f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:55.679726 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461754b-004e-4079-a4cf-287de5952f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:55.681863 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461754b-004e-4079-a4cf-287de5952f83 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:55.694810 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1172/2381] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:48:55.702676 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0efcb-fbfe-47be-89e9-ebae3c6d9c33 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:55.723189 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0efcb-fbfe-47be-89e9-ebae3c6d9c33 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:55.737400 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58662feb-88a8-4bcd-ad71-b3282d26683d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:55.738213 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58662feb-88a8-4bcd-ad71-b3282d26683d admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:55.738503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58662feb-88a8-4bcd-ad71-b3282d26683d admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:55.738786 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58662feb-88a8-4bcd-ad71-b3282d26683d admin admin] PATH_INFO: `/v3/projects/d1d735afd8e9406c86e926c8fddb783d/users/646e798fdc7140aab56af751d180da45/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:55.749305 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58662feb-88a8-4bcd-ad71-b3282d26683d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d735afd8e9406c86e926c8fddb783d, user_id=646e798fdc7140aab56af751d180da45, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:55.753164 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58662feb-88a8-4bcd-ad71-b3282d26683d admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:55.782271 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1210/2382] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:48:55 2022] PUT /identity/v3/projects/d1d735afd8e9406c86e926c8fddb783d/users/646e798fdc7140aab56af751d180da45/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:48:59.211391 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8171cc1-0468-461f-a6dd-bf047d3ea18a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:59.218785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8171cc1-0468-461f-a6dd-bf047d3ea18a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:59.218785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8171cc1-0468-461f-a6dd-bf047d3ea18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:59.241867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b8171cc1-0468-461f-a6dd-bf047d3ea18a None None] MFA Rules not processed for user `5b4c4184e87b4dc5a4047310cd0122ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:48:59.242998 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b8171cc1-0468-461f-a6dd-bf047d3ea18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:59.367664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1173/2383] 10.222.0.65 () {58 vars in 967 bytes} [Wed Jul 27 18:48:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:48:59.409217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58662feb-88a8-4bcd-ad71-b3282d26683d admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:48:59.409920 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-58662feb-88a8-4bcd-ad71-b3282d26683d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:48:59.623523 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58662feb-88a8-4bcd-ad71-b3282d26683d admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:48:59.637334 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb2f36-bb5a-469b-8e89-d7e61f9988bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7832398e97af4e539e10d1eef49f6d6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:48:59.638368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb2f36-bb5a-469b-8e89-d7e61f9988bc service swift] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:48:59.638844 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb2f36-bb5a-469b-8e89-d7e61f9988bc service swift] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:48:59.639394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb2f36-bb5a-469b-8e89-d7e61f9988bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:48:59.651282 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb2f36-bb5a-469b-8e89-d7e61f9988bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:48:59.653582 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb2f36-bb5a-469b-8e89-d7e61f9988bc service swift] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:48:59.672664 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1211/2384] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 18:48:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:49:04.246094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8171cc1-0468-461f-a6dd-bf047d3ea18a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:49:04.247770 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b8171cc1-0468-461f-a6dd-bf047d3ea18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:49:04.270019 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:49:04.417592 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8171cc1-0468-461f-a6dd-bf047d3ea18a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:49:04.437559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2baed03-4b75-4bd5-a3a3-8bf86837f180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:49:04.437559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baed03-4b75-4bd5-a3a3-8bf86837f180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:04.437559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baed03-4b75-4bd5-a3a3-8bf86837f180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:04.437559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baed03-4b75-4bd5-a3a3-8bf86837f180 admin admin] PATH_INFO: `/v3/users/c09b1d84cda94d41a8835c99a7aaac4a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:04.440927 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2baed03-4b75-4bd5-a3a3-8bf86837f180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c09b1d84cda94d41a8835c99a7aaac4a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:49:04.446080 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2baed03-4b75-4bd5-a3a3-8bf86837f180 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:49:04.564961 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f510fab-d004-495d-a600-4d8a267dfc98 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:04.568441 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f510fab-d004-495d-a600-4d8a267dfc98 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:04.568441 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f510fab-d004-495d-a600-4d8a267dfc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:04.660055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-4f510fab-d004-495d-a600-4d8a267dfc98 None None] MFA Rules not processed for user `646e798fdc7140aab56af751d180da45`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:49:04.670686 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4f510fab-d004-495d-a600-4d8a267dfc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:49:04.692005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e2baed03-4b75-4bd5-a3a3-8bf86837f180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c09b1d84cda94d41a8835c99a7aaac4a'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:49:04.693197 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e2baed03-4b75-4bd5-a3a3-8bf86837f180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c09b1d84cda94d41a8835c99a7aaac4a'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:49:04.778982 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e2baed03-4b75-4bd5-a3a3-8bf86837f180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c09b1d84cda94d41a8835c99a7aaac4a'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:49:04.804956 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e2baed03-4b75-4bd5-a3a3-8bf86837f180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c09b1d84cda94d41a8835c99a7aaac4a'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:49:04.805826 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e2baed03-4b75-4bd5-a3a3-8bf86837f180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c09b1d84cda94d41a8835c99a7aaac4a'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:49:04.830810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1212/2385] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:49:04 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:49:04.834995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1174/2386] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:49:04 2022] DELETE /identity/v3/users/c09b1d84cda94d41a8835c99a7aaac4a => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:49:04.843116 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f510fab-d004-495d-a600-4d8a267dfc98 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:49:04.845873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4f510fab-d004-495d-a600-4d8a267dfc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:49:04.872976 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:49:05.007047 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f510fab-d004-495d-a600-4d8a267dfc98 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:49:05.118016 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d23ea3-6428-43f4-aad2-a6588df0b70e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:49:05.119216 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d23ea3-6428-43f4-aad2-a6588df0b70e service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:05.119456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d23ea3-6428-43f4-aad2-a6588df0b70e service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:05.119872 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d23ea3-6428-43f4-aad2-a6588df0b70e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:05.122339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-d2d23ea3-6428-43f4-aad2-a6588df0b70e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:49:05.255530 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d23ea3-6428-43f4-aad2-a6588df0b70e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:49:05.258463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d23ea3-6428-43f4-aad2-a6588df0b70e service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:49:05.297418 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1213/2387] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:49:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:49:05.347967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2baed03-4b75-4bd5-a3a3-8bf86837f180 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:49:05.349891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e2baed03-4b75-4bd5-a3a3-8bf86837f180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:49:05.455621 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2baed03-4b75-4bd5-a3a3-8bf86837f180 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:49:05.474079 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12432de4-c610-47eb-bf5a-07422d568278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:49:05.474079 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12432de4-c610-47eb-bf5a-07422d568278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:05.474079 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12432de4-c610-47eb-bf5a-07422d568278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:05.474079 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12432de4-c610-47eb-bf5a-07422d568278 admin admin] PATH_INFO: `/v3/projects/087c953588c2462cba6cf3a071e28a53` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:05.475039 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12432de4-c610-47eb-bf5a-07422d568278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=087c953588c2462cba6cf3a071e28a53)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:49:05.475039 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12432de4-c610-47eb-bf5a-07422d568278 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:49:05.615404 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:49:05.641491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-12432de4-c610-47eb-bf5a-07422d568278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '087c953588c2462cba6cf3a071e28a53', 'request_id': 'req-12432de4-c610-47eb-bf5a-07422d568278'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:49:05.655149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-12432de4-c610-47eb-bf5a-07422d568278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '087c953588c2462cba6cf3a071e28a53', 'request_id': 'req-12432de4-c610-47eb-bf5a-07422d568278'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:49:05.722544 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-12432de4-c610-47eb-bf5a-07422d568278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '087c953588c2462cba6cf3a071e28a53', 'request_id': 'req-12432de4-c610-47eb-bf5a-07422d568278'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:49:05.737032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-12432de4-c610-47eb-bf5a-07422d568278 admin admin] The token cache is being invalidate because project 087c953588c2462cba6cf3a071e28a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:49:05.738256 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-12432de4-c610-47eb-bf5a-07422d568278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:49:05.740993 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-12432de4-c610-47eb-bf5a-07422d568278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:49:05.746091 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1175/2388] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:49:05 2022] DELETE /identity/v3/projects/087c953588c2462cba6cf3a071e28a53 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:49:05.748429 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fc300-5bc0-499d-9a43-42f2d11ddfe6 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:05.749245 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fc300-5bc0-499d-9a43-42f2d11ddfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:05.749537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fc300-5bc0-499d-9a43-42f2d11ddfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:05.793914 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-ba5fc300-5bc0-499d-9a43-42f2d11ddfe6 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:49:05.795847 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ba5fc300-5bc0-499d-9a43-42f2d11ddfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:49:05.873232 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:49:05.900379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1214/2389] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:49:05.901330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf151c-5fda-4fba-954d-95455c301fcd None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:05.905563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf151c-5fda-4fba-954d-95455c301fcd None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:05.905563 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf151c-5fda-4fba-954d-95455c301fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:05.929408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c5bf151c-5fda-4fba-954d-95455c301fcd None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:49:05.930877 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c5bf151c-5fda-4fba-954d-95455c301fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:49:05.941515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1176/2390] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:49:05.945678 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fc300-5bc0-499d-9a43-42f2d11ddfe6 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:49:05.956591 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fc300-5bc0-499d-9a43-42f2d11ddfe6 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:49:05.962301 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e1665-b725-4200-b7cb-d5bb94a6556a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:49:05.963088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e1665-b725-4200-b7cb-d5bb94a6556a admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:05.963504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e1665-b725-4200-b7cb-d5bb94a6556a admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:05.963858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e1665-b725-4200-b7cb-d5bb94a6556a admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:05.964653 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e1665-b725-4200-b7cb-d5bb94a6556a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:49:05.965045 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e1665-b725-4200-b7cb-d5bb94a6556a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:49:05.967083 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e1665-b725-4200-b7cb-d5bb94a6556a admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:49:06.007207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1215/2391] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:49:06.008437 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf151c-5fda-4fba-954d-95455c301fcd None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:49:06.019253 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf151c-5fda-4fba-954d-95455c301fcd None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:49:06.027603 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62378147-0b5e-483f-8284-a8e83beb3252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:49:06.035707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62378147-0b5e-483f-8284-a8e83beb3252 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:06.036236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62378147-0b5e-483f-8284-a8e83beb3252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:06.036733 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62378147-0b5e-483f-8284-a8e83beb3252 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:06.037705 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62378147-0b5e-483f-8284-a8e83beb3252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:49:06.040793 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62378147-0b5e-483f-8284-a8e83beb3252 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:49:06.166775 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1177/2392] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:49:06 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:49:06.175734 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e1665-b725-4200-b7cb-d5bb94a6556a admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:49:06.190564 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e1665-b725-4200-b7cb-d5bb94a6556a admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:49:06.301180 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e687bc-fdfb-406a-91c1-0e33140a5d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:49:06.301953 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e687bc-fdfb-406a-91c1-0e33140a5d97 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:06.302166 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e687bc-fdfb-406a-91c1-0e33140a5d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:06.302474 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e687bc-fdfb-406a-91c1-0e33140a5d97 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:06.303286 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e687bc-fdfb-406a-91c1-0e33140a5d97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:49:06.305203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e687bc-fdfb-406a-91c1-0e33140a5d97 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:49:06.426125 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1216/2393] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:49:06 2022] POST /identity/v3/users => generated 291 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:49:06.430351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62378147-0b5e-483f-8284-a8e83beb3252 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:49:06.441207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62378147-0b5e-483f-8284-a8e83beb3252 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:49:06.445768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce3513-4d98-422b-b367-93680b49b08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:49:06.446462 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce3513-4d98-422b-b367-93680b49b08d admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:06.446802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce3513-4d98-422b-b367-93680b49b08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:06.447087 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce3513-4d98-422b-b367-93680b49b08d admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:06.447984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce3513-4d98-422b-b367-93680b49b08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:49:06.449497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce3513-4d98-422b-b367-93680b49b08d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:49:06.464079 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1178/2394] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:49:06.467747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e687bc-fdfb-406a-91c1-0e33140a5d97 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:49:06.481239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e687bc-fdfb-406a-91c1-0e33140a5d97 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:49:06.489038 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764fabc-9356-451b-a0d9-6088f0974c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:49:06.489752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764fabc-9356-451b-a0d9-6088f0974c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:06.490384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764fabc-9356-451b-a0d9-6088f0974c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:06.490769 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764fabc-9356-451b-a0d9-6088f0974c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:06.492402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764fabc-9356-451b-a0d9-6088f0974c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:49:06.494780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764fabc-9356-451b-a0d9-6088f0974c21 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:49:06.513197 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1217/2395] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:49:06.513423 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce3513-4d98-422b-b367-93680b49b08d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:49:06.527381 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce3513-4d98-422b-b367-93680b49b08d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:49:06.536519 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d97e2-a50d-4157-af1e-bdfd9fdde440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:49:06.536733 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d97e2-a50d-4157-af1e-bdfd9fdde440 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:06.537180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d97e2-a50d-4157-af1e-bdfd9fdde440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:06.537759 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d97e2-a50d-4157-af1e-bdfd9fdde440 admin admin] PATH_INFO: `/v3/projects/458a93b8b3d647e7aeacbac263848be3/users/7d75f170844342ffaf9101da660ac871/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:06.591285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d97e2-a50d-4157-af1e-bdfd9fdde440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=458a93b8b3d647e7aeacbac263848be3, user_id=7d75f170844342ffaf9101da660ac871, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:49:06.599348 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d97e2-a50d-4157-af1e-bdfd9fdde440 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:49:06.697899 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1179/2396] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:49:06 2022] PUT /identity/v3/projects/458a93b8b3d647e7aeacbac263848be3/users/7d75f170844342ffaf9101da660ac871/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:49:06.703414 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86f7a8-975f-4cf1-8ca7-fc1478183d24 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:06.703705 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86f7a8-975f-4cf1-8ca7-fc1478183d24 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:06.708897 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86f7a8-975f-4cf1-8ca7-fc1478183d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:06.735929 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-9d86f7a8-975f-4cf1-8ca7-fc1478183d24 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:49:06.737325 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-9d86f7a8-975f-4cf1-8ca7-fc1478183d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:49:06.823531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1218/2397] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:49:06.834496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d97e2-a50d-4157-af1e-bdfd9fdde440 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:49:06.836330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f02d97e2-a50d-4157-af1e-bdfd9fdde440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:49:06.935117 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d97e2-a50d-4157-af1e-bdfd9fdde440 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:49:06.943811 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6609c-65ca-4489-ad2b-cbfdd96762d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:49:06.945509 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6609c-65ca-4489-ad2b-cbfdd96762d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:06.946257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6609c-65ca-4489-ad2b-cbfdd96762d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:06.947226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6609c-65ca-4489-ad2b-cbfdd96762d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:06.963965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6609c-65ca-4489-ad2b-cbfdd96762d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:49:06.966222 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6609c-65ca-4489-ad2b-cbfdd96762d6 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:49:06.995859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1180/2398] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:49:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:49:08.646980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a8696-235e-4c9f-91a5-53f30a481ffe None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:08.648329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a8696-235e-4c9f-91a5-53f30a481ffe None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:08.648814 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a8696-235e-4c9f-91a5-53f30a481ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:08.687084 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2f798-c187-4156-bdd7-a8468b39f533 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:08.687557 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2f798-c187-4156-bdd7-a8468b39f533 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:08.687557 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2f798-c187-4156-bdd7-a8468b39f533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:08.708427 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-b88a8696-235e-4c9f-91a5-53f30a481ffe None None] MFA Rules not processed for user `7d75f170844342ffaf9101da660ac871`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:49:08.709693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c6d2f798-c187-4156-bdd7-a8468b39f533 None None] MFA Rules not processed for user `868f014b54ad407e8c8f5656d1cc8484`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:49:08.709819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b88a8696-235e-4c9f-91a5-53f30a481ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:49:08.710976 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c6d2f798-c187-4156-bdd7-a8468b39f533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:49:08.770807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:49:08.777444 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1181/2399] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:49:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:49:08.778950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d23dba-62b7-4472-8478-cb8f90499056 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:08.779456 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d23dba-62b7-4472-8478-cb8f90499056 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:08.779930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d23dba-62b7-4472-8478-cb8f90499056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:08.790993 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:49:08.806372 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-98d23dba-62b7-4472-8478-cb8f90499056 None None] MFA Rules not processed for user `b25caac30f7641f0b0d746ebff0b54b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:49:08.807760 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-98d23dba-62b7-4472-8478-cb8f90499056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:49:08.817020 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1219/2400] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:49:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:49:08.831233 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a8696-235e-4c9f-91a5-53f30a481ffe None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:49:08.831233 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b88a8696-235e-4c9f-91a5-53f30a481ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:49:08.889423 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1182/2401] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:49:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:49:08.921204 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a8696-235e-4c9f-91a5-53f30a481ffe None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:49:08.926219 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23da6d-f852-4a4d-bae1-e02e2f4072b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:49:08.932048 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23da6d-f852-4a4d-bae1-e02e2f4072b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:08.933114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23da6d-f852-4a4d-bae1-e02e2f4072b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:08.933881 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23da6d-f852-4a4d-bae1-e02e2f4072b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:08.950832 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23da6d-f852-4a4d-bae1-e02e2f4072b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:49:08.952370 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23da6d-f852-4a4d-bae1-e02e2f4072b5 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:49:08.967079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1220/2402] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:49:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:49:10.897809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3895f65-a6bd-4c90-a67d-682f70165bd5 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:10.898428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3895f65-a6bd-4c90-a67d-682f70165bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:10.898780 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3895f65-a6bd-4c90-a67d-682f70165bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:10.919889 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c3895f65-a6bd-4c90-a67d-682f70165bd5 None None] MFA Rules not processed for user `7d75f170844342ffaf9101da660ac871`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:49:10.921104 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c3895f65-a6bd-4c90-a67d-682f70165bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:49:10.928549 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1183/2403] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:49:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:49:19.161962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=33 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:49:20.914266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=27 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:49:40.407043 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23da6d-f852-4a4d-bae1-e02e2f4072b5 service cinder] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:49:40.417921 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23da6d-f852-4a4d-bae1-e02e2f4072b5 service cinder] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:49:40.422122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2a3b1-ee1c-439f-a21d-c99c4235d57e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:49:40.422850 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2a3b1-ee1c-439f-a21d-c99c4235d57e service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:40.423295 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2a3b1-ee1c-439f-a21d-c99c4235d57e service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:40.423574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2a3b1-ee1c-439f-a21d-c99c4235d57e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:40.425473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e8f2a3b1-ee1c-439f-a21d-c99c4235d57e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:49:40.495366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2a3b1-ee1c-439f-a21d-c99c4235d57e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:49:40.496943 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2a3b1-ee1c-439f-a21d-c99c4235d57e service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:49:40.507865 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1221/2404] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:49:40 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:49:41.626502 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e4e1b-4064-403b-a56c-4431c6a5a5ff None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:41.627060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e4e1b-4064-403b-a56c-4431c6a5a5ff None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:41.627060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e4e1b-4064-403b-a56c-4431c6a5a5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:41.647993 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-914e4e1b-4064-403b-a56c-4431c6a5a5ff None None] MFA Rules not processed for user `91402fce003f49cf9b3cb3c170fbed71`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:49:41.649223 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-914e4e1b-4064-403b-a56c-4431c6a5a5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:49:41.705495 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1184/2405] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:49:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:49:47.805498 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61d093-8f25-420c-9a0a-8ad916a10097 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:47.806433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61d093-8f25-420c-9a0a-8ad916a10097 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:47.806433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61d093-8f25-420c-9a0a-8ad916a10097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:47.827135 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-1f61d093-8f25-420c-9a0a-8ad916a10097 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:49:47.828403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-1f61d093-8f25-420c-9a0a-8ad916a10097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:49:47.837931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1222/2406] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Jul 27 18:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:49:47.859114 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e4e1b-4064-403b-a56c-4431c6a5a5ff None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:49:47.860675 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-914e4e1b-4064-403b-a56c-4431c6a5a5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:49:47.946381 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e4e1b-4064-403b-a56c-4431c6a5a5ff None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:49:47.952274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc0619-3051-4c16-ac49-e490a69f8035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:49:47.952915 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc0619-3051-4c16-ac49-e490a69f8035 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:47.953196 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc0619-3051-4c16-ac49-e490a69f8035 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:47.953481 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc0619-3051-4c16-ac49-e490a69f8035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:47.968067 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc0619-3051-4c16-ac49-e490a69f8035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:49:47.968067 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc0619-3051-4c16-ac49-e490a69f8035 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:49:47.978577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1185/2407] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:49:52.033116 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49bcdd-9d50-4644-ac21-40e6fdfe817b None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:52.033723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49bcdd-9d50-4644-ac21-40e6fdfe817b None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:52.033723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49bcdd-9d50-4644-ac21-40e6fdfe817b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:52.053416 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-5e49bcdd-9d50-4644-ac21-40e6fdfe817b None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:49:52.054615 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5e49bcdd-9d50-4644-ac21-40e6fdfe817b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:49:52.062944 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1223/2408] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Jul 27 18:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:49:52.078408 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc0619-3051-4c16-ac49-e490a69f8035 service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:49:52.079926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6afc0619-3051-4c16-ac49-e490a69f8035 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:49:52.095362 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc0619-3051-4c16-ac49-e490a69f8035 service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:49:52.101551 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ebb6d-2e19-411f-85fc-7ace3b706ffb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:49:52.102310 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ebb6d-2e19-411f-85fc-7ace3b706ffb service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:52.102601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ebb6d-2e19-411f-85fc-7ace3b706ffb service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:52.102883 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ebb6d-2e19-411f-85fc-7ace3b706ffb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:52.111631 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ebb6d-2e19-411f-85fc-7ace3b706ffb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:49:52.113270 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ebb6d-2e19-411f-85fc-7ace3b706ffb service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:49:52.123187 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1186/2409] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:49:57.765285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b23d1-d232-46cc-a6b4-4b671d53b67c None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:57.765845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b23d1-d232-46cc-a6b4-4b671d53b67c None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:57.765845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b23d1-d232-46cc-a6b4-4b671d53b67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:57.786484 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-a03b23d1-d232-46cc-a6b4-4b671d53b67c None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:49:57.787788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a03b23d1-d232-46cc-a6b4-4b671d53b67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:49:57.797859 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1224/2410] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Jul 27 18:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:49:57.812899 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ebb6d-2e19-411f-85fc-7ace3b706ffb service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:49:57.825536 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ebb6d-2e19-411f-85fc-7ace3b706ffb service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:49:57.832404 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791eb3d-8658-4bf7-a203-332202bd2dad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:49:57.833034 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791eb3d-8658-4bf7-a203-332202bd2dad service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:57.833323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791eb3d-8658-4bf7-a203-332202bd2dad service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:57.833623 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791eb3d-8658-4bf7-a203-332202bd2dad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:57.843681 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791eb3d-8658-4bf7-a203-332202bd2dad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:49:57.845482 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791eb3d-8658-4bf7-a203-332202bd2dad service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:49:57.858273 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1187/2411] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:49:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:50:05.788622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa9764-6107-4d84-9f18-dfeac8759ec6 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:05.788622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa9764-6107-4d84-9f18-dfeac8759ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:05.788622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa9764-6107-4d84-9f18-dfeac8759ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:05.811373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-2daa9764-6107-4d84-9f18-dfeac8759ec6 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:50:05.811373 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2daa9764-6107-4d84-9f18-dfeac8759ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:05.818651 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1225/2412] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Jul 27 18:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:50:05.840513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791eb3d-8658-4bf7-a203-332202bd2dad service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:05.850922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791eb3d-8658-4bf7-a203-332202bd2dad service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:05.856988 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523a5cb-a803-4b99-a53a-7d8467797286 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:05.857620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523a5cb-a803-4b99-a53a-7d8467797286 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:05.857900 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523a5cb-a803-4b99-a53a-7d8467797286 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:05.858174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523a5cb-a803-4b99-a53a-7d8467797286 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:05.869196 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523a5cb-a803-4b99-a53a-7d8467797286 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:05.871811 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523a5cb-a803-4b99-a53a-7d8467797286 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:05.884310 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1188/2413] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:50:10.044793 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445f4d6-0737-4cce-a3ab-5e182fc4e95f None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:10.045313 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445f4d6-0737-4cce-a3ab-5e182fc4e95f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:10.045313 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445f4d6-0737-4cce-a3ab-5e182fc4e95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:10.054411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=43 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:50:10.067971 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-6445f4d6-0737-4cce-a3ab-5e182fc4e95f None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:50:10.069337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-6445f4d6-0737-4cce-a3ab-5e182fc4e95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:10.077840 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1226/2414] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Jul 27 18:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:50:10.107651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523a5cb-a803-4b99-a53a-7d8467797286 service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:10.114695 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523a5cb-a803-4b99-a53a-7d8467797286 service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:10.120589 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9414c47-a2e2-46b4-aac8-a445497891dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:10.121212 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9414c47-a2e2-46b4-aac8-a445497891dd service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:10.121489 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9414c47-a2e2-46b4-aac8-a445497891dd service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:10.121810 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9414c47-a2e2-46b4-aac8-a445497891dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:10.131308 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9414c47-a2e2-46b4-aac8-a445497891dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:10.132933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9414c47-a2e2-46b4-aac8-a445497891dd service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:10.143435 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1189/2415] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:50:12.691789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445f4d6-0737-4cce-a3ab-5e182fc4e95f None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:12.695413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-6445f4d6-0737-4cce-a3ab-5e182fc4e95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:12.715513 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445f4d6-0737-4cce-a3ab-5e182fc4e95f None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:12.720400 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156f925-38a4-4f8a-9a5b-d0a616bfb406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:12.721051 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156f925-38a4-4f8a-9a5b-d0a616bfb406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:12.721503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156f925-38a4-4f8a-9a5b-d0a616bfb406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:12.722813 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156f925-38a4-4f8a-9a5b-d0a616bfb406 admin admin] PATH_INFO: `/v3/users/b05240b3f0bf40789d476e4bdad8bea0` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:12.724417 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156f925-38a4-4f8a-9a5b-d0a616bfb406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05240b3f0bf40789d476e4bdad8bea0)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:12.726537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156f925-38a4-4f8a-9a5b-d0a616bfb406 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:12.916450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0156f925-38a4-4f8a-9a5b-d0a616bfb406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05240b3f0bf40789d476e4bdad8bea0'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:50:12.917394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0156f925-38a4-4f8a-9a5b-d0a616bfb406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05240b3f0bf40789d476e4bdad8bea0'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:50:12.987582 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0156f925-38a4-4f8a-9a5b-d0a616bfb406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05240b3f0bf40789d476e4bdad8bea0'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:50:13.001137 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0156f925-38a4-4f8a-9a5b-d0a616bfb406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05240b3f0bf40789d476e4bdad8bea0'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:50:13.008524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0156f925-38a4-4f8a-9a5b-d0a616bfb406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05240b3f0bf40789d476e4bdad8bea0'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:50:13.014723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1227/2416] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:50:12 2022] DELETE /identity/v3/users/b05240b3f0bf40789d476e4bdad8bea0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:50:13.281611 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9414c47-a2e2-46b4-aac8-a445497891dd service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:13.287817 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=84 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:50:13.294784 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9414c47-a2e2-46b4-aac8-a445497891dd service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:13.322625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75f501-d5e9-4e58-b0a9-54f6a0d8d630 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:13.322921 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75f501-d5e9-4e58-b0a9-54f6a0d8d630 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:13.323205 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75f501-d5e9-4e58-b0a9-54f6a0d8d630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:13.344270 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-2f75f501-d5e9-4e58-b0a9-54f6a0d8d630 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:50:13.345643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2f75f501-d5e9-4e58-b0a9-54f6a0d8d630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:13.357982 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16672860-c0cc-414b-8a07-8b9b12e67f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:13.358634 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16672860-c0cc-414b-8a07-8b9b12e67f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:13.358925 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16672860-c0cc-414b-8a07-8b9b12e67f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:13.359208 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16672860-c0cc-414b-8a07-8b9b12e67f56 admin admin] PATH_INFO: `/v3/projects/cfc3633f57a545048abf93eb58e0f77e` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:13.360441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16672860-c0cc-414b-8a07-8b9b12e67f56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfc3633f57a545048abf93eb58e0f77e)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:13.362375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16672860-c0cc-414b-8a07-8b9b12e67f56 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:13.409071 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1228/2417] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Jul 27 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:50:13.426497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75f501-d5e9-4e58-b0a9-54f6a0d8d630 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:13.428040 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2f75f501-d5e9-4e58-b0a9-54f6a0d8d630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:13.472818 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-16672860-c0cc-414b-8a07-8b9b12e67f56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfc3633f57a545048abf93eb58e0f77e', 'request_id': 'req-16672860-c0cc-414b-8a07-8b9b12e67f56'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:50:13.479149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-16672860-c0cc-414b-8a07-8b9b12e67f56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfc3633f57a545048abf93eb58e0f77e', 'request_id': 'req-16672860-c0cc-414b-8a07-8b9b12e67f56'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:50:13.506069 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75f501-d5e9-4e58-b0a9-54f6a0d8d630 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:13.509612 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:50:13.544720 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-16672860-c0cc-414b-8a07-8b9b12e67f56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfc3633f57a545048abf93eb58e0f77e', 'request_id': 'req-16672860-c0cc-414b-8a07-8b9b12e67f56'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:50:13.558633 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-16672860-c0cc-414b-8a07-8b9b12e67f56 admin admin] The token cache is being invalidate because project cfc3633f57a545048abf93eb58e0f77e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:50:13.558926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-16672860-c0cc-414b-8a07-8b9b12e67f56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:50:13.561684 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-16672860-c0cc-414b-8a07-8b9b12e67f56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:50:13.561684 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1190/2418] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:50:13 2022] DELETE /identity/v3/projects/cfc3633f57a545048abf93eb58e0f77e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:50:13.566309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ec859-2fe6-4260-b45a-155f968ddba0 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:13.566598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ec859-2fe6-4260-b45a-155f968ddba0 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:13.566878 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ec859-2fe6-4260-b45a-155f968ddba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:13.570413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e9a7f-9b0b-40b4-ac53-3259dca3eb92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:13.571044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e9a7f-9b0b-40b4-ac53-3259dca3eb92 service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:13.571345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e9a7f-9b0b-40b4-ac53-3259dca3eb92 service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:13.571624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e9a7f-9b0b-40b4-ac53-3259dca3eb92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:13.573353 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-100e9a7f-9b0b-40b4-ac53-3259dca3eb92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:13.587649 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-3e2ec859-2fe6-4260-b45a-155f968ddba0 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:50:13.589013 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-3e2ec859-2fe6-4260-b45a-155f968ddba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:13.638469 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e9a7f-9b0b-40b4-ac53-3259dca3eb92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:13.640121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e9a7f-9b0b-40b4-ac53-3259dca3eb92 service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:13.650672 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1229/2419] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:50:13.651371 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1191/2420] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:50:13.661462 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c60367-18a9-4082-b156-2d0db0a08cf5 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:13.661651 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c60367-18a9-4082-b156-2d0db0a08cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:13.661927 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c60367-18a9-4082-b156-2d0db0a08cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:13.681153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-00c60367-18a9-4082-b156-2d0db0a08cf5 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:50:13.682352 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-00c60367-18a9-4082-b156-2d0db0a08cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:13.690682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1230/2421] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:50:13.695809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ec859-2fe6-4260-b45a-155f968ddba0 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:13.707843 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ec859-2fe6-4260-b45a-155f968ddba0 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:13.712619 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701dda4-c870-49eb-9909-1b916eee9d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:13.713238 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701dda4-c870-49eb-9909-1b916eee9d91 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:13.713536 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701dda4-c870-49eb-9909-1b916eee9d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:13.713793 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701dda4-c870-49eb-9909-1b916eee9d91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:13.714500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701dda4-c870-49eb-9909-1b916eee9d91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:50:13.714802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701dda4-c870-49eb-9909-1b916eee9d91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:13.716833 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701dda4-c870-49eb-9909-1b916eee9d91 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:13.729477 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1192/2422] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:50:13.743374 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c60367-18a9-4082-b156-2d0db0a08cf5 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:13.746341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c60367-18a9-4082-b156-2d0db0a08cf5 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:13.751150 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72447d-e661-472d-b619-1776d2d463d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:13.751867 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72447d-e661-472d-b619-1776d2d463d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:13.752154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72447d-e661-472d-b619-1776d2d463d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:13.752444 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72447d-e661-472d-b619-1776d2d463d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:13.753104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72447d-e661-472d-b619-1776d2d463d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:13.755786 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72447d-e661-472d-b619-1776d2d463d7 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:13.899716 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1231/2423] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:50:13 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:50:13.904016 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701dda4-c870-49eb-9909-1b916eee9d91 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:13.914640 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701dda4-c870-49eb-9909-1b916eee9d91 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:13.932376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:50:13.971519 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00fe2e-83fc-4506-8d28-107ca850d0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:13.972137 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00fe2e-83fc-4506-8d28-107ca850d0a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:13.972910 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00fe2e-83fc-4506-8d28-107ca850d0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:13.973187 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00fe2e-83fc-4506-8d28-107ca850d0a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:13.973982 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00fe2e-83fc-4506-8d28-107ca850d0a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:13.975942 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00fe2e-83fc-4506-8d28-107ca850d0a0 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:14.090914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1193/2424] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:50:13 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:50:14.092387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72447d-e661-472d-b619-1776d2d463d7 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:14.103557 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72447d-e661-472d-b619-1776d2d463d7 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:14.108385 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7cfa7-ff46-4e1c-be8d-c0a022d18c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:14.109010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7cfa7-ff46-4e1c-be8d-c0a022d18c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:14.109296 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7cfa7-ff46-4e1c-be8d-c0a022d18c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:14.109573 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7cfa7-ff46-4e1c-be8d-c0a022d18c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:14.110270 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7cfa7-ff46-4e1c-be8d-c0a022d18c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:14.111937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7cfa7-ff46-4e1c-be8d-c0a022d18c88 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:14.122284 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1232/2425] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:50:14.126433 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00fe2e-83fc-4506-8d28-107ca850d0a0 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:14.137503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00fe2e-83fc-4506-8d28-107ca850d0a0 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:14.142208 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83aa76-a9e7-4df7-ba84-ffc54421d1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:14.142804 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83aa76-a9e7-4df7-ba84-ffc54421d1ab admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:14.143114 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83aa76-a9e7-4df7-ba84-ffc54421d1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:14.143428 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83aa76-a9e7-4df7-ba84-ffc54421d1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:14.144133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83aa76-a9e7-4df7-ba84-ffc54421d1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:14.146354 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83aa76-a9e7-4df7-ba84-ffc54421d1ab admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:14.157864 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1194/2426] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:50:14.161681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7cfa7-ff46-4e1c-be8d-c0a022d18c88 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:14.172047 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7cfa7-ff46-4e1c-be8d-c0a022d18c88 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:14.177501 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1795440-1123-4848-9b5f-46ff326eb36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:14.178176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795440-1123-4848-9b5f-46ff326eb36b admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:14.178464 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795440-1123-4848-9b5f-46ff326eb36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:14.178745 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795440-1123-4848-9b5f-46ff326eb36b admin admin] PATH_INFO: `/v3/projects/52d2a291e9e94d30b7bb8f47d7506fb7/users/7063b5053f164bba83cd0c17d66cbdff/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:14.194699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1795440-1123-4848-9b5f-46ff326eb36b admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d2a291e9e94d30b7bb8f47d7506fb7, user_id=7063b5053f164bba83cd0c17d66cbdff, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:14.197443 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1795440-1123-4848-9b5f-46ff326eb36b admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:14.309293 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1233/2427] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:50:14 2022] PUT /identity/v3/projects/52d2a291e9e94d30b7bb8f47d7506fb7/users/7063b5053f164bba83cd0c17d66cbdff/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:50:14.314478 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e87f06-23bc-4751-b6cb-2872da13cc57 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:14.315047 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e87f06-23bc-4751-b6cb-2872da13cc57 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:14.315249 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e87f06-23bc-4751-b6cb-2872da13cc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:14.337339 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-18e87f06-23bc-4751-b6cb-2872da13cc57 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:50:14.338580 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-18e87f06-23bc-4751-b6cb-2872da13cc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:14.404126 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1195/2428] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:50:14.415360 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1795440-1123-4848-9b5f-46ff326eb36b admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:14.417164 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-d1795440-1123-4848-9b5f-46ff326eb36b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:14.458240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:50:14.475363 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1795440-1123-4848-9b5f-46ff326eb36b admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:14.479034 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb8ad5-8cf5-4555-b560-fb5e0ad29748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:14.479705 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb8ad5-8cf5-4555-b560-fb5e0ad29748 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:14.479978 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb8ad5-8cf5-4555-b560-fb5e0ad29748 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:14.480250 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb8ad5-8cf5-4555-b560-fb5e0ad29748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:14.489563 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb8ad5-8cf5-4555-b560-fb5e0ad29748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:14.491002 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb8ad5-8cf5-4555-b560-fb5e0ad29748 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:14.500480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1234/2429] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:50:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:50:16.457247 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e87f06-23bc-4751-b6cb-2872da13cc57 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:16.461357 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-18e87f06-23bc-4751-b6cb-2872da13cc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:16.569652 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb8ad5-8cf5-4555-b560-fb5e0ad29748 service neutron] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:16.570249 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e87f06-23bc-4751-b6cb-2872da13cc57 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:16.573904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8c675-16b1-4aba-984a-88677f4c0aee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:16.574733 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8c675-16b1-4aba-984a-88677f4c0aee service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:16.575180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8c675-16b1-4aba-984a-88677f4c0aee service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:16.575660 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8c675-16b1-4aba-984a-88677f4c0aee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:16.578461 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb8ad5-8cf5-4555-b560-fb5e0ad29748 service neutron] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:16.580624 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-3dd8c675-16b1-4aba-984a-88677f4c0aee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:16.586954 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb743349-9b1f-430a-b9de-8d2bb3f06156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:16.587908 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb743349-9b1f-430a-b9de-8d2bb3f06156 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:16.589103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb743349-9b1f-430a-b9de-8d2bb3f06156 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:16.589731 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb743349-9b1f-430a-b9de-8d2bb3f06156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:16.596094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-bb743349-9b1f-430a-b9de-8d2bb3f06156 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:16.656270 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:50:16.679389 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8c675-16b1-4aba-984a-88677f4c0aee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:16.680847 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8c675-16b1-4aba-984a-88677f4c0aee service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:16.686860 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb743349-9b1f-430a-b9de-8d2bb3f06156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:16.688349 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb743349-9b1f-430a-b9de-8d2bb3f06156 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:16.692949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1196/2430] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:50:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:50:16.701332 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1235/2431] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:50:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:50:20.590855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcce93-4af6-421d-98d3-15d38dfd4fd7 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:20.591461 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcce93-4af6-421d-98d3-15d38dfd4fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:20.591461 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcce93-4af6-421d-98d3-15d38dfd4fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:20.625449 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c5bcce93-4af6-421d-98d3-15d38dfd4fd7 None None] MFA Rules not processed for user `7063b5053f164bba83cd0c17d66cbdff`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:50:20.626784 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c5bcce93-4af6-421d-98d3-15d38dfd4fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:20.727164 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1197/2432] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:50:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:50:20.746163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb743349-9b1f-430a-b9de-8d2bb3f06156 service neutron] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:20.747771 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-bb743349-9b1f-430a-b9de-8d2bb3f06156 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:20.766116 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb743349-9b1f-430a-b9de-8d2bb3f06156 service neutron] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:20.770152 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6aaf9-ff80-4585-a884-dc5d46a5c59c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:20.770804 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6aaf9-ff80-4585-a884-dc5d46a5c59c service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:20.771092 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6aaf9-ff80-4585-a884-dc5d46a5c59c service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:20.771402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6aaf9-ff80-4585-a884-dc5d46a5c59c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:20.780711 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6aaf9-ff80-4585-a884-dc5d46a5c59c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:20.782733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6aaf9-ff80-4585-a884-dc5d46a5c59c service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:20.811325 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1236/2433] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:50:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:50:23.667186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6016aa-cf23-486f-b161-d25eb7340910 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:23.667727 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6016aa-cf23-486f-b161-d25eb7340910 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:23.667865 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6016aa-cf23-486f-b161-d25eb7340910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:23.692231 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-2b6016aa-cf23-486f-b161-d25eb7340910 None None] MFA Rules not processed for user `7063b5053f164bba83cd0c17d66cbdff`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:50:23.693783 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2b6016aa-cf23-486f-b161-d25eb7340910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:23.700847 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1198/2434] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:50:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:50:30.792743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=50 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:50:31.512964 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc6d78-1cac-4a12-967e-caa5cdf86a77 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:31.513348 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc6d78-1cac-4a12-967e-caa5cdf86a77 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:31.513640 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc6d78-1cac-4a12-967e-caa5cdf86a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:31.532952 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-61bc6d78-1cac-4a12-967e-caa5cdf86a77 None None] MFA Rules not processed for user `7d75f170844342ffaf9101da660ac871`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:50:31.538942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-61bc6d78-1cac-4a12-967e-caa5cdf86a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:31.593251 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1237/2435] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:50:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:50:31.792050 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6016aa-cf23-486f-b161-d25eb7340910 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:31.793618 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2b6016aa-cf23-486f-b161-d25eb7340910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:31.810223 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6016aa-cf23-486f-b161-d25eb7340910 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:31.815867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc7b6f-4dd7-4228-9565-d1f8cd911a7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:31.816485 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc7b6f-4dd7-4228-9565-d1f8cd911a7d service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:31.816762 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc7b6f-4dd7-4228-9565-d1f8cd911a7d service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:31.817032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc7b6f-4dd7-4228-9565-d1f8cd911a7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:31.818772 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5afc7b6f-4dd7-4228-9565-d1f8cd911a7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:31.841427 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc6d78-1cac-4a12-967e-caa5cdf86a77 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:31.852421 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc6d78-1cac-4a12-967e-caa5cdf86a77 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:31.856265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937fcdf-959d-4115-a50f-dfc73e5190cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:31.856896 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937fcdf-959d-4115-a50f-dfc73e5190cb service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:31.857182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937fcdf-959d-4115-a50f-dfc73e5190cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:31.857463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937fcdf-959d-4115-a50f-dfc73e5190cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:31.859371 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4937fcdf-959d-4115-a50f-dfc73e5190cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:31.870632 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937fcdf-959d-4115-a50f-dfc73e5190cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:31.872136 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937fcdf-959d-4115-a50f-dfc73e5190cb service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:31.880981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1238/2436] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:50:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:50:31.891526 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc7b6f-4dd7-4228-9565-d1f8cd911a7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:31.891526 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc7b6f-4dd7-4228-9565-d1f8cd911a7d service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:31.897885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1199/2437] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:50:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:50:37.203283 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445237f-1b56-42f9-b94c-1914d39ec670 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:37.203805 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445237f-1b56-42f9-b94c-1914d39ec670 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:37.203901 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445237f-1b56-42f9-b94c-1914d39ec670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:37.231881 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-4445237f-1b56-42f9-b94c-1914d39ec670 None None] MFA Rules not processed for user `5b4c4184e87b4dc5a4047310cd0122ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:50:37.231881 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4445237f-1b56-42f9-b94c-1914d39ec670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:37.291648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1239/2438] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 18:50:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:50:37.426164 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc7b6f-4dd7-4228-9565-d1f8cd911a7d service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:37.427751 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5afc7b6f-4dd7-4228-9565-d1f8cd911a7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:37.505416 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=100 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:50:37.509727 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc7b6f-4dd7-4228-9565-d1f8cd911a7d service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:37.514889 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7b22b-506e-4d92-a9eb-d0055e998679 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7832398e97af4e539e10d1eef49f6d6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:37.515587 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7b22b-506e-4d92-a9eb-d0055e998679 service swift] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:37.515876 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7b22b-506e-4d92-a9eb-d0055e998679 service swift] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:37.516153 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7b22b-506e-4d92-a9eb-d0055e998679 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:37.525751 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7b22b-506e-4d92-a9eb-d0055e998679 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:37.527465 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7b22b-506e-4d92-a9eb-d0055e998679 service swift] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:37.536514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1200/2439] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 18:50:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:50:44.574382 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445237f-1b56-42f9-b94c-1914d39ec670 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:44.587216 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445237f-1b56-42f9-b94c-1914d39ec670 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:44.591221 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b597d53-fa27-4186-9604-002d931e777b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:44.591880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b597d53-fa27-4186-9604-002d931e777b service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:44.592340 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b597d53-fa27-4186-9604-002d931e777b service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:44.592794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b597d53-fa27-4186-9604-002d931e777b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:44.594835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-9b597d53-fa27-4186-9604-002d931e777b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:44.611178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b597d53-fa27-4186-9604-002d931e777b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:44.612981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b597d53-fa27-4186-9604-002d931e777b service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:44.621803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1240/2440] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:50:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:50:47.725882 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:50:51.662494 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fcb46-d6cf-4553-8eae-685119d6ef3a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:51.663162 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fcb46-d6cf-4553-8eae-685119d6ef3a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:51.663162 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fcb46-d6cf-4553-8eae-685119d6ef3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:51.683678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-7c7fcb46-d6cf-4553-8eae-685119d6ef3a None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:50:51.684920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7c7fcb46-d6cf-4553-8eae-685119d6ef3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:51.692940 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1201/2441] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Jul 27 18:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:50:51.707830 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b597d53-fa27-4186-9604-002d931e777b service neutron] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:51.721872 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b597d53-fa27-4186-9604-002d931e777b service neutron] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:51.728595 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b90f2-c6f2-4133-bcd2-a4a8d55fb29f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:51.729222 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b90f2-c6f2-4133-bcd2-a4a8d55fb29f service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:51.729504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b90f2-c6f2-4133-bcd2-a4a8d55fb29f service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:51.729779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b90f2-c6f2-4133-bcd2-a4a8d55fb29f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:51.738607 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b90f2-c6f2-4133-bcd2-a4a8d55fb29f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:51.740231 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b90f2-c6f2-4133-bcd2-a4a8d55fb29f service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:51.750901 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1241/2442] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:50:52.760347 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fcb46-d6cf-4553-8eae-685119d6ef3a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:52.772916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fcb46-d6cf-4553-8eae-685119d6ef3a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:52.778600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9360343-8a31-4ce9-af19-5f98ccb92f0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:52.779318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9360343-8a31-4ce9-af19-5f98ccb92f0a service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:52.779548 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9360343-8a31-4ce9-af19-5f98ccb92f0a service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:52.779822 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9360343-8a31-4ce9-af19-5f98ccb92f0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:52.781604 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b9360343-8a31-4ce9-af19-5f98ccb92f0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:52.853251 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9360343-8a31-4ce9-af19-5f98ccb92f0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:52.855068 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9360343-8a31-4ce9-af19-5f98ccb92f0a service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:52.867162 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1202/2443] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:50:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:50:55.247526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cf155-fab1-4ab5-8e6f-5b0c52272301 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:55.248222 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cf155-fab1-4ab5-8e6f-5b0c52272301 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:55.248222 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cf155-fab1-4ab5-8e6f-5b0c52272301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:55.270568 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-a27cf155-fab1-4ab5-8e6f-5b0c52272301 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:50:55.271856 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a27cf155-fab1-4ab5-8e6f-5b0c52272301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:55.280673 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1242/2444] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Jul 27 18:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:50:55.528180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9360343-8a31-4ce9-af19-5f98ccb92f0a service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:55.539834 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9360343-8a31-4ce9-af19-5f98ccb92f0a service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:55.546440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9008b7-7929-4487-b65b-4d62c285581f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:55.547092 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9008b7-7929-4487-b65b-4d62c285581f service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:55.547404 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9008b7-7929-4487-b65b-4d62c285581f service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:55.547684 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9008b7-7929-4487-b65b-4d62c285581f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:55.557203 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9008b7-7929-4487-b65b-4d62c285581f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:55.559484 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9008b7-7929-4487-b65b-4d62c285581f service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:55.575725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1203/2445] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:50:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:50:56.454390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf99aa7-1653-40d8-9cbb-1934b49735a4 None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:56.454901 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf99aa7-1653-40d8-9cbb-1934b49735a4 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:56.454988 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf99aa7-1653-40d8-9cbb-1934b49735a4 None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:56.456313 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1243/2446] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 18:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:50:56.465013 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105a4e8-2156-4687-b947-a6a40876ef41 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:56.465317 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105a4e8-2156-4687-b947-a6a40876ef41 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:56.465598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105a4e8-2156-4687-b947-a6a40876ef41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:56.486723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f105a4e8-2156-4687-b947-a6a40876ef41 None None] MFA Rules not processed for user `be769d4dd016466f9174e7d5e47a2a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:50:56.487968 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f105a4e8-2156-4687-b947-a6a40876ef41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:56.497440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1204/2447] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 18:50:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:50:56.509776 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf99aa7-1653-40d8-9cbb-1934b49735a4 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:56.511666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-3bf99aa7-1653-40d8-9cbb-1934b49735a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:56.574932 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf99aa7-1653-40d8-9cbb-1934b49735a4 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:56.579385 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5825111-2233-48f2-b024-92bb5af51f33 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49a34cd99ab47bb92af6ed2f82fefde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:56.580034 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5825111-2233-48f2-b024-92bb5af51f33 service glance] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:56.580317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5825111-2233-48f2-b024-92bb5af51f33 service glance] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:56.580593 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5825111-2233-48f2-b024-92bb5af51f33 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:56.593049 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5825111-2233-48f2-b024-92bb5af51f33 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:56.594737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5825111-2233-48f2-b024-92bb5af51f33 service glance] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:56.607018 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1244/2448] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:50:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:50:56.794177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21d7ed-6638-45ba-b359-7c70bffd9422 None None] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:56.794732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21d7ed-6638-45ba-b359-7c70bffd9422 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:56.794732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21d7ed-6638-45ba-b359-7c70bffd9422 None None] PATH_INFO: `/` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:56.796117 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1205/2449] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 18:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:50:56.800794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e65e32-5d43-4906-b3ec-6018cf67ffbf None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:56.801087 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e65e32-5d43-4906-b3ec-6018cf67ffbf None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:56.801371 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e65e32-5d43-4906-b3ec-6018cf67ffbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:56.816056 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:50:56.822256 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-14e65e32-5d43-4906-b3ec-6018cf67ffbf None None] MFA Rules not processed for user `ffee4a13d4fd4f86bd1c79b4535a0c55`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:50:56.823510 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-14e65e32-5d43-4906-b3ec-6018cf67ffbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:56.832185 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1245/2450] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 18:50:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:50:56.846372 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21d7ed-6638-45ba-b359-7c70bffd9422 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:56.858097 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21d7ed-6638-45ba-b359-7c70bffd9422 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:56.861769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9d7ad-5fa1-49f0-a1df-71b046514aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:56.862381 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9d7ad-5fa1-49f0-a1df-71b046514aff service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:56.862691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9d7ad-5fa1-49f0-a1df-71b046514aff service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:56.862924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9d7ad-5fa1-49f0-a1df-71b046514aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:56.870868 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9d7ad-5fa1-49f0-a1df-71b046514aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:56.872565 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9d7ad-5fa1-49f0-a1df-71b046514aff service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:56.889017 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1206/2451] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:50:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:50:56.975060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c591e09-7214-481c-9844-1cf420755d3c None None] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:56.975467 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c591e09-7214-481c-9844-1cf420755d3c None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:56.975750 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c591e09-7214-481c-9844-1cf420755d3c None None] PATH_INFO: `/` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:56.977563 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1246/2452] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 18:50:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:50:56.984723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c99e26-c378-4208-9e5a-40184ac46e8b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:56.985012 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c99e26-c378-4208-9e5a-40184ac46e8b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:56.985295 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c99e26-c378-4208-9e5a-40184ac46e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:57.004817 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-53c99e26-c378-4208-9e5a-40184ac46e8b None None] MFA Rules not processed for user `be769d4dd016466f9174e7d5e47a2a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:50:57.006073 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-53c99e26-c378-4208-9e5a-40184ac46e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:57.015951 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1207/2453] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 18:50:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:50:57.027455 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c591e09-7214-481c-9844-1cf420755d3c None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:57.038591 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c591e09-7214-481c-9844-1cf420755d3c None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:57.045346 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ffa89-0c55-4a05-9e24-de3dc0c1b425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:57.045346 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ffa89-0c55-4a05-9e24-de3dc0c1b425 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:57.045346 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ffa89-0c55-4a05-9e24-de3dc0c1b425 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:57.045346 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ffa89-0c55-4a05-9e24-de3dc0c1b425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:57.054299 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ffa89-0c55-4a05-9e24-de3dc0c1b425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:57.056066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ffa89-0c55-4a05-9e24-de3dc0c1b425 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:57.067021 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1247/2454] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:50:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:50:57.129639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c99e26-c378-4208-9e5a-40184ac46e8b None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:57.131084 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-53c99e26-c378-4208-9e5a-40184ac46e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:57.200613 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c99e26-c378-4208-9e5a-40184ac46e8b None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:57.205940 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13008ee2-c791-4fa5-8d3f-5bf0ad507492 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa971da983ea48c3b6d4c68a5d454bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:57.206562 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13008ee2-c791-4fa5-8d3f-5bf0ad507492 service placement] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:57.206842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13008ee2-c791-4fa5-8d3f-5bf0ad507492 service placement] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:57.207118 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13008ee2-c791-4fa5-8d3f-5bf0ad507492 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:57.208940 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-13008ee2-c791-4fa5-8d3f-5bf0ad507492 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:57.220191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13008ee2-c791-4fa5-8d3f-5bf0ad507492 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:57.221777 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13008ee2-c791-4fa5-8d3f-5bf0ad507492 service placement] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:57.231624 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1208/2455] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:50:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:50:59.133299 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26981b3-f74b-41a6-9810-9191040f245f None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:59.138896 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26981b3-f74b-41a6-9810-9191040f245f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:59.138896 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26981b3-f74b-41a6-9810-9191040f245f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:59.154136 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-b26981b3-f74b-41a6-9810-9191040f245f None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:50:59.155398 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b26981b3-f74b-41a6-9810-9191040f245f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:59.163812 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1248/2456] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Jul 27 18:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:50:59.182800 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13008ee2-c791-4fa5-8d3f-5bf0ad507492 service placement] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:59.194945 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13008ee2-c791-4fa5-8d3f-5bf0ad507492 service placement] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:59.200746 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5573d0-c1e1-4db4-8731-fe0c8425a979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:59.201364 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5573d0-c1e1-4db4-8731-fe0c8425a979 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:59.201649 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5573d0-c1e1-4db4-8731-fe0c8425a979 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:59.201928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5573d0-c1e1-4db4-8731-fe0c8425a979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:59.210718 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5573d0-c1e1-4db4-8731-fe0c8425a979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:59.214361 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5573d0-c1e1-4db4-8731-fe0c8425a979 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:59.222697 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1209/2457] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:51:01.215193 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3323d0-cc2d-427b-a4d3-2e3254013e83 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:01.215778 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3323d0-cc2d-427b-a4d3-2e3254013e83 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:01.215897 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3323d0-cc2d-427b-a4d3-2e3254013e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:01.239542 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-bf3323d0-cc2d-427b-a4d3-2e3254013e83 None None] MFA Rules not processed for user `5b4c4184e87b4dc5a4047310cd0122ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:01.240820 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-bf3323d0-cc2d-427b-a4d3-2e3254013e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:01.248533 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1249/2458] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 18:51:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:51:01.261696 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5573d0-c1e1-4db4-8731-fe0c8425a979 service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:01.274786 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5573d0-c1e1-4db4-8731-fe0c8425a979 service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:01.279806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7adeb4-3157-4dc3-9c20-6de97cf3f14e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7832398e97af4e539e10d1eef49f6d6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:01.280414 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7adeb4-3157-4dc3-9c20-6de97cf3f14e service swift] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:01.280701 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7adeb4-3157-4dc3-9c20-6de97cf3f14e service swift] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:01.280980 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7adeb4-3157-4dc3-9c20-6de97cf3f14e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:01.290712 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7adeb4-3157-4dc3-9c20-6de97cf3f14e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:01.292959 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7adeb4-3157-4dc3-9c20-6de97cf3f14e service swift] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:01.302764 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1210/2459] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 18:51:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:51:03.399884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d30d67-82ae-4eb1-9dea-cc6a6e93b82e None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:03.400476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d30d67-82ae-4eb1-9dea-cc6a6e93b82e None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:03.400476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d30d67-82ae-4eb1-9dea-cc6a6e93b82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:03.423897 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-44d30d67-82ae-4eb1-9dea-cc6a6e93b82e None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:03.425138 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-44d30d67-82ae-4eb1-9dea-cc6a6e93b82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:03.434163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1250/2460] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Jul 27 18:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:51:03.451691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7adeb4-3157-4dc3-9c20-6de97cf3f14e service swift] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:03.464856 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7adeb4-3157-4dc3-9c20-6de97cf3f14e service swift] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:03.472605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f7d33-1e64-447c-9190-bf432acd6a35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:03.473167 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f7d33-1e64-447c-9190-bf432acd6a35 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:03.473450 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f7d33-1e64-447c-9190-bf432acd6a35 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:03.473726 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f7d33-1e64-447c-9190-bf432acd6a35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:03.483353 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f7d33-1e64-447c-9190-bf432acd6a35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:03.484973 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f7d33-1e64-447c-9190-bf432acd6a35 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:03.495683 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1211/2461] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:51:13.418767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=15 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:13.490493 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:17.939117 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57ee62-1a6b-4fec-917e-06139ef5f707 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:17.939647 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57ee62-1a6b-4fec-917e-06139ef5f707 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:17.939763 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57ee62-1a6b-4fec-917e-06139ef5f707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:17.959529 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-cd57ee62-1a6b-4fec-917e-06139ef5f707 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:17.960774 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-cd57ee62-1a6b-4fec-917e-06139ef5f707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:17.969775 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1251/2462] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Jul 27 18:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:51:17.988147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f7d33-1e64-447c-9190-bf432acd6a35 service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:18.006723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f7d33-1e64-447c-9190-bf432acd6a35 service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:18.013159 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad47c6-3e6f-4cb6-b69e-599f4a27902b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:18.013788 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad47c6-3e6f-4cb6-b69e-599f4a27902b service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:18.014075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad47c6-3e6f-4cb6-b69e-599f4a27902b service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:18.014383 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad47c6-3e6f-4cb6-b69e-599f4a27902b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:18.023865 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad47c6-3e6f-4cb6-b69e-599f4a27902b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:18.025400 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad47c6-3e6f-4cb6-b69e-599f4a27902b service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:18.036850 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1212/2463] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:51:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:51:18.408736 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57ee62-1a6b-4fec-917e-06139ef5f707 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:18.439936 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57ee62-1a6b-4fec-917e-06139ef5f707 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:18.451504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400fa28-27ef-4a33-93e9-3c2bdb71751a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:18.452140 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400fa28-27ef-4a33-93e9-3c2bdb71751a service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:18.456162 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400fa28-27ef-4a33-93e9-3c2bdb71751a service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:18.456162 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400fa28-27ef-4a33-93e9-3c2bdb71751a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:18.456162 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-d400fa28-27ef-4a33-93e9-3c2bdb71751a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:18.468917 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400fa28-27ef-4a33-93e9-3c2bdb71751a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:18.470568 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400fa28-27ef-4a33-93e9-3c2bdb71751a service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:18.482413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1252/2464] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:51:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:51:21.613321 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b77de1-e783-4dae-a20a-1c3448f08e4a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:21.613840 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b77de1-e783-4dae-a20a-1c3448f08e4a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:21.614950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b77de1-e783-4dae-a20a-1c3448f08e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:21.636909 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-65b77de1-e783-4dae-a20a-1c3448f08e4a None None] MFA Rules not processed for user `5b4c4184e87b4dc5a4047310cd0122ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:21.638362 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-65b77de1-e783-4dae-a20a-1c3448f08e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:21.647384 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1213/2465] 10.222.0.65 () {58 vars in 967 bytes} [Wed Jul 27 18:51:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:51:21.659578 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400fa28-27ef-4a33-93e9-3c2bdb71751a service nova] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:21.671751 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400fa28-27ef-4a33-93e9-3c2bdb71751a service nova] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:21.677096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139f340-b7ed-4888-b12a-3bb75b4dfca5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7832398e97af4e539e10d1eef49f6d6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:21.677803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139f340-b7ed-4888-b12a-3bb75b4dfca5 service swift] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:21.678303 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139f340-b7ed-4888-b12a-3bb75b4dfca5 service swift] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:21.678664 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139f340-b7ed-4888-b12a-3bb75b4dfca5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:21.688528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139f340-b7ed-4888-b12a-3bb75b4dfca5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:21.700661 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139f340-b7ed-4888-b12a-3bb75b4dfca5 service swift] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:21.700661 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1253/2466] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 18:51:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:51:26.524075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b77de1-e783-4dae-a20a-1c3448f08e4a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:26.543113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b77de1-e783-4dae-a20a-1c3448f08e4a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:26.554731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1091ae-7502-40a1-850f-0fead924b71c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:26.555627 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1091ae-7502-40a1-850f-0fead924b71c service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:26.555911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1091ae-7502-40a1-850f-0fead924b71c service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:26.556186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1091ae-7502-40a1-850f-0fead924b71c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:26.558186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cf1091ae-7502-40a1-850f-0fead924b71c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:26.575881 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1091ae-7502-40a1-850f-0fead924b71c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:26.577741 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1091ae-7502-40a1-850f-0fead924b71c service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:26.592438 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1214/2467] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:51:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:51:31.696725 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=15 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:36.586396 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=15 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:36.716371 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d13bec-cefb-464e-9727-0c42f2114e12 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:36.716966 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d13bec-cefb-464e-9727-0c42f2114e12 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:36.716966 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d13bec-cefb-464e-9727-0c42f2114e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:36.736898 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-96d13bec-cefb-464e-9727-0c42f2114e12 None None] MFA Rules not processed for user `7063b5053f164bba83cd0c17d66cbdff`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:36.738096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-96d13bec-cefb-464e-9727-0c42f2114e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:36.745159 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1254/2468] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:51:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:51:37.062895 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1091ae-7502-40a1-850f-0fead924b71c service nova] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:37.072320 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1091ae-7502-40a1-850f-0fead924b71c service nova] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:37.075910 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e180d04-635c-499b-b8fb-44e6cc8f0969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:37.076517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e180d04-635c-499b-b8fb-44e6cc8f0969 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:37.076798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e180d04-635c-499b-b8fb-44e6cc8f0969 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:37.077073 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e180d04-635c-499b-b8fb-44e6cc8f0969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:37.079141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8e180d04-635c-499b-b8fb-44e6cc8f0969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:37.089555 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e180d04-635c-499b-b8fb-44e6cc8f0969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:37.090997 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e180d04-635c-499b-b8fb-44e6cc8f0969 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:37.099784 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1215/2469] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:51:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:51:37.366837 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d13bec-cefb-464e-9727-0c42f2114e12 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:37.376780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d13bec-cefb-464e-9727-0c42f2114e12 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:37.380730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d42e1-a2db-4d98-8539-94dff7f90d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:37.381642 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d42e1-a2db-4d98-8539-94dff7f90d47 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:37.382066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d42e1-a2db-4d98-8539-94dff7f90d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:37.382457 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d42e1-a2db-4d98-8539-94dff7f90d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:37.384497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a54d42e1-a2db-4d98-8539-94dff7f90d47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:37.400446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d42e1-a2db-4d98-8539-94dff7f90d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:37.402538 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d42e1-a2db-4d98-8539-94dff7f90d47 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:37.413275 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1255/2470] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:51:41.580885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e180d04-635c-499b-b8fb-44e6cc8f0969 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:41.582508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8e180d04-635c-499b-b8fb-44e6cc8f0969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:41.600286 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e180d04-635c-499b-b8fb-44e6cc8f0969 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:41.607636 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c77e5e-5a8f-4744-a1ea-79d5abf1c9c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa971da983ea48c3b6d4c68a5d454bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:41.608546 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c77e5e-5a8f-4744-a1ea-79d5abf1c9c9 service placement] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:41.609041 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c77e5e-5a8f-4744-a1ea-79d5abf1c9c9 service placement] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:41.609717 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c77e5e-5a8f-4744-a1ea-79d5abf1c9c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:41.612825 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-00c77e5e-5a8f-4744-a1ea-79d5abf1c9c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:41.635759 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c77e5e-5a8f-4744-a1ea-79d5abf1c9c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:41.638059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c77e5e-5a8f-4744-a1ea-79d5abf1c9c9 service placement] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:41.650397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1216/2471] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:51:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:51:41.733798 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d42e1-a2db-4d98-8539-94dff7f90d47 service neutron] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:41.735295 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a54d42e1-a2db-4d98-8539-94dff7f90d47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:41.750026 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d42e1-a2db-4d98-8539-94dff7f90d47 service neutron] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:41.754846 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e90767-10a3-47bd-b410-b3fc04b5ac3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:41.755550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e90767-10a3-47bd-b410-b3fc04b5ac3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:41.755834 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e90767-10a3-47bd-b410-b3fc04b5ac3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:41.756111 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e90767-10a3-47bd-b410-b3fc04b5ac3e admin admin] PATH_INFO: `/v3/users/91402fce003f49cf9b3cb3c170fbed71` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:41.757310 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e90767-10a3-47bd-b410-b3fc04b5ac3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=91402fce003f49cf9b3cb3c170fbed71)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:41.759255 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e90767-10a3-47bd-b410-b3fc04b5ac3e admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:41.985791 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-e4e90767-10a3-47bd-b410-b3fc04b5ac3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91402fce003f49cf9b3cb3c170fbed71'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:41.992499 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-e4e90767-10a3-47bd-b410-b3fc04b5ac3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91402fce003f49cf9b3cb3c170fbed71'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:42.082361 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-e4e90767-10a3-47bd-b410-b3fc04b5ac3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91402fce003f49cf9b3cb3c170fbed71'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:42.099159 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-e4e90767-10a3-47bd-b410-b3fc04b5ac3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91402fce003f49cf9b3cb3c170fbed71'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:42.112543 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-e4e90767-10a3-47bd-b410-b3fc04b5ac3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91402fce003f49cf9b3cb3c170fbed71'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:42.120075 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1256/2472] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:51:41 2022] DELETE /identity/v3/users/91402fce003f49cf9b3cb3c170fbed71 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:51:42.456377 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c77e5e-5a8f-4744-a1ea-79d5abf1c9c9 service placement] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:42.469128 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c77e5e-5a8f-4744-a1ea-79d5abf1c9c9 service placement] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:42.560240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7efc8b-853d-4734-b3c1-e06dba56aa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:42.560916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7efc8b-853d-4734-b3c1-e06dba56aa6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:42.561205 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7efc8b-853d-4734-b3c1-e06dba56aa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:42.561488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7efc8b-853d-4734-b3c1-e06dba56aa6f admin admin] PATH_INFO: `/v3/projects/d36d7265f2274436a89e5dad0e66eba2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:42.562668 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7efc8b-853d-4734-b3c1-e06dba56aa6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d36d7265f2274436a89e5dad0e66eba2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:42.564658 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7efc8b-853d-4734-b3c1-e06dba56aa6f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:42.697339 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7d7efc8b-853d-4734-b3c1-e06dba56aa6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd36d7265f2274436a89e5dad0e66eba2', 'request_id': 'req-7d7efc8b-853d-4734-b3c1-e06dba56aa6f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:42.706787 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7d7efc8b-853d-4734-b3c1-e06dba56aa6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd36d7265f2274436a89e5dad0e66eba2', 'request_id': 'req-7d7efc8b-853d-4734-b3c1-e06dba56aa6f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:42.777164 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7d7efc8b-853d-4734-b3c1-e06dba56aa6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd36d7265f2274436a89e5dad0e66eba2', 'request_id': 'req-7d7efc8b-853d-4734-b3c1-e06dba56aa6f'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:42.789518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7d7efc8b-853d-4734-b3c1-e06dba56aa6f admin admin] The token cache is being invalidate because project d36d7265f2274436a89e5dad0e66eba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:51:42.789811 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7d7efc8b-853d-4734-b3c1-e06dba56aa6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:42.794967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-7d7efc8b-853d-4734-b3c1-e06dba56aa6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:42.794967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1217/2473] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:51:42 2022] DELETE /identity/v3/projects/d36d7265f2274436a89e5dad0e66eba2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:51:42.798540 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc9f23-a7c6-4f8b-93ad-394ee613e2c3 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:42.799058 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc9f23-a7c6-4f8b-93ad-394ee613e2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:42.799163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc9f23-a7c6-4f8b-93ad-394ee613e2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:42.819988 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-f7cc9f23-a7c6-4f8b-93ad-394ee613e2c3 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:42.821172 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-f7cc9f23-a7c6-4f8b-93ad-394ee613e2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:42.885750 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1257/2474] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:51:42.894088 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6c1ea-7598-47d4-9194-009af44ab2ef None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:42.894376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6c1ea-7598-47d4-9194-009af44ab2ef None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:42.894655 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6c1ea-7598-47d4-9194-009af44ab2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:42.916997 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-d0e6c1ea-7598-47d4-9194-009af44ab2ef None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:42.918313 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-d0e6c1ea-7598-47d4-9194-009af44ab2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:42.926671 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1218/2475] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:51:42.931330 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc9f23-a7c6-4f8b-93ad-394ee613e2c3 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:42.942549 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc9f23-a7c6-4f8b-93ad-394ee613e2c3 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:42.947178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc07576-b1e9-4dca-831f-dfb0f56f93b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:42.947947 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc07576-b1e9-4dca-831f-dfb0f56f93b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:42.948234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc07576-b1e9-4dca-831f-dfb0f56f93b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:42.948512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc07576-b1e9-4dca-831f-dfb0f56f93b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:42.949224 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc07576-b1e9-4dca-831f-dfb0f56f93b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:42.949533 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc07576-b1e9-4dca-831f-dfb0f56f93b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:42.951171 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc07576-b1e9-4dca-831f-dfb0f56f93b9 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:42.964584 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1258/2476] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:42.969071 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6c1ea-7598-47d4-9194-009af44ab2ef None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:42.978624 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6c1ea-7598-47d4-9194-009af44ab2ef None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:42.984608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b61aad-3454-4d4b-b8af-511344c5279a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:42.985261 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b61aad-3454-4d4b-b8af-511344c5279a admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:42.985541 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b61aad-3454-4d4b-b8af-511344c5279a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:42.985815 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b61aad-3454-4d4b-b8af-511344c5279a admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:42.986512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b61aad-3454-4d4b-b8af-511344c5279a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:42.988508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b61aad-3454-4d4b-b8af-511344c5279a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:43.137457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1219/2477] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:51:42 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:51:43.139230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc07576-b1e9-4dca-831f-dfb0f56f93b9 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:43.149383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc07576-b1e9-4dca-831f-dfb0f56f93b9 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:43.192261 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:43.212564 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f592c-a9c2-4a6b-9a0f-c102db53d934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:43.213235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f592c-a9c2-4a6b-9a0f-c102db53d934 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:43.213532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f592c-a9c2-4a6b-9a0f-c102db53d934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:43.213981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f592c-a9c2-4a6b-9a0f-c102db53d934 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:43.214661 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f592c-a9c2-4a6b-9a0f-c102db53d934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:43.220158 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f592c-a9c2-4a6b-9a0f-c102db53d934 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:43.368011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1259/2478] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:51:43 2022] POST /identity/v3/users => generated 290 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:51:43.373310 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b61aad-3454-4d4b-b8af-511344c5279a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:43.384081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b61aad-3454-4d4b-b8af-511344c5279a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:43.389443 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184c2b7-b81d-4c4f-862f-c514753df333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:43.390305 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184c2b7-b81d-4c4f-862f-c514753df333 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:43.390708 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184c2b7-b81d-4c4f-862f-c514753df333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:43.391074 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184c2b7-b81d-4c4f-862f-c514753df333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:43.392104 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184c2b7-b81d-4c4f-862f-c514753df333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:43.393669 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184c2b7-b81d-4c4f-862f-c514753df333 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:43.405378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1220/2479] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:51:43.409780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f592c-a9c2-4a6b-9a0f-c102db53d934 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:43.420956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f592c-a9c2-4a6b-9a0f-c102db53d934 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:43.427429 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a82bc-7fb6-43c5-a82e-721bba3d3172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:43.428058 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a82bc-7fb6-43c5-a82e-721bba3d3172 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:43.428343 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a82bc-7fb6-43c5-a82e-721bba3d3172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:43.428621 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a82bc-7fb6-43c5-a82e-721bba3d3172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:43.429322 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a82bc-7fb6-43c5-a82e-721bba3d3172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:43.430955 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a82bc-7fb6-43c5-a82e-721bba3d3172 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:43.442086 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1260/2480] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:51:43.446736 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184c2b7-b81d-4c4f-862f-c514753df333 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:43.457974 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184c2b7-b81d-4c4f-862f-c514753df333 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:43.462740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc673b4-3cdb-4d13-aa69-8fdaee8e5791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:43.464214 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc673b4-3cdb-4d13-aa69-8fdaee8e5791 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:43.464497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc673b4-3cdb-4d13-aa69-8fdaee8e5791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:43.464773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc673b4-3cdb-4d13-aa69-8fdaee8e5791 admin admin] PATH_INFO: `/v3/projects/08dfc39b91d94ecfbda019af2722380a/users/6caf4118d38a4fcba0a012a29acd46ff/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:43.479755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc673b4-3cdb-4d13-aa69-8fdaee8e5791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08dfc39b91d94ecfbda019af2722380a, user_id=6caf4118d38a4fcba0a012a29acd46ff, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:43.482494 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc673b4-3cdb-4d13-aa69-8fdaee8e5791 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:43.563244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:43.569087 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1221/2481] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:51:43 2022] PUT /identity/v3/projects/08dfc39b91d94ecfbda019af2722380a/users/6caf4118d38a4fcba0a012a29acd46ff/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:51:43.581776 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509e788-971a-4a81-821e-8c651f3f0bd7 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:43.582065 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509e788-971a-4a81-821e-8c651f3f0bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:43.582341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509e788-971a-4a81-821e-8c651f3f0bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:43.611842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-c509e788-971a-4a81-821e-8c651f3f0bd7 None None] MFA Rules not processed for user `6caf4118d38a4fcba0a012a29acd46ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:43.613074 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c509e788-971a-4a81-821e-8c651f3f0bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:43.678998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1261/2482] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:51:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:51:43.683947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc673b4-3cdb-4d13-aa69-8fdaee8e5791 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:43.765709 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc673b4-3cdb-4d13-aa69-8fdaee8e5791 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:43.770496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833b585-bf6c-4c86-aac6-2b59b4fbe696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:43.775062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833b585-bf6c-4c86-aac6-2b59b4fbe696 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:43.775062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833b585-bf6c-4c86-aac6-2b59b4fbe696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:43.775062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833b585-bf6c-4c86-aac6-2b59b4fbe696 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:43.775062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833b585-bf6c-4c86-aac6-2b59b4fbe696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:43.775062 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833b585-bf6c-4c86-aac6-2b59b4fbe696 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:43.893680 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1222/2483] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:51:43 2022] POST /identity/v3/projects => generated 381 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:51:43.897810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509e788-971a-4a81-821e-8c651f3f0bd7 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:43.909905 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509e788-971a-4a81-821e-8c651f3f0bd7 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:43.968683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31232b-5c03-4967-8710-c704405473aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:43.969204 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31232b-5c03-4967-8710-c704405473aa admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:43.969491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31232b-5c03-4967-8710-c704405473aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:43.969763 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31232b-5c03-4967-8710-c704405473aa admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:43.970434 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a31232b-5c03-4967-8710-c704405473aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:43.972447 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a31232b-5c03-4967-8710-c704405473aa admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:44.120684 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1262/2484] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:51:43 2022] POST /identity/v3/users => generated 297 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:51:44.125118 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833b585-bf6c-4c86-aac6-2b59b4fbe696 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:44.135513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833b585-bf6c-4c86-aac6-2b59b4fbe696 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:44.140635 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f42818-d10b-4c50-afd8-f34d58136e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:44.141316 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f42818-d10b-4c50-afd8-f34d58136e0e admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:44.141604 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f42818-d10b-4c50-afd8-f34d58136e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:44.141883 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f42818-d10b-4c50-afd8-f34d58136e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:44.142579 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f42818-d10b-4c50-afd8-f34d58136e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:44.144236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f42818-d10b-4c50-afd8-f34d58136e0e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:44.155280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1223/2485] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:51:44.159757 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31232b-5c03-4967-8710-c704405473aa admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:44.170686 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31232b-5c03-4967-8710-c704405473aa admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:44.175443 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dcbd3-cbce-469e-959e-09e17a049164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:44.176106 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dcbd3-cbce-469e-959e-09e17a049164 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:44.176390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dcbd3-cbce-469e-959e-09e17a049164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:44.176668 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dcbd3-cbce-469e-959e-09e17a049164 admin admin] PATH_INFO: `/v3/projects/fdd413d0ef464811bc84939dd6799dbd/users/5a853aa8e5d043c08e2b282110a362f8/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:44.191998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dcbd3-cbce-469e-959e-09e17a049164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdd413d0ef464811bc84939dd6799dbd, user_id=5a853aa8e5d043c08e2b282110a362f8, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:44.194726 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dcbd3-cbce-469e-959e-09e17a049164 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:44.259331 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1263/2486] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:51:44 2022] PUT /identity/v3/projects/fdd413d0ef464811bc84939dd6799dbd/users/5a853aa8e5d043c08e2b282110a362f8/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:51:44.263787 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f42818-d10b-4c50-afd8-f34d58136e0e admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:44.274092 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f42818-d10b-4c50-afd8-f34d58136e0e admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:44.332758 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e978da-d4dc-43bc-8782-240cdd3ce802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:44.333384 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e978da-d4dc-43bc-8782-240cdd3ce802 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:44.333669 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e978da-d4dc-43bc-8782-240cdd3ce802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:44.333948 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e978da-d4dc-43bc-8782-240cdd3ce802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:44.334676 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e978da-d4dc-43bc-8782-240cdd3ce802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:44.336322 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e978da-d4dc-43bc-8782-240cdd3ce802 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:44.348864 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1224/2487] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:51:44.353600 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dcbd3-cbce-469e-959e-09e17a049164 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:44.365301 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dcbd3-cbce-469e-959e-09e17a049164 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:44.370757 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b6ca9-55f5-4192-b7e0-aa82a8acc685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:44.371484 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b6ca9-55f5-4192-b7e0-aa82a8acc685 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:44.371771 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b6ca9-55f5-4192-b7e0-aa82a8acc685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:44.372051 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b6ca9-55f5-4192-b7e0-aa82a8acc685 admin admin] PATH_INFO: `/v3/projects/fdd413d0ef464811bc84939dd6799dbd/users/5a853aa8e5d043c08e2b282110a362f8/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:44.374098 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b6ca9-55f5-4192-b7e0-aa82a8acc685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdd413d0ef464811bc84939dd6799dbd, user_id=5a853aa8e5d043c08e2b282110a362f8, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:44.376802 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b6ca9-55f5-4192-b7e0-aa82a8acc685 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:44.383601 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:44.388561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1264/2488] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:51:44 2022] PUT /identity/v3/projects/fdd413d0ef464811bc84939dd6799dbd/users/5a853aa8e5d043c08e2b282110a362f8/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:51:44.399224 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7acc16-27a7-49a8-8043-af0c9fc46893 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:44.399548 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7acc16-27a7-49a8-8043-af0c9fc46893 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:44.399831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7acc16-27a7-49a8-8043-af0c9fc46893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:44.435695 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5c7acc16-27a7-49a8-8043-af0c9fc46893 None None] MFA Rules not processed for user `5a853aa8e5d043c08e2b282110a362f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:44.436922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5c7acc16-27a7-49a8-8043-af0c9fc46893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:44.496046 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:44.504907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1225/2489] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:51:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:51:44.517602 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b6ca9-55f5-4192-b7e0-aa82a8acc685 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:44.519378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-8d6b6ca9-55f5-4192-b7e0-aa82a8acc685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:44.578086 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b6ca9-55f5-4192-b7e0-aa82a8acc685 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:44.581793 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21de8c9-5aa0-4388-8ba8-bb2b90c28e5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:44.582405 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21de8c9-5aa0-4388-8ba8-bb2b90c28e5e service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:44.582684 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21de8c9-5aa0-4388-8ba8-bb2b90c28e5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:44.582955 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21de8c9-5aa0-4388-8ba8-bb2b90c28e5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:44.592706 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21de8c9-5aa0-4388-8ba8-bb2b90c28e5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:44.594138 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21de8c9-5aa0-4388-8ba8-bb2b90c28e5e service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:44.604328 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1265/2490] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:51:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:51:44.806816 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7acc16-27a7-49a8-8043-af0c9fc46893 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:44.808499 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5c7acc16-27a7-49a8-8043-af0c9fc46893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:44.821358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7acc16-27a7-49a8-8043-af0c9fc46893 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:44.826023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3c89b-047e-4341-8310-5f6cae7fe6ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:44.826681 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3c89b-047e-4341-8310-5f6cae7fe6ae service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:44.826968 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3c89b-047e-4341-8310-5f6cae7fe6ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:44.827245 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3c89b-047e-4341-8310-5f6cae7fe6ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:44.898446 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca3c89b-047e-4341-8310-5f6cae7fe6ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:44.899938 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca3c89b-047e-4341-8310-5f6cae7fe6ae service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:44.911478 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1226/2491] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:51:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:51:53.215252 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21de8c9-5aa0-4388-8ba8-bb2b90c28e5e service cinder] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:53.216865 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e21de8c9-5aa0-4388-8ba8-bb2b90c28e5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:53.298858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21de8c9-5aa0-4388-8ba8-bb2b90c28e5e service cinder] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:53.304263 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849d6d3-cfa7-4f5e-9e52-498ab661ee57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:53.304898 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849d6d3-cfa7-4f5e-9e52-498ab661ee57 service nova] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:53.305182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849d6d3-cfa7-4f5e-9e52-498ab661ee57 service nova] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:53.305461 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849d6d3-cfa7-4f5e-9e52-498ab661ee57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:53.307317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2849d6d3-cfa7-4f5e-9e52-498ab661ee57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:53.319994 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849d6d3-cfa7-4f5e-9e52-498ab661ee57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:53.321632 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849d6d3-cfa7-4f5e-9e52-498ab661ee57 service nova] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:53.333938 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1266/2492] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:51:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:51:53.980369 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3c89b-047e-4341-8310-5f6cae7fe6ae service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:54.074339 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3c89b-047e-4341-8310-5f6cae7fe6ae service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:54.240373 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86372a40-89bb-4a78-8df7-b1eee955debb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:54.240373 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86372a40-89bb-4a78-8df7-b1eee955debb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:54.240373 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86372a40-89bb-4a78-8df7-b1eee955debb admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:54.240373 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86372a40-89bb-4a78-8df7-b1eee955debb admin admin] PATH_INFO: `/v3/users/6caf4118d38a4fcba0a012a29acd46ff` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:54.243524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86372a40-89bb-4a78-8df7-b1eee955debb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6caf4118d38a4fcba0a012a29acd46ff)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:54.243524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86372a40-89bb-4a78-8df7-b1eee955debb admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:54.387298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-86372a40-89bb-4a78-8df7-b1eee955debb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6caf4118d38a4fcba0a012a29acd46ff'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:54.388303 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-86372a40-89bb-4a78-8df7-b1eee955debb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6caf4118d38a4fcba0a012a29acd46ff'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:54.496776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-86372a40-89bb-4a78-8df7-b1eee955debb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6caf4118d38a4fcba0a012a29acd46ff'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:54.509891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-86372a40-89bb-4a78-8df7-b1eee955debb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6caf4118d38a4fcba0a012a29acd46ff'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:54.510888 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-86372a40-89bb-4a78-8df7-b1eee955debb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6caf4118d38a4fcba0a012a29acd46ff'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:54.524360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1227/2493] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:51:53 2022] DELETE /identity/v3/users/6caf4118d38a4fcba0a012a29acd46ff => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:51:54.529539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84c11a-9ce2-4298-9112-196c251d4a80 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:54.530091 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84c11a-9ce2-4298-9112-196c251d4a80 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:54.530091 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84c11a-9ce2-4298-9112-196c251d4a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:54.550650 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-db84c11a-9ce2-4298-9112-196c251d4a80 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:54.556965 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-db84c11a-9ce2-4298-9112-196c251d4a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:54.634655 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1267/2494] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:51:54.635231 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86372a40-89bb-4a78-8df7-b1eee955debb admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:54.635231 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-86372a40-89bb-4a78-8df7-b1eee955debb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:54.642613 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:54.688888 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86372a40-89bb-4a78-8df7-b1eee955debb admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:54.693237 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba8fe6-3ab6-4e8e-b5fb-8f1e62eecf91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:54.693863 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba8fe6-3ab6-4e8e-b5fb-8f1e62eecf91 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:54.694149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba8fe6-3ab6-4e8e-b5fb-8f1e62eecf91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:54.694427 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba8fe6-3ab6-4e8e-b5fb-8f1e62eecf91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:54.704147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba8fe6-3ab6-4e8e-b5fb-8f1e62eecf91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:54.705905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba8fe6-3ab6-4e8e-b5fb-8f1e62eecf91 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:54.715572 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1228/2495] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:51:54.803200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84c11a-9ce2-4298-9112-196c251d4a80 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:54.804796 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-db84c11a-9ce2-4298-9112-196c251d4a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:54.821442 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84c11a-9ce2-4298-9112-196c251d4a80 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:54.827682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033af18-d419-4ef4-9b31-96e350371d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:54.827682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033af18-d419-4ef4-9b31-96e350371d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:54.827682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033af18-d419-4ef4-9b31-96e350371d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:54.828112 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033af18-d419-4ef4-9b31-96e350371d62 admin admin] PATH_INFO: `/v3/users/7d75f170844342ffaf9101da660ac871` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:54.829124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033af18-d419-4ef4-9b31-96e350371d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d75f170844342ffaf9101da660ac871)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:54.831075 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033af18-d419-4ef4-9b31-96e350371d62 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:54.856192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:55.036884 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d033af18-d419-4ef4-9b31-96e350371d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d75f170844342ffaf9101da660ac871'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:55.037604 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d033af18-d419-4ef4-9b31-96e350371d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d75f170844342ffaf9101da660ac871'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:55.101771 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d033af18-d419-4ef4-9b31-96e350371d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d75f170844342ffaf9101da660ac871'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:55.114309 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d033af18-d419-4ef4-9b31-96e350371d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d75f170844342ffaf9101da660ac871'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:55.121470 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d033af18-d419-4ef4-9b31-96e350371d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d75f170844342ffaf9101da660ac871'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:55.127895 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1268/2496] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:51:54 2022] DELETE /identity/v3/users/7d75f170844342ffaf9101da660ac871 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:51:55.182171 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba8fe6-3ab6-4e8e-b5fb-8f1e62eecf91 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:55.184781 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5aba8fe6-3ab6-4e8e-b5fb-8f1e62eecf91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:55.199913 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba8fe6-3ab6-4e8e-b5fb-8f1e62eecf91 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:55.298843 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d57fe-aff8-476d-bacb-692834ceb8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:55.299548 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d57fe-aff8-476d-bacb-692834ceb8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:55.299835 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d57fe-aff8-476d-bacb-692834ceb8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:55.300119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d57fe-aff8-476d-bacb-692834ceb8fe admin admin] PATH_INFO: `/v3/projects/08dfc39b91d94ecfbda019af2722380a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:55.301338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d57fe-aff8-476d-bacb-692834ceb8fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=08dfc39b91d94ecfbda019af2722380a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:55.303971 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d57fe-aff8-476d-bacb-692834ceb8fe admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:55.398201 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033af18-d419-4ef4-9b31-96e350371d62 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:55.399724 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-d033af18-d419-4ef4-9b31-96e350371d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:55.414400 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-484d57fe-aff8-476d-bacb-692834ceb8fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08dfc39b91d94ecfbda019af2722380a', 'request_id': 'req-484d57fe-aff8-476d-bacb-692834ceb8fe'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:55.420749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-484d57fe-aff8-476d-bacb-692834ceb8fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08dfc39b91d94ecfbda019af2722380a', 'request_id': 'req-484d57fe-aff8-476d-bacb-692834ceb8fe'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:55.424809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033af18-d419-4ef4-9b31-96e350371d62 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:55.483285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0472e6-7b6d-4877-ad95-485c354e3092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:55.483951 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0472e6-7b6d-4877-ad95-485c354e3092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:55.484234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0472e6-7b6d-4877-ad95-485c354e3092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:55.484516 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0472e6-7b6d-4877-ad95-485c354e3092 admin admin] PATH_INFO: `/v3/projects/458a93b8b3d647e7aeacbac263848be3` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:55.485695 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0472e6-7b6d-4877-ad95-485c354e3092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=458a93b8b3d647e7aeacbac263848be3)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:55.487653 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0472e6-7b6d-4877-ad95-485c354e3092 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:55.492668 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-484d57fe-aff8-476d-bacb-692834ceb8fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08dfc39b91d94ecfbda019af2722380a', 'request_id': 'req-484d57fe-aff8-476d-bacb-692834ceb8fe'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:55.505434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-484d57fe-aff8-476d-bacb-692834ceb8fe admin admin] The token cache is being invalidate because project 08dfc39b91d94ecfbda019af2722380a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:51:55.505723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-484d57fe-aff8-476d-bacb-692834ceb8fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:55.506413 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-484d57fe-aff8-476d-bacb-692834ceb8fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:55.508010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1229/2497] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:51:55 2022] DELETE /identity/v3/projects/08dfc39b91d94ecfbda019af2722380a => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:51:55.512492 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d57fe-aff8-476d-bacb-692834ceb8fe admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:55.513855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-484d57fe-aff8-476d-bacb-692834ceb8fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:55.526197 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d57fe-aff8-476d-bacb-692834ceb8fe admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:55.531190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d22fe-2083-4125-af71-a4db8b8c1e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:55.532008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d22fe-2083-4125-af71-a4db8b8c1e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:55.532295 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d22fe-2083-4125-af71-a4db8b8c1e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:55.532577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d22fe-2083-4125-af71-a4db8b8c1e86 admin admin] PATH_INFO: `/v3/users/5a853aa8e5d043c08e2b282110a362f8` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:55.533797 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d22fe-2083-4125-af71-a4db8b8c1e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a853aa8e5d043c08e2b282110a362f8)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:55.535805 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d22fe-2083-4125-af71-a4db8b8c1e86 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:55.596617 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ea0472e6-7b6d-4877-ad95-485c354e3092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '458a93b8b3d647e7aeacbac263848be3', 'request_id': 'req-ea0472e6-7b6d-4877-ad95-485c354e3092'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:55.602111 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ea0472e6-7b6d-4877-ad95-485c354e3092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '458a93b8b3d647e7aeacbac263848be3', 'request_id': 'req-ea0472e6-7b6d-4877-ad95-485c354e3092'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:55.709694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ea0472e6-7b6d-4877-ad95-485c354e3092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '458a93b8b3d647e7aeacbac263848be3', 'request_id': 'req-ea0472e6-7b6d-4877-ad95-485c354e3092'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:55.722532 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ea0472e6-7b6d-4877-ad95-485c354e3092 admin admin] The token cache is being invalidate because project 458a93b8b3d647e7aeacbac263848be3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:51:55.723427 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ea0472e6-7b6d-4877-ad95-485c354e3092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:55.723764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ea0472e6-7b6d-4877-ad95-485c354e3092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:55.725374 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1269/2498] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:51:55 2022] DELETE /identity/v3/projects/458a93b8b3d647e7aeacbac263848be3 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:51:55.754845 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:55.761514 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-854d22fe-2083-4125-af71-a4db8b8c1e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a853aa8e5d043c08e2b282110a362f8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:55.762345 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-854d22fe-2083-4125-af71-a4db8b8c1e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a853aa8e5d043c08e2b282110a362f8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:55.853138 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-854d22fe-2083-4125-af71-a4db8b8c1e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a853aa8e5d043c08e2b282110a362f8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:55.867670 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-854d22fe-2083-4125-af71-a4db8b8c1e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a853aa8e5d043c08e2b282110a362f8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:55.868431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-854d22fe-2083-4125-af71-a4db8b8c1e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a853aa8e5d043c08e2b282110a362f8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:55.883383 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1230/2499] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:51:55 2022] DELETE /identity/v3/users/5a853aa8e5d043c08e2b282110a362f8 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:51:56.390320 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0472e6-7b6d-4877-ad95-485c354e3092 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:56.392265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ea0472e6-7b6d-4877-ad95-485c354e3092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:56.433337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:56.475023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0472e6-7b6d-4877-ad95-485c354e3092 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:56.533677 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e82df-b36a-433b-a4fb-c84843f1d47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:56.534310 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e82df-b36a-433b-a4fb-c84843f1d47e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:56.534676 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e82df-b36a-433b-a4fb-c84843f1d47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:56.534952 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e82df-b36a-433b-a4fb-c84843f1d47e admin admin] PATH_INFO: `/v3/projects/fdd413d0ef464811bc84939dd6799dbd` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:56.536300 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e82df-b36a-433b-a4fb-c84843f1d47e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdd413d0ef464811bc84939dd6799dbd)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:56.538269 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e82df-b36a-433b-a4fb-c84843f1d47e admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:56.660713 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f31e82df-b36a-433b-a4fb-c84843f1d47e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdd413d0ef464811bc84939dd6799dbd', 'request_id': 'req-f31e82df-b36a-433b-a4fb-c84843f1d47e'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:56.666171 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f31e82df-b36a-433b-a4fb-c84843f1d47e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdd413d0ef464811bc84939dd6799dbd', 'request_id': 'req-f31e82df-b36a-433b-a4fb-c84843f1d47e'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:56.738090 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f31e82df-b36a-433b-a4fb-c84843f1d47e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdd413d0ef464811bc84939dd6799dbd', 'request_id': 'req-f31e82df-b36a-433b-a4fb-c84843f1d47e'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:56.750353 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f31e82df-b36a-433b-a4fb-c84843f1d47e admin admin] The token cache is being invalidate because project fdd413d0ef464811bc84939dd6799dbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:51:56.750645 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f31e82df-b36a-433b-a4fb-c84843f1d47e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:56.755977 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f31e82df-b36a-433b-a4fb-c84843f1d47e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:51:56.755977 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1270/2500] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:51:56 2022] DELETE /identity/v3/projects/fdd413d0ef464811bc84939dd6799dbd => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:51:56.757772 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7554c-40b0-443f-abd6-c556aa623613 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:56.758253 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7554c-40b0-443f-abd6-c556aa623613 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:56.758357 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7554c-40b0-443f-abd6-c556aa623613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:56.778496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-57e7554c-40b0-443f-abd6-c556aa623613 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:56.779757 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-57e7554c-40b0-443f-abd6-c556aa623613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:56.839693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1231/2501] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:51:56.847439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00825c82-e984-45d7-9417-ad3354d9bcf0 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:56.847732 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00825c82-e984-45d7-9417-ad3354d9bcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:56.848016 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00825c82-e984-45d7-9417-ad3354d9bcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:56.867595 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-00825c82-e984-45d7-9417-ad3354d9bcf0 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:56.868813 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-00825c82-e984-45d7-9417-ad3354d9bcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:56.877330 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1271/2502] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:51:56.881536 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7554c-40b0-443f-abd6-c556aa623613 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:56.892018 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7554c-40b0-443f-abd6-c556aa623613 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:56.896593 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879c779-1c97-4876-af28-bbd69475aef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:56.897209 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879c779-1c97-4876-af28-bbd69475aef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:56.897494 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879c779-1c97-4876-af28-bbd69475aef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:56.897773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879c779-1c97-4876-af28-bbd69475aef8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:56.898478 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879c779-1c97-4876-af28-bbd69475aef8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:56.898791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879c779-1c97-4876-af28-bbd69475aef8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:56.900465 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879c779-1c97-4876-af28-bbd69475aef8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:56.912467 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1232/2503] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:56.916974 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00825c82-e984-45d7-9417-ad3354d9bcf0 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:56.926571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00825c82-e984-45d7-9417-ad3354d9bcf0 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:56.931179 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe03a48-3866-4a1f-a775-bcf413d1288f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:56.931818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe03a48-3866-4a1f-a775-bcf413d1288f admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:56.932097 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe03a48-3866-4a1f-a775-bcf413d1288f admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:56.932369 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe03a48-3866-4a1f-a775-bcf413d1288f admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:56.933025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe03a48-3866-4a1f-a775-bcf413d1288f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:56.935660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe03a48-3866-4a1f-a775-bcf413d1288f admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:57.064418 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1272/2504] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:51:56 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:51:57.068923 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879c779-1c97-4876-af28-bbd69475aef8 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:57.080303 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879c779-1c97-4876-af28-bbd69475aef8 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:57.137144 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76e981-281c-446b-beec-3cf5ad4468f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:57.137767 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76e981-281c-446b-beec-3cf5ad4468f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:57.138056 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76e981-281c-446b-beec-3cf5ad4468f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:57.138332 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76e981-281c-446b-beec-3cf5ad4468f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:57.139009 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76e981-281c-446b-beec-3cf5ad4468f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:57.140977 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76e981-281c-446b-beec-3cf5ad4468f3 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:57.256794 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1233/2505] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:51:57 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:51:57.261236 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe03a48-3866-4a1f-a775-bcf413d1288f admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:57.272589 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe03a48-3866-4a1f-a775-bcf413d1288f admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:57.278106 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031d69b-b965-4041-b033-c43f5f62b668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:57.278736 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031d69b-b965-4041-b033-c43f5f62b668 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:57.279023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031d69b-b965-4041-b033-c43f5f62b668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:57.279329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031d69b-b965-4041-b033-c43f5f62b668 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:57.280181 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031d69b-b965-4041-b033-c43f5f62b668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:57.281834 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031d69b-b965-4041-b033-c43f5f62b668 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:57.292203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1273/2506] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:51:57.296429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76e981-281c-446b-beec-3cf5ad4468f3 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:57.306557 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76e981-281c-446b-beec-3cf5ad4468f3 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:57.311621 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537ba4e-38f4-4df3-9504-5ac4a71cbfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:57.315636 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537ba4e-38f4-4df3-9504-5ac4a71cbfc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:57.315636 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537ba4e-38f4-4df3-9504-5ac4a71cbfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:57.315636 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537ba4e-38f4-4df3-9504-5ac4a71cbfc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:57.315636 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537ba4e-38f4-4df3-9504-5ac4a71cbfc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:57.315636 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537ba4e-38f4-4df3-9504-5ac4a71cbfc3 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:57.328242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1234/2507] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:51:57.332724 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031d69b-b965-4041-b033-c43f5f62b668 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:57.343784 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031d69b-b965-4041-b033-c43f5f62b668 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:57.348670 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525620c-cfc9-424a-99a7-65967c0766da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:57.349329 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525620c-cfc9-424a-99a7-65967c0766da admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:57.349611 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525620c-cfc9-424a-99a7-65967c0766da admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:57.349887 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525620c-cfc9-424a-99a7-65967c0766da admin admin] PATH_INFO: `/v3/projects/468b1e5c105049b9a0e123aacae6ab6b/users/bfd8d0a61973425d9805e7bd6792df52/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:57.366359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525620c-cfc9-424a-99a7-65967c0766da admin admin] RBAC: Authorizing `identity:create_grant(project_id=468b1e5c105049b9a0e123aacae6ab6b, user_id=bfd8d0a61973425d9805e7bd6792df52, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:57.369088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525620c-cfc9-424a-99a7-65967c0766da admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:57.451345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1274/2508] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:51:57 2022] PUT /identity/v3/projects/468b1e5c105049b9a0e123aacae6ab6b/users/bfd8d0a61973425d9805e7bd6792df52/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:51:57.467994 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dab194-4dc4-49ab-ab5e-f900e89b21c1 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:57.468435 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dab194-4dc4-49ab-ab5e-f900e89b21c1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:57.468720 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dab194-4dc4-49ab-ab5e-f900e89b21c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:57.499571 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-66dab194-4dc4-49ab-ab5e-f900e89b21c1 None None] MFA Rules not processed for user `bfd8d0a61973425d9805e7bd6792df52`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:57.500833 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-66dab194-4dc4-49ab-ab5e-f900e89b21c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:57.520586 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:57.593334 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1235/2509] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:51:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:51:57.605529 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525620c-cfc9-424a-99a7-65967c0766da admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:57.612265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:57.691433 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525620c-cfc9-424a-99a7-65967c0766da admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:57.696232 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a5a31-d945-4603-9fd1-ac716a4c1f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:57.696848 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a5a31-d945-4603-9fd1-ac716a4c1f09 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:57.697128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a5a31-d945-4603-9fd1-ac716a4c1f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:57.697400 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a5a31-d945-4603-9fd1-ac716a4c1f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:57.698060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a5a31-d945-4603-9fd1-ac716a4c1f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:57.700856 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a5a31-d945-4603-9fd1-ac716a4c1f09 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:57.842665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1275/2510] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:51:57 2022] POST /identity/v3/projects => generated 379 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:51:57.847007 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dab194-4dc4-49ab-ab5e-f900e89b21c1 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:57.858551 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dab194-4dc4-49ab-ab5e-f900e89b21c1 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:57.921927 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0bd1b-8861-4659-ac41-f61d9dc9d483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:57.922475 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0bd1b-8861-4659-ac41-f61d9dc9d483 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:57.922756 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0bd1b-8861-4659-ac41-f61d9dc9d483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:57.923028 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0bd1b-8861-4659-ac41-f61d9dc9d483 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:57.923741 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0bd1b-8861-4659-ac41-f61d9dc9d483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:57.925741 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0bd1b-8861-4659-ac41-f61d9dc9d483 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:58.032244 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1236/2511] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:51:57 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:51:58.035306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a5a31-d945-4603-9fd1-ac716a4c1f09 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:58.047121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a5a31-d945-4603-9fd1-ac716a4c1f09 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:58.052162 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e77d6-771e-415a-bb08-67dd6e5cfaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:58.052798 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e77d6-771e-415a-bb08-67dd6e5cfaa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:58.053079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e77d6-771e-415a-bb08-67dd6e5cfaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:58.053352 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e77d6-771e-415a-bb08-67dd6e5cfaa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:58.054156 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e77d6-771e-415a-bb08-67dd6e5cfaa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:58.055841 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e77d6-771e-415a-bb08-67dd6e5cfaa2 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:58.068229 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1276/2512] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:51:58.072916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0bd1b-8861-4659-ac41-f61d9dc9d483 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:58.083548 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0bd1b-8861-4659-ac41-f61d9dc9d483 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:58.088186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad7a71-d81e-47cd-a59f-82b8773ff2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:58.088855 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad7a71-d81e-47cd-a59f-82b8773ff2cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:58.089138 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad7a71-d81e-47cd-a59f-82b8773ff2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:58.089413 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad7a71-d81e-47cd-a59f-82b8773ff2cf admin admin] PATH_INFO: `/v3/projects/831f6e55f689465888cc4a03ebdb4a42/users/595d597f64bd4471900c60e856f85beb/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:58.110476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad7a71-d81e-47cd-a59f-82b8773ff2cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=831f6e55f689465888cc4a03ebdb4a42, user_id=595d597f64bd4471900c60e856f85beb, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:58.113266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad7a71-d81e-47cd-a59f-82b8773ff2cf admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:58.211252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1237/2513] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:51:58 2022] PUT /identity/v3/projects/831f6e55f689465888cc4a03ebdb4a42/users/595d597f64bd4471900c60e856f85beb/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:51:58.215912 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e77d6-771e-415a-bb08-67dd6e5cfaa2 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:58.225970 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e77d6-771e-415a-bb08-67dd6e5cfaa2 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:58.283492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738b28c-64e8-48e1-ad26-de3fcf50a06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:58.284121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738b28c-64e8-48e1-ad26-de3fcf50a06e admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:58.284409 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738b28c-64e8-48e1-ad26-de3fcf50a06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:58.284690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738b28c-64e8-48e1-ad26-de3fcf50a06e admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:58.285394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738b28c-64e8-48e1-ad26-de3fcf50a06e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:58.287037 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738b28c-64e8-48e1-ad26-de3fcf50a06e admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:58.297857 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1277/2514] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:51:58.302130 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad7a71-d81e-47cd-a59f-82b8773ff2cf admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:58.313250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad7a71-d81e-47cd-a59f-82b8773ff2cf admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:58.317891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd66c3-e5d2-452f-8a6a-6c5ce0e53a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:58.318556 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd66c3-e5d2-452f-8a6a-6c5ce0e53a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:58.318837 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd66c3-e5d2-452f-8a6a-6c5ce0e53a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:58.319112 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd66c3-e5d2-452f-8a6a-6c5ce0e53a36 admin admin] PATH_INFO: `/v3/projects/831f6e55f689465888cc4a03ebdb4a42/users/595d597f64bd4471900c60e856f85beb/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:58.321104 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd66c3-e5d2-452f-8a6a-6c5ce0e53a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=831f6e55f689465888cc4a03ebdb4a42, user_id=595d597f64bd4471900c60e856f85beb, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:58.323883 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd66c3-e5d2-452f-8a6a-6c5ce0e53a36 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:58.334897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1238/2515] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:51:58 2022] PUT /identity/v3/projects/831f6e55f689465888cc4a03ebdb4a42/users/595d597f64bd4471900c60e856f85beb/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:51:58.345682 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfa406-101f-428d-acdd-eae4de2c9717 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:58.345958 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfa406-101f-428d-acdd-eae4de2c9717 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:58.346245 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfa406-101f-428d-acdd-eae4de2c9717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:58.374870 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-5bcfa406-101f-428d-acdd-eae4de2c9717 None None] MFA Rules not processed for user `595d597f64bd4471900c60e856f85beb`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:58.376132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5bcfa406-101f-428d-acdd-eae4de2c9717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:58.442379 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:58.445902 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1278/2516] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:51:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:51:58.457774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd66c3-e5d2-452f-8a6a-6c5ce0e53a36 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:58.459516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a0bd66c3-e5d2-452f-8a6a-6c5ce0e53a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:58.518388 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd66c3-e5d2-452f-8a6a-6c5ce0e53a36 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:58.522817 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f77112-921c-4c59-9599-8b6bdd00d330 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:58.523469 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f77112-921c-4c59-9599-8b6bdd00d330 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:58.523752 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f77112-921c-4c59-9599-8b6bdd00d330 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:58.524051 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f77112-921c-4c59-9599-8b6bdd00d330 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:58.544273 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:58.583283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f77112-921c-4c59-9599-8b6bdd00d330 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:58.584796 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f77112-921c-4c59-9599-8b6bdd00d330 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:58.594218 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1239/2517] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:51:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:00.469863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfa406-101f-428d-acdd-eae4de2c9717 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:00.471410 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5bcfa406-101f-428d-acdd-eae4de2c9717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:00.485620 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfa406-101f-428d-acdd-eae4de2c9717 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:00.491331 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf8f6f-778d-4594-bbf4-276f18fec8c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:00.491586 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf8f6f-778d-4594-bbf4-276f18fec8c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:00.491874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf8f6f-778d-4594-bbf4-276f18fec8c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:00.492152 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf8f6f-778d-4594-bbf4-276f18fec8c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:00.508227 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf8f6f-778d-4594-bbf4-276f18fec8c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:00.510189 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf8f6f-778d-4594-bbf4-276f18fec8c6 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:00.522861 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1279/2518] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:05.062546 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f77112-921c-4c59-9599-8b6bdd00d330 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:05.131941 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f77112-921c-4c59-9599-8b6bdd00d330 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:05.137033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785248a-1934-4c71-972a-b9c85759de32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:05.137725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785248a-1934-4c71-972a-b9c85759de32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:05.137955 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785248a-1934-4c71-972a-b9c85759de32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:05.138231 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785248a-1934-4c71-972a-b9c85759de32 admin admin] PATH_INFO: `/v3/users/bfd8d0a61973425d9805e7bd6792df52` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:05.139490 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0785248a-1934-4c71-972a-b9c85759de32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfd8d0a61973425d9805e7bd6792df52)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:05.141500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0785248a-1934-4c71-972a-b9c85759de32 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:05.340684 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0785248a-1934-4c71-972a-b9c85759de32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd8d0a61973425d9805e7bd6792df52'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:05.341382 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0785248a-1934-4c71-972a-b9c85759de32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd8d0a61973425d9805e7bd6792df52'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:05.427790 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0785248a-1934-4c71-972a-b9c85759de32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd8d0a61973425d9805e7bd6792df52'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:05.441899 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0785248a-1934-4c71-972a-b9c85759de32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd8d0a61973425d9805e7bd6792df52'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:05.442609 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0785248a-1934-4c71-972a-b9c85759de32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd8d0a61973425d9805e7bd6792df52'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:05.455839 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1240/2519] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:52:05 2022] DELETE /identity/v3/users/bfd8d0a61973425d9805e7bd6792df52 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:05.460339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab42731-5790-452a-806e-d7a9e3eade75 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:05.460859 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab42731-5790-452a-806e-d7a9e3eade75 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:05.460978 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab42731-5790-452a-806e-d7a9e3eade75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:05.479390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-1ab42731-5790-452a-806e-d7a9e3eade75 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:05.481228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-1ab42731-5790-452a-806e-d7a9e3eade75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:05.546044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1280/2520] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:52:05.555402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785248a-1934-4c71-972a-b9c85759de32 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:05.556894 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0785248a-1934-4c71-972a-b9c85759de32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:05.603879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:05.618484 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785248a-1934-4c71-972a-b9c85759de32 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:05.623230 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110d148-38d6-4c60-907a-0d4adf0581a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:05.623887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110d148-38d6-4c60-907a-0d4adf0581a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:05.624173 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110d148-38d6-4c60-907a-0d4adf0581a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:05.624453 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110d148-38d6-4c60-907a-0d4adf0581a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:05.633907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110d148-38d6-4c60-907a-0d4adf0581a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:05.635451 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110d148-38d6-4c60-907a-0d4adf0581a6 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:05.645796 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1241/2521] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:06.110581 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab42731-5790-452a-806e-d7a9e3eade75 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:06.111528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-1ab42731-5790-452a-806e-d7a9e3eade75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:06.124591 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab42731-5790-452a-806e-d7a9e3eade75 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:06.129509 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac3a11-f958-4847-9ab8-38896d4a56ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:06.130165 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac3a11-f958-4847-9ab8-38896d4a56ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:06.130447 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac3a11-f958-4847-9ab8-38896d4a56ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:06.130759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac3a11-f958-4847-9ab8-38896d4a56ab admin admin] PATH_INFO: `/v3/projects/468b1e5c105049b9a0e123aacae6ab6b` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:06.131987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac3a11-f958-4847-9ab8-38896d4a56ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=468b1e5c105049b9a0e123aacae6ab6b)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:06.134039 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac3a11-f958-4847-9ab8-38896d4a56ab admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:06.301653 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ceac3a11-f958-4847-9ab8-38896d4a56ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '468b1e5c105049b9a0e123aacae6ab6b', 'request_id': 'req-ceac3a11-f958-4847-9ab8-38896d4a56ab'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:06.312880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ceac3a11-f958-4847-9ab8-38896d4a56ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '468b1e5c105049b9a0e123aacae6ab6b', 'request_id': 'req-ceac3a11-f958-4847-9ab8-38896d4a56ab'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:06.396945 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110d148-38d6-4c60-907a-0d4adf0581a6 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:06.399467 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ceac3a11-f958-4847-9ab8-38896d4a56ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '468b1e5c105049b9a0e123aacae6ab6b', 'request_id': 'req-ceac3a11-f958-4847-9ab8-38896d4a56ab'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:06.412810 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110d148-38d6-4c60-907a-0d4adf0581a6 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:06.421750 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ceac3a11-f958-4847-9ab8-38896d4a56ab admin admin] The token cache is being invalidate because project 468b1e5c105049b9a0e123aacae6ab6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:52:06.422046 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ceac3a11-f958-4847-9ab8-38896d4a56ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:06.422924 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ceac3a11-f958-4847-9ab8-38896d4a56ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:06.425565 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1281/2522] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:52:06 2022] DELETE /identity/v3/projects/468b1e5c105049b9a0e123aacae6ab6b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:06.429794 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac3a11-f958-4847-9ab8-38896d4a56ab admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:06.431582 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ceac3a11-f958-4847-9ab8-38896d4a56ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:06.478202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e20304-f58a-411d-9a34-5d93ab74fd16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:06.478840 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e20304-f58a-411d-9a34-5d93ab74fd16 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:06.479124 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e20304-f58a-411d-9a34-5d93ab74fd16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:06.479443 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e20304-f58a-411d-9a34-5d93ab74fd16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:06.481305 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-61e20304-f58a-411d-9a34-5d93ab74fd16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:06.505693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac3a11-f958-4847-9ab8-38896d4a56ab admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:06.516368 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3066e1-d037-4b54-9665-24fb0b316360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:06.517142 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3066e1-d037-4b54-9665-24fb0b316360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:06.517495 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3066e1-d037-4b54-9665-24fb0b316360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:06.517840 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3066e1-d037-4b54-9665-24fb0b316360 admin admin] PATH_INFO: `/v3/users/595d597f64bd4471900c60e856f85beb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:06.519117 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3066e1-d037-4b54-9665-24fb0b316360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=595d597f64bd4471900c60e856f85beb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:06.522058 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3066e1-d037-4b54-9665-24fb0b316360 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:06.536016 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:06.588762 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e20304-f58a-411d-9a34-5d93ab74fd16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:06.590320 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e20304-f58a-411d-9a34-5d93ab74fd16 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:06.618840 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1242/2523] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:52:06.788474 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-9b3066e1-d037-4b54-9665-24fb0b316360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '595d597f64bd4471900c60e856f85beb'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:06.789127 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-9b3066e1-d037-4b54-9665-24fb0b316360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '595d597f64bd4471900c60e856f85beb'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:06.875664 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-9b3066e1-d037-4b54-9665-24fb0b316360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '595d597f64bd4471900c60e856f85beb'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:06.884537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-9b3066e1-d037-4b54-9665-24fb0b316360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '595d597f64bd4471900c60e856f85beb'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:06.895763 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-9b3066e1-d037-4b54-9665-24fb0b316360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '595d597f64bd4471900c60e856f85beb'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:06.902243 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1282/2524] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:52:06 2022] DELETE /identity/v3/users/595d597f64bd4471900c60e856f85beb => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:52:07.682385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e20304-f58a-411d-9a34-5d93ab74fd16 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:07.692982 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e20304-f58a-411d-9a34-5d93ab74fd16 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:07.762110 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234be3e4-2fdc-4405-a690-e64195dc97da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:07.762828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234be3e4-2fdc-4405-a690-e64195dc97da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:07.763113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234be3e4-2fdc-4405-a690-e64195dc97da admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:07.763474 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234be3e4-2fdc-4405-a690-e64195dc97da admin admin] PATH_INFO: `/v3/projects/831f6e55f689465888cc4a03ebdb4a42` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:07.764676 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234be3e4-2fdc-4405-a690-e64195dc97da admin admin] RBAC: Authorizing `identity:delete_project(project_id=831f6e55f689465888cc4a03ebdb4a42)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:07.766652 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234be3e4-2fdc-4405-a690-e64195dc97da admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:07.889594 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:07.898856 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-234be3e4-2fdc-4405-a690-e64195dc97da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '831f6e55f689465888cc4a03ebdb4a42', 'request_id': 'req-234be3e4-2fdc-4405-a690-e64195dc97da'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:07.904449 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-234be3e4-2fdc-4405-a690-e64195dc97da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '831f6e55f689465888cc4a03ebdb4a42', 'request_id': 'req-234be3e4-2fdc-4405-a690-e64195dc97da'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:08.059211 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-234be3e4-2fdc-4405-a690-e64195dc97da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '831f6e55f689465888cc4a03ebdb4a42', 'request_id': 'req-234be3e4-2fdc-4405-a690-e64195dc97da'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:08.076359 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-234be3e4-2fdc-4405-a690-e64195dc97da admin admin] The token cache is being invalidate because project 831f6e55f689465888cc4a03ebdb4a42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:52:08.077423 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-234be3e4-2fdc-4405-a690-e64195dc97da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:08.079375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-234be3e4-2fdc-4405-a690-e64195dc97da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:08.081146 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1243/2525] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:52:07 2022] DELETE /identity/v3/projects/831f6e55f689465888cc4a03ebdb4a42 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:08.085925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d6eab-9d5d-4d11-bc46-cd3addf900e7 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:08.086458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d6eab-9d5d-4d11-bc46-cd3addf900e7 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:08.086458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d6eab-9d5d-4d11-bc46-cd3addf900e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:08.108492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-b64d6eab-9d5d-4d11-bc46-cd3addf900e7 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:08.109743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b64d6eab-9d5d-4d11-bc46-cd3addf900e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:08.185831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1283/2526] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:52:08.194112 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4acd2-ce8e-4cc9-9357-ac5d9d571adc None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:08.194403 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4acd2-ce8e-4cc9-9357-ac5d9d571adc None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:08.194685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4acd2-ce8e-4cc9-9357-ac5d9d571adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:08.216674 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-a2c4acd2-ce8e-4cc9-9357-ac5d9d571adc None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:08.217957 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a2c4acd2-ce8e-4cc9-9357-ac5d9d571adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:08.226258 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1244/2527] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:08.236428 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d6eab-9d5d-4d11-bc46-cd3addf900e7 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:08.248068 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d6eab-9d5d-4d11-bc46-cd3addf900e7 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:08.253153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ff747-efe5-41a4-92d2-b773595581d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:08.253808 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ff747-efe5-41a4-92d2-b773595581d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:08.254099 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ff747-efe5-41a4-92d2-b773595581d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:08.254378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ff747-efe5-41a4-92d2-b773595581d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:08.255120 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ff747-efe5-41a4-92d2-b773595581d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:08.255462 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ff747-efe5-41a4-92d2-b773595581d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:08.257096 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ff747-efe5-41a4-92d2-b773595581d0 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:08.274043 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1284/2528] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:08.275348 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4acd2-ce8e-4cc9-9357-ac5d9d571adc None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:08.286327 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4acd2-ce8e-4cc9-9357-ac5d9d571adc None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:08.291255 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a772d5-4e8c-4a76-9f76-d8e3bb0b6453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:08.291938 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a772d5-4e8c-4a76-9f76-d8e3bb0b6453 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:08.292226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a772d5-4e8c-4a76-9f76-d8e3bb0b6453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:08.292507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a772d5-4e8c-4a76-9f76-d8e3bb0b6453 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:08.294212 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a772d5-4e8c-4a76-9f76-d8e3bb0b6453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:08.296247 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a772d5-4e8c-4a76-9f76-d8e3bb0b6453 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:08.391330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1245/2529] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:52:08 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:08.395544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ff747-efe5-41a4-92d2-b773595581d0 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:08.406939 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ff747-efe5-41a4-92d2-b773595581d0 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:08.468588 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f90d6f-819a-4e96-832b-528a8b3a7f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:08.469135 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f90d6f-819a-4e96-832b-528a8b3a7f63 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:08.469426 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f90d6f-819a-4e96-832b-528a8b3a7f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:08.469703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f90d6f-819a-4e96-832b-528a8b3a7f63 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:08.470521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f90d6f-819a-4e96-832b-528a8b3a7f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:08.472515 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f90d6f-819a-4e96-832b-528a8b3a7f63 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:08.550293 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1285/2530] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:52:08 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:52:08.561487 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a772d5-4e8c-4a76-9f76-d8e3bb0b6453 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:08.566071 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a772d5-4e8c-4a76-9f76-d8e3bb0b6453 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:08.570933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edfff2-9fb2-4c99-bf25-9719c52375d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:08.571597 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edfff2-9fb2-4c99-bf25-9719c52375d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:08.571901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edfff2-9fb2-4c99-bf25-9719c52375d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:08.572184 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edfff2-9fb2-4c99-bf25-9719c52375d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:08.572893 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edfff2-9fb2-4c99-bf25-9719c52375d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:08.575322 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edfff2-9fb2-4c99-bf25-9719c52375d2 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:08.586284 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1246/2531] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:08.590924 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f90d6f-819a-4e96-832b-528a8b3a7f63 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:08.600927 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f90d6f-819a-4e96-832b-528a8b3a7f63 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:08.606171 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef849db-9544-4a0d-a03d-0c79e361ec06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:08.606866 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef849db-9544-4a0d-a03d-0c79e361ec06 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:08.607152 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef849db-9544-4a0d-a03d-0c79e361ec06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:08.607481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef849db-9544-4a0d-a03d-0c79e361ec06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:08.613088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef849db-9544-4a0d-a03d-0c79e361ec06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:08.613088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef849db-9544-4a0d-a03d-0c79e361ec06 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:08.613088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:08.627934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1286/2532] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:52:08.628153 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edfff2-9fb2-4c99-bf25-9719c52375d2 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:08.638557 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edfff2-9fb2-4c99-bf25-9719c52375d2 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:08.643724 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca877bd-3a11-4468-a7a3-9d55bb94d4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:08.644431 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca877bd-3a11-4468-a7a3-9d55bb94d4d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:08.645057 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca877bd-3a11-4468-a7a3-9d55bb94d4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:08.645057 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca877bd-3a11-4468-a7a3-9d55bb94d4d0 admin admin] PATH_INFO: `/v3/projects/d15dbc9defb1426098e8f5053a136205/users/9a85e88a7b284241aeccb30831c953bc/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:08.669815 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca877bd-3a11-4468-a7a3-9d55bb94d4d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d15dbc9defb1426098e8f5053a136205, user_id=9a85e88a7b284241aeccb30831c953bc, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:08.672766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca877bd-3a11-4468-a7a3-9d55bb94d4d0 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:08.748079 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1247/2533] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:08 2022] PUT /identity/v3/projects/d15dbc9defb1426098e8f5053a136205/users/9a85e88a7b284241aeccb30831c953bc/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:08.758761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034306b-2b2e-4275-8199-e3b7df3ff8a0 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:08.759055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034306b-2b2e-4275-8199-e3b7df3ff8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:08.759432 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034306b-2b2e-4275-8199-e3b7df3ff8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:08.791779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-4034306b-2b2e-4275-8199-e3b7df3ff8a0 None None] MFA Rules not processed for user `9a85e88a7b284241aeccb30831c953bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:08.793911 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4034306b-2b2e-4275-8199-e3b7df3ff8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:08.879542 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1287/2534] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:08.883255 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca877bd-3a11-4468-a7a3-9d55bb94d4d0 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:08.969624 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca877bd-3a11-4468-a7a3-9d55bb94d4d0 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:08.975316 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b710917-ca22-44b1-a27c-c1b730145925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:08.975899 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b710917-ca22-44b1-a27c-c1b730145925 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:08.976183 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b710917-ca22-44b1-a27c-c1b730145925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:08.976642 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b710917-ca22-44b1-a27c-c1b730145925 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:08.977921 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b710917-ca22-44b1-a27c-c1b730145925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:08.979909 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b710917-ca22-44b1-a27c-c1b730145925 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:09.124523 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1248/2535] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:52:08 2022] POST /identity/v3/projects => generated 381 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:09.128410 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034306b-2b2e-4275-8199-e3b7df3ff8a0 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:09.140202 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034306b-2b2e-4275-8199-e3b7df3ff8a0 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:09.222332 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b050a0-f8c0-4b59-9604-f57ee3a124a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:09.222332 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b050a0-f8c0-4b59-9604-f57ee3a124a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:09.222332 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b050a0-f8c0-4b59-9604-f57ee3a124a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:09.222332 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b050a0-f8c0-4b59-9604-f57ee3a124a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:09.222746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b050a0-f8c0-4b59-9604-f57ee3a124a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:09.222746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b050a0-f8c0-4b59-9604-f57ee3a124a0 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:09.344684 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1288/2536] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:52:09 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:52:09.348538 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b710917-ca22-44b1-a27c-c1b730145925 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:09.359901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b710917-ca22-44b1-a27c-c1b730145925 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:09.364593 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf14e4-a4a2-4b96-b744-ca861fc25d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:09.365263 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf14e4-a4a2-4b96-b744-ca861fc25d7c admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:09.365548 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf14e4-a4a2-4b96-b744-ca861fc25d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:09.365860 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf14e4-a4a2-4b96-b744-ca861fc25d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:09.366560 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf14e4-a4a2-4b96-b744-ca861fc25d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:09.368497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf14e4-a4a2-4b96-b744-ca861fc25d7c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:09.384359 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1249/2537] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:09.389405 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b050a0-f8c0-4b59-9604-f57ee3a124a0 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:09.400024 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b050a0-f8c0-4b59-9604-f57ee3a124a0 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:09.405477 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734098a2-0026-40e5-9d40-80d1ede3d29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:09.406154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734098a2-0026-40e5-9d40-80d1ede3d29b admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:09.406438 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734098a2-0026-40e5-9d40-80d1ede3d29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:09.406746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734098a2-0026-40e5-9d40-80d1ede3d29b admin admin] PATH_INFO: `/v3/projects/a0c997159fb74f4181e03b757df57c84/users/109e867e197a41f28aa0005fa396d9b8/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:09.423224 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734098a2-0026-40e5-9d40-80d1ede3d29b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0c997159fb74f4181e03b757df57c84, user_id=109e867e197a41f28aa0005fa396d9b8, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:09.425963 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734098a2-0026-40e5-9d40-80d1ede3d29b admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:09.516351 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1289/2538] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:09 2022] PUT /identity/v3/projects/a0c997159fb74f4181e03b757df57c84/users/109e867e197a41f28aa0005fa396d9b8/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:09.520376 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf14e4-a4a2-4b96-b744-ca861fc25d7c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:09.530396 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf14e4-a4a2-4b96-b744-ca861fc25d7c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:09.561083 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:09.587971 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a93a2-8d61-4b4c-a6b1-3f7756024c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:09.588676 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a93a2-8d61-4b4c-a6b1-3f7756024c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:09.589035 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a93a2-8d61-4b4c-a6b1-3f7756024c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:09.589375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a93a2-8d61-4b4c-a6b1-3f7756024c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:09.590251 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a93a2-8d61-4b4c-a6b1-3f7756024c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:09.592123 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a93a2-8d61-4b4c-a6b1-3f7756024c32 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:09.610137 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1250/2539] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:09.615153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734098a2-0026-40e5-9d40-80d1ede3d29b admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:09.625769 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734098a2-0026-40e5-9d40-80d1ede3d29b admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:09.630876 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782f028-7fe2-4f84-9331-7e70737f2939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:09.631604 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782f028-7fe2-4f84-9331-7e70737f2939 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:09.631947 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782f028-7fe2-4f84-9331-7e70737f2939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:09.632243 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782f028-7fe2-4f84-9331-7e70737f2939 admin admin] PATH_INFO: `/v3/projects/a0c997159fb74f4181e03b757df57c84/users/109e867e197a41f28aa0005fa396d9b8/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:09.634365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782f028-7fe2-4f84-9331-7e70737f2939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0c997159fb74f4181e03b757df57c84, user_id=109e867e197a41f28aa0005fa396d9b8, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:09.637898 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782f028-7fe2-4f84-9331-7e70737f2939 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:09.656551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1290/2540] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:09 2022] PUT /identity/v3/projects/a0c997159fb74f4181e03b757df57c84/users/109e867e197a41f28aa0005fa396d9b8/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:09.668851 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bef17d-5529-482d-8a5e-b481a51eca49 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:09.669139 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bef17d-5529-482d-8a5e-b481a51eca49 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:09.669421 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bef17d-5529-482d-8a5e-b481a51eca49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:09.702573 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-59bef17d-5529-482d-8a5e-b481a51eca49 None None] MFA Rules not processed for user `109e867e197a41f28aa0005fa396d9b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:09.703870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-59bef17d-5529-482d-8a5e-b481a51eca49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:09.786309 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1251/2541] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:09.796761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782f028-7fe2-4f84-9331-7e70737f2939 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:09.798488 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-d782f028-7fe2-4f84-9331-7e70737f2939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:09.843344 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:09.861193 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782f028-7fe2-4f84-9331-7e70737f2939 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:09.865045 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87f139-1dc5-4af3-b623-2bf5cd617d7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:09.865668 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87f139-1dc5-4af3-b623-2bf5cd617d7d service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:09.865953 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87f139-1dc5-4af3-b623-2bf5cd617d7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:09.866230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87f139-1dc5-4af3-b623-2bf5cd617d7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:09.876255 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87f139-1dc5-4af3-b623-2bf5cd617d7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:09.877752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87f139-1dc5-4af3-b623-2bf5cd617d7d service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:09.887561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1291/2542] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:09.954959 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bef17d-5529-482d-8a5e-b481a51eca49 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:10.020667 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bef17d-5529-482d-8a5e-b481a51eca49 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:10.025445 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d4ab9-be7a-459d-81aa-6cab4dd7df38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:10.026049 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d4ab9-be7a-459d-81aa-6cab4dd7df38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:10.026334 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d4ab9-be7a-459d-81aa-6cab4dd7df38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:10.026614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d4ab9-be7a-459d-81aa-6cab4dd7df38 admin admin] PATH_INFO: `/v3/users/9a85e88a7b284241aeccb30831c953bc` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:10.027896 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d4ab9-be7a-459d-81aa-6cab4dd7df38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a85e88a7b284241aeccb30831c953bc)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:10.029845 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d4ab9-be7a-459d-81aa-6cab4dd7df38 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:10.234615 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e36d4ab9-be7a-459d-81aa-6cab4dd7df38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a85e88a7b284241aeccb30831c953bc'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:10.235371 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e36d4ab9-be7a-459d-81aa-6cab4dd7df38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a85e88a7b284241aeccb30831c953bc'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:10.349107 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e36d4ab9-be7a-459d-81aa-6cab4dd7df38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a85e88a7b284241aeccb30831c953bc'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:10.350182 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:10.365214 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e36d4ab9-be7a-459d-81aa-6cab4dd7df38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a85e88a7b284241aeccb30831c953bc'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:10.366131 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e36d4ab9-be7a-459d-81aa-6cab4dd7df38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a85e88a7b284241aeccb30831c953bc'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:10.383843 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1252/2543] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:52:09 2022] DELETE /identity/v3/users/9a85e88a7b284241aeccb30831c953bc => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:10.387867 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f48c1-9e3b-46ae-a5d2-c7d62d6c1869 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:10.388744 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f48c1-9e3b-46ae-a5d2-c7d62d6c1869 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:10.389039 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f48c1-9e3b-46ae-a5d2-c7d62d6c1869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:10.416398 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-476f48c1-9e3b-46ae-a5d2-c7d62d6c1869 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:10.417830 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-476f48c1-9e3b-46ae-a5d2-c7d62d6c1869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:10.506807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1292/2544] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:10.519136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d4ab9-be7a-459d-81aa-6cab4dd7df38 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:10.524251 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e36d4ab9-be7a-459d-81aa-6cab4dd7df38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:10.633161 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d4ab9-be7a-459d-81aa-6cab4dd7df38 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:10.637603 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c69db-9a7a-4d0c-83a6-6ec6ff222be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:10.638692 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c69db-9a7a-4d0c-83a6-6ec6ff222be7 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:10.638692 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c69db-9a7a-4d0c-83a6-6ec6ff222be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:10.638972 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c69db-9a7a-4d0c-83a6-6ec6ff222be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:10.650751 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c69db-9a7a-4d0c-83a6-6ec6ff222be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:10.652116 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c69db-9a7a-4d0c-83a6-6ec6ff222be7 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:10.664909 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1253/2545] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:11.266253 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f48c1-9e3b-46ae-a5d2-c7d62d6c1869 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:11.268077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-476f48c1-9e3b-46ae-a5d2-c7d62d6c1869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:11.281265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f48c1-9e3b-46ae-a5d2-c7d62d6c1869 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:11.286230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b218cb-ec94-461f-857a-3a754e8cf1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:11.290223 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b218cb-ec94-461f-857a-3a754e8cf1c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:11.290223 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b218cb-ec94-461f-857a-3a754e8cf1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:11.290223 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b218cb-ec94-461f-857a-3a754e8cf1c8 admin admin] PATH_INFO: `/v3/projects/d15dbc9defb1426098e8f5053a136205` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:11.290223 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b218cb-ec94-461f-857a-3a754e8cf1c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d15dbc9defb1426098e8f5053a136205)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:11.290699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b218cb-ec94-461f-857a-3a754e8cf1c8 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:11.326613 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c69db-9a7a-4d0c-83a6-6ec6ff222be7 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:11.328789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-789c69db-9a7a-4d0c-83a6-6ec6ff222be7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:11.343329 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c69db-9a7a-4d0c-83a6-6ec6ff222be7 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:11.348041 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c449bd-918e-4432-9512-db60d61e2614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:11.353158 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c449bd-918e-4432-9512-db60d61e2614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:11.353158 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c449bd-918e-4432-9512-db60d61e2614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:11.353158 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c449bd-918e-4432-9512-db60d61e2614 admin admin] PATH_INFO: `/v3/users/b25caac30f7641f0b0d746ebff0b54b9` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:11.353158 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c449bd-918e-4432-9512-db60d61e2614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b25caac30f7641f0b0d746ebff0b54b9)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:11.353158 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c449bd-918e-4432-9512-db60d61e2614 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:11.424268 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f9b218cb-ec94-461f-857a-3a754e8cf1c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd15dbc9defb1426098e8f5053a136205', 'request_id': 'req-f9b218cb-ec94-461f-857a-3a754e8cf1c8'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:11.429876 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f9b218cb-ec94-461f-857a-3a754e8cf1c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd15dbc9defb1426098e8f5053a136205', 'request_id': 'req-f9b218cb-ec94-461f-857a-3a754e8cf1c8'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:11.502014 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f9b218cb-ec94-461f-857a-3a754e8cf1c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd15dbc9defb1426098e8f5053a136205', 'request_id': 'req-f9b218cb-ec94-461f-857a-3a754e8cf1c8'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:11.514561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f9b218cb-ec94-461f-857a-3a754e8cf1c8 admin admin] The token cache is being invalidate because project d15dbc9defb1426098e8f5053a136205 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:52:11.514851 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f9b218cb-ec94-461f-857a-3a754e8cf1c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:11.515505 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f9b218cb-ec94-461f-857a-3a754e8cf1c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:11.517042 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1293/2546] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:52:11 2022] DELETE /identity/v3/projects/d15dbc9defb1426098e8f5053a136205 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:11.520852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b218cb-ec94-461f-857a-3a754e8cf1c8 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:11.522157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-f9b218cb-ec94-461f-857a-3a754e8cf1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:11.573068 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-21c449bd-918e-4432-9512-db60d61e2614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b25caac30f7641f0b0d746ebff0b54b9'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:11.574725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-21c449bd-918e-4432-9512-db60d61e2614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b25caac30f7641f0b0d746ebff0b54b9'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:11.590468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b218cb-ec94-461f-857a-3a754e8cf1c8 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:11.595504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073e071-b505-45d3-b95b-9d1d945703b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:11.596159 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073e071-b505-45d3-b95b-9d1d945703b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:11.596445 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073e071-b505-45d3-b95b-9d1d945703b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:11.596723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073e071-b505-45d3-b95b-9d1d945703b8 admin admin] PATH_INFO: `/v3/users/109e867e197a41f28aa0005fa396d9b8` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:11.597904 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073e071-b505-45d3-b95b-9d1d945703b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=109e867e197a41f28aa0005fa396d9b8)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:11.599892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073e071-b505-45d3-b95b-9d1d945703b8 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:11.605350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:11.669569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-21c449bd-918e-4432-9512-db60d61e2614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b25caac30f7641f0b0d746ebff0b54b9'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:11.682940 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-21c449bd-918e-4432-9512-db60d61e2614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b25caac30f7641f0b0d746ebff0b54b9'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:11.683761 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-21c449bd-918e-4432-9512-db60d61e2614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b25caac30f7641f0b0d746ebff0b54b9'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:11.697219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1254/2547] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:52:11 2022] DELETE /identity/v3/users/b25caac30f7641f0b0d746ebff0b54b9 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:52:11.832624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-7073e071-b505-45d3-b95b-9d1d945703b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '109e867e197a41f28aa0005fa396d9b8'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:11.833372 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-7073e071-b505-45d3-b95b-9d1d945703b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '109e867e197a41f28aa0005fa396d9b8'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:11.903537 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-7073e071-b505-45d3-b95b-9d1d945703b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '109e867e197a41f28aa0005fa396d9b8'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:11.916515 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-7073e071-b505-45d3-b95b-9d1d945703b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '109e867e197a41f28aa0005fa396d9b8'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:11.923513 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-7073e071-b505-45d3-b95b-9d1d945703b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '109e867e197a41f28aa0005fa396d9b8'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:11.929412 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1294/2548] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:52:11 2022] DELETE /identity/v3/users/109e867e197a41f28aa0005fa396d9b8 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:52:11.948714 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c449bd-918e-4432-9512-db60d61e2614 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:11.951072 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-21c449bd-918e-4432-9512-db60d61e2614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:12.009349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:12.026426 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c449bd-918e-4432-9512-db60d61e2614 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:12.088787 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb3ab7-4899-4eaa-b93b-e0a25169acde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:12.089360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb3ab7-4899-4eaa-b93b-e0a25169acde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:12.090170 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb3ab7-4899-4eaa-b93b-e0a25169acde admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:12.090554 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb3ab7-4899-4eaa-b93b-e0a25169acde admin admin] PATH_INFO: `/v3/projects/9115211ae1634cf2ab7d9784a36c743a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:12.091761 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb3ab7-4899-4eaa-b93b-e0a25169acde admin admin] RBAC: Authorizing `identity:delete_project(project_id=9115211ae1634cf2ab7d9784a36c743a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:12.093763 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb3ab7-4899-4eaa-b93b-e0a25169acde admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:12.231270 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6cbb3ab7-4899-4eaa-b93b-e0a25169acde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9115211ae1634cf2ab7d9784a36c743a', 'request_id': 'req-6cbb3ab7-4899-4eaa-b93b-e0a25169acde'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:12.236828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6cbb3ab7-4899-4eaa-b93b-e0a25169acde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9115211ae1634cf2ab7d9784a36c743a', 'request_id': 'req-6cbb3ab7-4899-4eaa-b93b-e0a25169acde'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:12.320715 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6cbb3ab7-4899-4eaa-b93b-e0a25169acde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9115211ae1634cf2ab7d9784a36c743a', 'request_id': 'req-6cbb3ab7-4899-4eaa-b93b-e0a25169acde'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:12.335242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6cbb3ab7-4899-4eaa-b93b-e0a25169acde admin admin] The token cache is being invalidate because project 9115211ae1634cf2ab7d9784a36c743a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:52:12.335939 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6cbb3ab7-4899-4eaa-b93b-e0a25169acde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:12.336220 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-6cbb3ab7-4899-4eaa-b93b-e0a25169acde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:12.337764 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1255/2549] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:52:11 2022] DELETE /identity/v3/projects/9115211ae1634cf2ab7d9784a36c743a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:12.343804 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404b317-90ae-4459-b309-9b292db6eb4d None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:12.344024 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404b317-90ae-4459-b309-9b292db6eb4d None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:12.344300 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404b317-90ae-4459-b309-9b292db6eb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:12.365270 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-0404b317-90ae-4459-b309-9b292db6eb4d None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:12.366514 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-0404b317-90ae-4459-b309-9b292db6eb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:12.368590 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb3ab7-4899-4eaa-b93b-e0a25169acde admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:12.370025 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6cbb3ab7-4899-4eaa-b93b-e0a25169acde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:12.442953 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1295/2550] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:12.448118 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb3ab7-4899-4eaa-b93b-e0a25169acde admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:12.453267 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2f540-61b4-44f2-ac17-55b5945ebc46 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:12.453580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2f540-61b4-44f2-ac17-55b5945ebc46 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:12.453861 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2f540-61b4-44f2-ac17-55b5945ebc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:12.454485 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39623f-abe5-4ea9-b0c8-5d113d69fd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:12.455378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39623f-abe5-4ea9-b0c8-5d113d69fd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:12.455721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39623f-abe5-4ea9-b0c8-5d113d69fd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:12.456047 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39623f-abe5-4ea9-b0c8-5d113d69fd02 admin admin] PATH_INFO: `/v3/projects/a0c997159fb74f4181e03b757df57c84` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:12.457298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39623f-abe5-4ea9-b0c8-5d113d69fd02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0c997159fb74f4181e03b757df57c84)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:12.459421 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39623f-abe5-4ea9-b0c8-5d113d69fd02 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:12.475989 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-31e2f540-61b4-44f2-ac17-55b5945ebc46 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:12.477225 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-31e2f540-61b4-44f2-ac17-55b5945ebc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:12.489713 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1296/2551] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:52:12.491029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2f540-61b4-44f2-ac17-55b5945ebc46 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:12.502217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2f540-61b4-44f2-ac17-55b5945ebc46 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:12.508151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4562af-c7f4-4071-adcf-30abccf5a78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:12.509077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4562af-c7f4-4071-adcf-30abccf5a78b admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:12.509077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4562af-c7f4-4071-adcf-30abccf5a78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:12.509357 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4562af-c7f4-4071-adcf-30abccf5a78b admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:12.510105 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4562af-c7f4-4071-adcf-30abccf5a78b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:12.510414 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4562af-c7f4-4071-adcf-30abccf5a78b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:12.512779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4562af-c7f4-4071-adcf-30abccf5a78b admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:12.530925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1297/2552] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:12.532619 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4562af-c7f4-4071-adcf-30abccf5a78b admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:12.545285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4562af-c7f4-4071-adcf-30abccf5a78b admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:12.556521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ac42d-a0d5-4c03-ae0c-4e1f22b8c459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:12.557249 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ac42d-a0d5-4c03-ae0c-4e1f22b8c459 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:12.557606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ac42d-a0d5-4c03-ae0c-4e1f22b8c459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:12.557963 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ac42d-a0d5-4c03-ae0c-4e1f22b8c459 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:12.559440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ac42d-a0d5-4c03-ae0c-4e1f22b8c459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:12.561547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ac42d-a0d5-4c03-ae0c-4e1f22b8c459 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:12.660356 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1298/2553] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:52:12 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:12.665228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ac42d-a0d5-4c03-ae0c-4e1f22b8c459 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:12.695218 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:12.715571 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4b39623f-abe5-4ea9-b0c8-5d113d69fd02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0c997159fb74f4181e03b757df57c84', 'request_id': 'req-4b39623f-abe5-4ea9-b0c8-5d113d69fd02'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:12.716600 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:12.722826 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4b39623f-abe5-4ea9-b0c8-5d113d69fd02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0c997159fb74f4181e03b757df57c84', 'request_id': 'req-4b39623f-abe5-4ea9-b0c8-5d113d69fd02'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:12.736251 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ac42d-a0d5-4c03-ae0c-4e1f22b8c459 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:12.797950 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852387e2-39f8-4c81-8b2d-aa58efbb8ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:12.798586 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852387e2-39f8-4c81-8b2d-aa58efbb8ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:12.798874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852387e2-39f8-4c81-8b2d-aa58efbb8ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:12.799153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852387e2-39f8-4c81-8b2d-aa58efbb8ff7 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:12.799868 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852387e2-39f8-4c81-8b2d-aa58efbb8ff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:12.801010 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4b39623f-abe5-4ea9-b0c8-5d113d69fd02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0c997159fb74f4181e03b757df57c84', 'request_id': 'req-4b39623f-abe5-4ea9-b0c8-5d113d69fd02'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:12.801928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852387e2-39f8-4c81-8b2d-aa58efbb8ff7 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:12.816346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4b39623f-abe5-4ea9-b0c8-5d113d69fd02 admin admin] The token cache is being invalidate because project a0c997159fb74f4181e03b757df57c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:52:12.816641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4b39623f-abe5-4ea9-b0c8-5d113d69fd02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:12.817323 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4b39623f-abe5-4ea9-b0c8-5d113d69fd02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:12.819016 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1256/2554] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:52:12 2022] DELETE /identity/v3/projects/a0c997159fb74f4181e03b757df57c84 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:12.823789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c2365-76ab-4b17-af34-4c1af0cad8b8 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:12.824654 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c2365-76ab-4b17-af34-4c1af0cad8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:12.825044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c2365-76ab-4b17-af34-4c1af0cad8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:12.848660 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-666c2365-76ab-4b17-af34-4c1af0cad8b8 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:12.849891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-666c2365-76ab-4b17-af34-4c1af0cad8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:12.859349 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1257/2555] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:52:12.868325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40a47a-2126-44ae-9069-cd978ba69858 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:12.868606 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40a47a-2126-44ae-9069-cd978ba69858 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:12.868883 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40a47a-2126-44ae-9069-cd978ba69858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:12.890041 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-ca40a47a-2126-44ae-9069-cd978ba69858 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:12.891385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ca40a47a-2126-44ae-9069-cd978ba69858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:12.899873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1258/2556] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:52:12.904325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40a47a-2126-44ae-9069-cd978ba69858 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:12.913632 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40a47a-2126-44ae-9069-cd978ba69858 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:12.919294 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1beffdf-03a5-4cec-8bab-343357e5d583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:12.919932 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1beffdf-03a5-4cec-8bab-343357e5d583 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:12.920216 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1beffdf-03a5-4cec-8bab-343357e5d583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:12.920489 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1beffdf-03a5-4cec-8bab-343357e5d583 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:12.921196 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1beffdf-03a5-4cec-8bab-343357e5d583 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:12.921502 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1beffdf-03a5-4cec-8bab-343357e5d583 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:12.923121 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1beffdf-03a5-4cec-8bab-343357e5d583 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:12.935912 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1259/2557] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:12.944026 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1beffdf-03a5-4cec-8bab-343357e5d583 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:12.951336 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1299/2558] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:52:12 2022] POST /identity/v3/users => generated 286 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:52:12.954076 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852387e2-39f8-4c81-8b2d-aa58efbb8ff7 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:12.955912 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1beffdf-03a5-4cec-8bab-343357e5d583 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:12.956452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-852387e2-39f8-4c81-8b2d-aa58efbb8ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:12.961601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79427c80-8510-4fbc-ba3f-4bc1409860e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:12.962366 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79427c80-8510-4fbc-ba3f-4bc1409860e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:12.962649 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79427c80-8510-4fbc-ba3f-4bc1409860e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:12.963057 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79427c80-8510-4fbc-ba3f-4bc1409860e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:12.963768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79427c80-8510-4fbc-ba3f-4bc1409860e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:12.966136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79427c80-8510-4fbc-ba3f-4bc1409860e7 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:12.970860 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852387e2-39f8-4c81-8b2d-aa58efbb8ff7 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:12.976996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883e8c1-588a-4292-af84-059543acae7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:12.977807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e8c1-588a-4292-af84-059543acae7f admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:12.978100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e8c1-588a-4292-af84-059543acae7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:12.978384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e8c1-588a-4292-af84-059543acae7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:12.979125 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883e8c1-588a-4292-af84-059543acae7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:12.981427 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883e8c1-588a-4292-af84-059543acae7f admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:12.993649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1300/2559] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:52:12.998633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883e8c1-588a-4292-af84-059543acae7f admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:13.008838 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883e8c1-588a-4292-af84-059543acae7f admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:13.013572 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422635a0-e8d2-428f-aae2-cfb48c123dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:13.014243 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422635a0-e8d2-428f-aae2-cfb48c123dce admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:13.014528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422635a0-e8d2-428f-aae2-cfb48c123dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:13.014805 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422635a0-e8d2-428f-aae2-cfb48c123dce admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:13.015550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422635a0-e8d2-428f-aae2-cfb48c123dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:13.017142 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422635a0-e8d2-428f-aae2-cfb48c123dce admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:13.028226 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1301/2560] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:52:13.033234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422635a0-e8d2-428f-aae2-cfb48c123dce admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:13.043859 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422635a0-e8d2-428f-aae2-cfb48c123dce admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:13.048741 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26376600-fe05-444f-9232-4e7b1bcb4905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:13.049423 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26376600-fe05-444f-9232-4e7b1bcb4905 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:13.049706 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26376600-fe05-444f-9232-4e7b1bcb4905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:13.049986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26376600-fe05-444f-9232-4e7b1bcb4905 admin admin] PATH_INFO: `/v3/projects/1abaf636f5d04525a6f598292347c3fe/users/56ec5f199a8b4847a3544b233f6a8613/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:13.059790 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1260/2561] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:52:12 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:13.065338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79427c80-8510-4fbc-ba3f-4bc1409860e7 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:13.068287 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26376600-fe05-444f-9232-4e7b1bcb4905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1abaf636f5d04525a6f598292347c3fe, user_id=56ec5f199a8b4847a3544b233f6a8613, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:13.071227 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26376600-fe05-444f-9232-4e7b1bcb4905 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:13.133545 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79427c80-8510-4fbc-ba3f-4bc1409860e7 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:13.138235 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badab63-de45-47a1-b7a8-8caa8e6ab039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:13.138787 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badab63-de45-47a1-b7a8-8caa8e6ab039 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:13.139170 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badab63-de45-47a1-b7a8-8caa8e6ab039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:13.139370 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badab63-de45-47a1-b7a8-8caa8e6ab039 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:13.140033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7badab63-de45-47a1-b7a8-8caa8e6ab039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:13.141948 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7badab63-de45-47a1-b7a8-8caa8e6ab039 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:13.161123 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1302/2562] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:13 2022] PUT /identity/v3/projects/1abaf636f5d04525a6f598292347c3fe/users/56ec5f199a8b4847a3544b233f6a8613/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:13.172459 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75bd2d-35a2-4712-ad25-be70b0d23755 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:13.172756 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75bd2d-35a2-4712-ad25-be70b0d23755 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:13.173038 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75bd2d-35a2-4712-ad25-be70b0d23755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:13.200857 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-6b75bd2d-35a2-4712-ad25-be70b0d23755 None None] MFA Rules not processed for user `56ec5f199a8b4847a3544b233f6a8613`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:13.202371 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-6b75bd2d-35a2-4712-ad25-be70b0d23755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:13.268183 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1303/2563] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:52:13.271966 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1261/2564] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:52:13 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:52:13.276150 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75bd2d-35a2-4712-ad25-be70b0d23755 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:13.280011 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badab63-de45-47a1-b7a8-8caa8e6ab039 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:13.281676 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-7badab63-de45-47a1-b7a8-8caa8e6ab039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:13.304032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:13.336079 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:13.343110 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75bd2d-35a2-4712-ad25-be70b0d23755 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:13.349171 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be3e06-05c3-4d86-a488-52e8bf1b479e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:13.349803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be3e06-05c3-4d86-a488-52e8bf1b479e admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:13.350091 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be3e06-05c3-4d86-a488-52e8bf1b479e admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:13.350372 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be3e06-05c3-4d86-a488-52e8bf1b479e admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:13.351133 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be3e06-05c3-4d86-a488-52e8bf1b479e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:13.352850 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be3e06-05c3-4d86-a488-52e8bf1b479e admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:13.355133 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badab63-de45-47a1-b7a8-8caa8e6ab039 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:13.365207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1304/2565] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:13.369081 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be3e06-05c3-4d86-a488-52e8bf1b479e admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:13.379366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be3e06-05c3-4d86-a488-52e8bf1b479e admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:13.384190 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d7f89-7ce7-403c-9887-6255e28001ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:13.384998 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d7f89-7ce7-403c-9887-6255e28001ee admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:13.385283 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d7f89-7ce7-403c-9887-6255e28001ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:13.385564 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d7f89-7ce7-403c-9887-6255e28001ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:13.386317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d7f89-7ce7-403c-9887-6255e28001ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:13.388171 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d7f89-7ce7-403c-9887-6255e28001ee admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:13.405553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1305/2566] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:52:13.408659 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d7f89-7ce7-403c-9887-6255e28001ee admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:13.420138 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d7f89-7ce7-403c-9887-6255e28001ee admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:13.425196 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaae74-2c54-43d8-bb87-cec46729fe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:13.425870 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaae74-2c54-43d8-bb87-cec46729fe60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:13.426008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141667df-b646-4966-ab7b-369642fa25ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:13.426144 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaae74-2c54-43d8-bb87-cec46729fe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:13.426425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaae74-2c54-43d8-bb87-cec46729fe60 admin admin] PATH_INFO: `/v3/projects/91d729205d694c0eb8a3a792caab3a55/users/6736fb7813e44d1d8a5abb663b2d0f70/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:13.426604 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141667df-b646-4966-ab7b-369642fa25ad service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:13.426884 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141667df-b646-4966-ab7b-369642fa25ad service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:13.427168 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141667df-b646-4966-ab7b-369642fa25ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:13.438256 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141667df-b646-4966-ab7b-369642fa25ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:13.440013 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141667df-b646-4966-ab7b-369642fa25ad service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:13.443604 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eaae74-2c54-43d8-bb87-cec46729fe60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d729205d694c0eb8a3a792caab3a55, user_id=6736fb7813e44d1d8a5abb663b2d0f70, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:13.446383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eaae74-2c54-43d8-bb87-cec46729fe60 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:13.450685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1262/2567] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:13.536676 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1306/2568] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:13 2022] PUT /identity/v3/projects/91d729205d694c0eb8a3a792caab3a55/users/6736fb7813e44d1d8a5abb663b2d0f70/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:52:13.547410 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5358c-04d5-4fe8-a06c-7b24d3fe5c35 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:13.547702 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5358c-04d5-4fe8-a06c-7b24d3fe5c35 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:13.547989 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5358c-04d5-4fe8-a06c-7b24d3fe5c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:13.579246 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-04c5358c-04d5-4fe8-a06c-7b24d3fe5c35 None None] MFA Rules not processed for user `6736fb7813e44d1d8a5abb663b2d0f70`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:13.580580 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-04c5358c-04d5-4fe8-a06c-7b24d3fe5c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:13.646119 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1263/2569] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:13.650857 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaae74-2c54-43d8-bb87-cec46729fe60 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:13.714506 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaae74-2c54-43d8-bb87-cec46729fe60 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:13.719317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a48b42-a2b6-4cee-9c39-ab0071f60e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:13.719933 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a48b42-a2b6-4cee-9c39-ab0071f60e2e admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:13.720213 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a48b42-a2b6-4cee-9c39-ab0071f60e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:13.720487 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a48b42-a2b6-4cee-9c39-ab0071f60e2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:13.721152 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a48b42-a2b6-4cee-9c39-ab0071f60e2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:13.723077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a48b42-a2b6-4cee-9c39-ab0071f60e2e admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:13.870975 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1307/2570] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:52:13 2022] POST /identity/v3/projects => generated 387 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:13.875234 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5358c-04d5-4fe8-a06c-7b24d3fe5c35 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:13.885951 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5358c-04d5-4fe8-a06c-7b24d3fe5c35 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:13.942551 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68716fcc-9594-43aa-a364-7300847377d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:13.943175 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68716fcc-9594-43aa-a364-7300847377d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:13.943508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68716fcc-9594-43aa-a364-7300847377d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:13.943783 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68716fcc-9594-43aa-a364-7300847377d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:13.944468 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68716fcc-9594-43aa-a364-7300847377d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:13.946540 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68716fcc-9594-43aa-a364-7300847377d6 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:14.087455 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:14.093113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1264/2571] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:52:13 2022] POST /identity/v3/users => generated 294 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:52:14.097002 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a48b42-a2b6-4cee-9c39-ab0071f60e2e admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:14.107919 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a48b42-a2b6-4cee-9c39-ab0071f60e2e admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:14.113503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806dc5d7-d36c-45b9-977b-122c9ea39e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:14.114126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806dc5d7-d36c-45b9-977b-122c9ea39e5a admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:14.114413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806dc5d7-d36c-45b9-977b-122c9ea39e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:14.114681 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806dc5d7-d36c-45b9-977b-122c9ea39e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:14.115409 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806dc5d7-d36c-45b9-977b-122c9ea39e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:14.117129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806dc5d7-d36c-45b9-977b-122c9ea39e5a admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:14.130338 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1308/2572] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:14.134776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68716fcc-9594-43aa-a364-7300847377d6 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:14.145687 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68716fcc-9594-43aa-a364-7300847377d6 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:14.150892 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc81a8-1c81-48eb-b1f0-92e61e821215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:14.151595 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc81a8-1c81-48eb-b1f0-92e61e821215 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:14.151886 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc81a8-1c81-48eb-b1f0-92e61e821215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:14.152193 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc81a8-1c81-48eb-b1f0-92e61e821215 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:14.156643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc81a8-1c81-48eb-b1f0-92e61e821215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:14.156643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc81a8-1c81-48eb-b1f0-92e61e821215 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:14.166094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1265/2573] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:14.170592 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806dc5d7-d36c-45b9-977b-122c9ea39e5a admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:14.180813 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806dc5d7-d36c-45b9-977b-122c9ea39e5a admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:14.186235 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecda48-14bc-4730-9872-e6e38a187040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:14.186908 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecda48-14bc-4730-9872-e6e38a187040 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:14.187185 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecda48-14bc-4730-9872-e6e38a187040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:14.187492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecda48-14bc-4730-9872-e6e38a187040 admin admin] PATH_INFO: `/v3/projects/31518101badc464594e7a41d16905b86/users/3e0c753810074caebf8a6954f71b6ff8/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:14.205743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecda48-14bc-4730-9872-e6e38a187040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31518101badc464594e7a41d16905b86, user_id=3e0c753810074caebf8a6954f71b6ff8, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:14.208540 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecda48-14bc-4730-9872-e6e38a187040 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:14.316938 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1309/2574] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:14 2022] PUT /identity/v3/projects/31518101badc464594e7a41d16905b86/users/3e0c753810074caebf8a6954f71b6ff8/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:14.328662 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f08a66-f0d5-495b-94c2-5940b7a3d700 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:14.328949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f08a66-f0d5-495b-94c2-5940b7a3d700 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:14.329221 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f08a66-f0d5-495b-94c2-5940b7a3d700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:14.358869 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-10f08a66-f0d5-495b-94c2-5940b7a3d700 None None] MFA Rules not processed for user `3e0c753810074caebf8a6954f71b6ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:14.360396 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-10f08a66-f0d5-495b-94c2-5940b7a3d700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:14.426038 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1266/2575] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:14.430592 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecda48-14bc-4730-9872-e6e38a187040 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:14.468129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:14.497350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecda48-14bc-4730-9872-e6e38a187040 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:14.502378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6484e8-59d0-4991-b2f4-f0aef0137d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:14.502956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6484e8-59d0-4991-b2f4-f0aef0137d93 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:14.503276 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6484e8-59d0-4991-b2f4-f0aef0137d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:14.503556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6484e8-59d0-4991-b2f4-f0aef0137d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:14.504236 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6484e8-59d0-4991-b2f4-f0aef0137d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:14.506124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6484e8-59d0-4991-b2f4-f0aef0137d93 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:14.638436 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1310/2576] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:52:14 2022] POST /identity/v3/projects => generated 387 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:14.642976 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f08a66-f0d5-495b-94c2-5940b7a3d700 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:14.655251 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f08a66-f0d5-495b-94c2-5940b7a3d700 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:14.717837 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff6a3a-e6b5-4c77-803b-5804817b5dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:14.718469 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff6a3a-e6b5-4c77-803b-5804817b5dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:14.718779 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff6a3a-e6b5-4c77-803b-5804817b5dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:14.719058 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff6a3a-e6b5-4c77-803b-5804817b5dfb admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:14.719804 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff6a3a-e6b5-4c77-803b-5804817b5dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:14.724720 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff6a3a-e6b5-4c77-803b-5804817b5dfb admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:14.842255 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1267/2577] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:52:14 2022] POST /identity/v3/users => generated 300 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:52:14.845562 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6484e8-59d0-4991-b2f4-f0aef0137d93 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:14.857258 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6484e8-59d0-4991-b2f4-f0aef0137d93 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:14.862143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812420f-2283-47a4-a6c9-1875bd13ab66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:14.862777 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812420f-2283-47a4-a6c9-1875bd13ab66 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:14.863060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812420f-2283-47a4-a6c9-1875bd13ab66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:14.863364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812420f-2283-47a4-a6c9-1875bd13ab66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:14.864072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812420f-2283-47a4-a6c9-1875bd13ab66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:14.865772 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812420f-2283-47a4-a6c9-1875bd13ab66 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:14.876889 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1311/2578] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:14.885312 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff6a3a-e6b5-4c77-803b-5804817b5dfb admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:14.895633 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff6a3a-e6b5-4c77-803b-5804817b5dfb admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:14.900304 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad095c-7f6c-49b4-a2f7-6b72a17c4c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:14.901362 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad095c-7f6c-49b4-a2f7-6b72a17c4c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:14.901362 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad095c-7f6c-49b4-a2f7-6b72a17c4c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:14.901694 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad095c-7f6c-49b4-a2f7-6b72a17c4c0c admin admin] PATH_INFO: `/v3/projects/e3718e573d264dd78603c565264ec075/users/c34c8bac08a64f19968f0b3e444874b1/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:14.917959 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad095c-7f6c-49b4-a2f7-6b72a17c4c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3718e573d264dd78603c565264ec075, user_id=c34c8bac08a64f19968f0b3e444874b1, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:14.921219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad095c-7f6c-49b4-a2f7-6b72a17c4c0c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:15.039844 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1268/2579] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:14 2022] PUT /identity/v3/projects/e3718e573d264dd78603c565264ec075/users/c34c8bac08a64f19968f0b3e444874b1/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:15.044745 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812420f-2283-47a4-a6c9-1875bd13ab66 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:15.055101 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812420f-2283-47a4-a6c9-1875bd13ab66 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:15.112512 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f2088-f1eb-4811-b88a-5030e1230646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:15.112949 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f2088-f1eb-4811-b88a-5030e1230646 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:15.113239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f2088-f1eb-4811-b88a-5030e1230646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:15.113613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f2088-f1eb-4811-b88a-5030e1230646 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:15.114312 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f2088-f1eb-4811-b88a-5030e1230646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:15.115965 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f2088-f1eb-4811-b88a-5030e1230646 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:15.126152 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1312/2580] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:15.130374 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad095c-7f6c-49b4-a2f7-6b72a17c4c0c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:15.145839 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad095c-7f6c-49b4-a2f7-6b72a17c4c0c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:15.151448 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7c632-2544-4c7d-a51f-8c480fee0a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:15.152991 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7c632-2544-4c7d-a51f-8c480fee0a65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:15.153708 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7c632-2544-4c7d-a51f-8c480fee0a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:15.153999 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7c632-2544-4c7d-a51f-8c480fee0a65 admin admin] PATH_INFO: `/v3/projects/e3718e573d264dd78603c565264ec075/users/c34c8bac08a64f19968f0b3e444874b1/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:15.156113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7c632-2544-4c7d-a51f-8c480fee0a65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3718e573d264dd78603c565264ec075, user_id=c34c8bac08a64f19968f0b3e444874b1, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:15.159548 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7c632-2544-4c7d-a51f-8c480fee0a65 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:15.170334 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1269/2581] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:15 2022] PUT /identity/v3/projects/e3718e573d264dd78603c565264ec075/users/c34c8bac08a64f19968f0b3e444874b1/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:15.182351 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d184d7-90b7-4c79-bef8-dc9a603b9cae None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:15.182351 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d184d7-90b7-4c79-bef8-dc9a603b9cae None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:15.182351 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d184d7-90b7-4c79-bef8-dc9a603b9cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:15.210580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-89d184d7-90b7-4c79-bef8-dc9a603b9cae None None] MFA Rules not processed for user `c34c8bac08a64f19968f0b3e444874b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:15.211952 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-89d184d7-90b7-4c79-bef8-dc9a603b9cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:15.287228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1313/2582] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:15.298147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7c632-2544-4c7d-a51f-8c480fee0a65 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:15.299912 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-75f7c632-2544-4c7d-a51f-8c480fee0a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:15.336943 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:15.361327 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7c632-2544-4c7d-a51f-8c480fee0a65 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:15.365275 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf04d4-f7d1-476f-b6a9-b80e234c1e4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:15.365833 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf04d4-f7d1-476f-b6a9-b80e234c1e4d service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:15.366115 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf04d4-f7d1-476f-b6a9-b80e234c1e4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:15.366413 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf04d4-f7d1-476f-b6a9-b80e234c1e4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:15.380403 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf04d4-f7d1-476f-b6a9-b80e234c1e4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:15.385804 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf04d4-f7d1-476f-b6a9-b80e234c1e4d service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:15.395876 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1270/2583] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:16.594996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d184d7-90b7-4c79-bef8-dc9a603b9cae None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:16.605812 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d184d7-90b7-4c79-bef8-dc9a603b9cae None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:16.609614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea619ed-1ba0-4c77-8b6b-1990b4dcfe45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:16.610220 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea619ed-1ba0-4c77-8b6b-1990b4dcfe45 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:16.610497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea619ed-1ba0-4c77-8b6b-1990b4dcfe45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:16.610768 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea619ed-1ba0-4c77-8b6b-1990b4dcfe45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:16.637653 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:16.670592 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea619ed-1ba0-4c77-8b6b-1990b4dcfe45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:16.672048 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea619ed-1ba0-4c77-8b6b-1990b4dcfe45 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:16.681495 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1314/2584] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:16.821902 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf04d4-f7d1-476f-b6a9-b80e234c1e4d service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:16.884425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf04d4-f7d1-476f-b6a9-b80e234c1e4d service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:16.889419 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcfc50-532d-4504-9c40-f31ac746b310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:16.890065 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcfc50-532d-4504-9c40-f31ac746b310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:16.890348 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcfc50-532d-4504-9c40-f31ac746b310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:16.890711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcfc50-532d-4504-9c40-f31ac746b310 admin admin] PATH_INFO: `/v3/users/56ec5f199a8b4847a3544b233f6a8613` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:16.892034 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcfc50-532d-4504-9c40-f31ac746b310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56ec5f199a8b4847a3544b233f6a8613)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:16.893959 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcfc50-532d-4504-9c40-f31ac746b310 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:17.105629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-12fcfc50-532d-4504-9c40-f31ac746b310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56ec5f199a8b4847a3544b233f6a8613'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:17.106382 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-12fcfc50-532d-4504-9c40-f31ac746b310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56ec5f199a8b4847a3544b233f6a8613'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:17.181306 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-12fcfc50-532d-4504-9c40-f31ac746b310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56ec5f199a8b4847a3544b233f6a8613'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:17.194192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-12fcfc50-532d-4504-9c40-f31ac746b310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56ec5f199a8b4847a3544b233f6a8613'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:17.194898 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-12fcfc50-532d-4504-9c40-f31ac746b310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56ec5f199a8b4847a3544b233f6a8613'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:17.207181 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1271/2585] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:52:16 2022] DELETE /identity/v3/users/56ec5f199a8b4847a3544b233f6a8613 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:17.211996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c703a8c-4440-487c-a6e0-993d7f0c1f71 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:17.212290 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c703a8c-4440-487c-a6e0-993d7f0c1f71 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:17.212574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c703a8c-4440-487c-a6e0-993d7f0c1f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:17.232842 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-2c703a8c-4440-487c-a6e0-993d7f0c1f71 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:17.236442 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2c703a8c-4440-487c-a6e0-993d7f0c1f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:17.299871 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1315/2586] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:17.310382 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcfc50-532d-4504-9c40-f31ac746b310 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:17.311912 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-12fcfc50-532d-4504-9c40-f31ac746b310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:17.377429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcfc50-532d-4504-9c40-f31ac746b310 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:17.381505 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6f383-798d-4e59-8316-d3e449843224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:17.382137 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6f383-798d-4e59-8316-d3e449843224 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:17.382382 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6f383-798d-4e59-8316-d3e449843224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:17.382635 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6f383-798d-4e59-8316-d3e449843224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:17.390453 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:17.393422 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6f383-798d-4e59-8316-d3e449843224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:17.394910 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6f383-798d-4e59-8316-d3e449843224 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:17.404984 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1272/2587] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:17.854981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c703a8c-4440-487c-a6e0-993d7f0c1f71 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:17.857751 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2c703a8c-4440-487c-a6e0-993d7f0c1f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:17.875874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c703a8c-4440-487c-a6e0-993d7f0c1f71 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:17.882147 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac6ac2-f962-4974-8d9c-771172c4ff0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:17.882818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac6ac2-f962-4974-8d9c-771172c4ff0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:17.883093 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac6ac2-f962-4974-8d9c-771172c4ff0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:17.883450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac6ac2-f962-4974-8d9c-771172c4ff0e admin admin] PATH_INFO: `/v3/projects/1abaf636f5d04525a6f598292347c3fe` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:17.884674 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac6ac2-f962-4974-8d9c-771172c4ff0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1abaf636f5d04525a6f598292347c3fe)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:17.886756 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac6ac2-f962-4974-8d9c-771172c4ff0e admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:18.008210 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-feac6ac2-f962-4974-8d9c-771172c4ff0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1abaf636f5d04525a6f598292347c3fe', 'request_id': 'req-feac6ac2-f962-4974-8d9c-771172c4ff0e'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:18.014689 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-feac6ac2-f962-4974-8d9c-771172c4ff0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1abaf636f5d04525a6f598292347c3fe', 'request_id': 'req-feac6ac2-f962-4974-8d9c-771172c4ff0e'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:18.098002 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-feac6ac2-f962-4974-8d9c-771172c4ff0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1abaf636f5d04525a6f598292347c3fe', 'request_id': 'req-feac6ac2-f962-4974-8d9c-771172c4ff0e'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:18.110447 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-feac6ac2-f962-4974-8d9c-771172c4ff0e admin admin] The token cache is being invalidate because project 1abaf636f5d04525a6f598292347c3fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:52:18.110669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-feac6ac2-f962-4974-8d9c-771172c4ff0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:18.111340 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-feac6ac2-f962-4974-8d9c-771172c4ff0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:18.112880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1316/2588] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:52:17 2022] DELETE /identity/v3/projects/1abaf636f5d04525a6f598292347c3fe => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:18.117879 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05efb9-5a56-45a2-971d-054639a5195a None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:18.118366 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05efb9-5a56-45a2-971d-054639a5195a None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:18.118488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05efb9-5a56-45a2-971d-054639a5195a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:18.140152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-db05efb9-5a56-45a2-971d-054639a5195a None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:18.141378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-db05efb9-5a56-45a2-971d-054639a5195a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:18.201526 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1273/2589] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:18.209793 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdf0e5-91ea-41b9-a19a-9c4e81f4b71b None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:18.210111 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdf0e5-91ea-41b9-a19a-9c4e81f4b71b None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:18.210388 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdf0e5-91ea-41b9-a19a-9c4e81f4b71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:18.230655 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-34cdf0e5-91ea-41b9-a19a-9c4e81f4b71b None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:18.231890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-34cdf0e5-91ea-41b9-a19a-9c4e81f4b71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:18.239941 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1317/2590] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:18.244241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05efb9-5a56-45a2-971d-054639a5195a None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:18.254200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05efb9-5a56-45a2-971d-054639a5195a None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:18.258887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591dc6b9-e281-409c-8988-a1aa4f35201e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:18.259530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dc6b9-e281-409c-8988-a1aa4f35201e admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:18.259814 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dc6b9-e281-409c-8988-a1aa4f35201e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:18.260092 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dc6b9-e281-409c-8988-a1aa4f35201e admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:18.260790 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591dc6b9-e281-409c-8988-a1aa4f35201e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:18.261625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591dc6b9-e281-409c-8988-a1aa4f35201e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:18.263302 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591dc6b9-e281-409c-8988-a1aa4f35201e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:18.276204 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1274/2591] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:18.281071 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdf0e5-91ea-41b9-a19a-9c4e81f4b71b None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:18.290343 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdf0e5-91ea-41b9-a19a-9c4e81f4b71b None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:18.295199 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6627b33-d00b-4ed2-831b-816b0ac867d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:18.295843 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6627b33-d00b-4ed2-831b-816b0ac867d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:18.296126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6627b33-d00b-4ed2-831b-816b0ac867d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:18.296400 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6627b33-d00b-4ed2-831b-816b0ac867d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:18.297056 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6627b33-d00b-4ed2-831b-816b0ac867d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:18.298960 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6627b33-d00b-4ed2-831b-816b0ac867d7 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:18.383050 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1318/2592] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:52:18 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:18.389069 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591dc6b9-e281-409c-8988-a1aa4f35201e admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:18.396574 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591dc6b9-e281-409c-8988-a1aa4f35201e admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:18.457970 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d194b-c163-4ab5-a796-3ff88ac81131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:18.458754 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d194b-c163-4ab5-a796-3ff88ac81131 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:18.459038 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d194b-c163-4ab5-a796-3ff88ac81131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:18.459338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d194b-c163-4ab5-a796-3ff88ac81131 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:18.460250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d194b-c163-4ab5-a796-3ff88ac81131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:18.462090 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d194b-c163-4ab5-a796-3ff88ac81131 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:18.579533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1275/2593] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:52:18 2022] POST /identity/v3/users => generated 282 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:18.584150 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6627b33-d00b-4ed2-831b-816b0ac867d7 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:18.595035 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6627b33-d00b-4ed2-831b-816b0ac867d7 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:18.599908 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c16ba2-ea0a-4b29-bbda-7b62f2eca555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:18.600558 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c16ba2-ea0a-4b29-bbda-7b62f2eca555 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:18.600851 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c16ba2-ea0a-4b29-bbda-7b62f2eca555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:18.601129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c16ba2-ea0a-4b29-bbda-7b62f2eca555 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:18.601832 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c16ba2-ea0a-4b29-bbda-7b62f2eca555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:18.603485 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c16ba2-ea0a-4b29-bbda-7b62f2eca555 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:18.614300 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1319/2594] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:52:18.618559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d194b-c163-4ab5-a796-3ff88ac81131 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:18.629270 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d194b-c163-4ab5-a796-3ff88ac81131 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:18.634015 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88f999-9e65-4fe8-9b13-6e613c601faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:18.634623 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88f999-9e65-4fe8-9b13-6e613c601faf admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:18.634907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88f999-9e65-4fe8-9b13-6e613c601faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:18.635188 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88f999-9e65-4fe8-9b13-6e613c601faf admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:18.635917 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88f999-9e65-4fe8-9b13-6e613c601faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:18.638274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88f999-9e65-4fe8-9b13-6e613c601faf admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:18.649100 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1276/2595] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:18.653473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c16ba2-ea0a-4b29-bbda-7b62f2eca555 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:18.663780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c16ba2-ea0a-4b29-bbda-7b62f2eca555 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:18.668478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80495a18-7501-46fe-a440-316e3f5c04d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:18.669148 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80495a18-7501-46fe-a440-316e3f5c04d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:18.669436 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80495a18-7501-46fe-a440-316e3f5c04d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:18.669747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80495a18-7501-46fe-a440-316e3f5c04d1 admin admin] PATH_INFO: `/v3/projects/c5218d266ab74b9396a4412af69a7f3a/users/3c5a62ff0f26482bad7e63eb90ab0684/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:18.679106 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:18.687938 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80495a18-7501-46fe-a440-316e3f5c04d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5218d266ab74b9396a4412af69a7f3a, user_id=3c5a62ff0f26482bad7e63eb90ab0684, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:18.690767 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80495a18-7501-46fe-a440-316e3f5c04d1 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:18.782907 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1320/2596] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:18 2022] PUT /identity/v3/projects/c5218d266ab74b9396a4412af69a7f3a/users/3c5a62ff0f26482bad7e63eb90ab0684/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:18.795624 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9080ff-1a05-49c3-9a0b-cb4b10d716d8 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:18.795915 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9080ff-1a05-49c3-9a0b-cb4b10d716d8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:18.796195 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9080ff-1a05-49c3-9a0b-cb4b10d716d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:18.827921 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-8c9080ff-1a05-49c3-9a0b-cb4b10d716d8 None None] MFA Rules not processed for user `3c5a62ff0f26482bad7e63eb90ab0684`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:18.829150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8c9080ff-1a05-49c3-9a0b-cb4b10d716d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:18.878231 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:18.894889 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1277/2597] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:18.899640 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80495a18-7501-46fe-a440-316e3f5c04d1 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:18.961265 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80495a18-7501-46fe-a440-316e3f5c04d1 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:18.967051 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff991e2e-d8f3-4498-95b8-4f03f3b7fc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:18.967687 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff991e2e-d8f3-4498-95b8-4f03f3b7fc6b admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:18.967964 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff991e2e-d8f3-4498-95b8-4f03f3b7fc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:18.968242 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff991e2e-d8f3-4498-95b8-4f03f3b7fc6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:18.968903 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff991e2e-d8f3-4498-95b8-4f03f3b7fc6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:18.970848 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff991e2e-d8f3-4498-95b8-4f03f3b7fc6b admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:19.112221 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1321/2598] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:52:18 2022] POST /identity/v3/projects => generated 365 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:19.115241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9080ff-1a05-49c3-9a0b-cb4b10d716d8 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:19.126503 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9080ff-1a05-49c3-9a0b-cb4b10d716d8 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:19.183511 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6cb0e-741a-4ea3-9028-cee1f8bea35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:19.184256 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6cb0e-741a-4ea3-9028-cee1f8bea35c admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:19.184537 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6cb0e-741a-4ea3-9028-cee1f8bea35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:19.184809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6cb0e-741a-4ea3-9028-cee1f8bea35c admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:19.185480 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6cb0e-741a-4ea3-9028-cee1f8bea35c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:19.187475 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6cb0e-741a-4ea3-9028-cee1f8bea35c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:19.280792 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1278/2599] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:52:19 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:19.285043 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff991e2e-d8f3-4498-95b8-4f03f3b7fc6b admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:19.295744 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff991e2e-d8f3-4498-95b8-4f03f3b7fc6b admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:19.300576 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e8406-deae-4e9a-af62-dd0e63f2793c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:19.301221 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e8406-deae-4e9a-af62-dd0e63f2793c admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:19.301629 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e8406-deae-4e9a-af62-dd0e63f2793c admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:19.301939 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e8406-deae-4e9a-af62-dd0e63f2793c admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:19.302660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e8406-deae-4e9a-af62-dd0e63f2793c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:19.304304 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e8406-deae-4e9a-af62-dd0e63f2793c admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:19.315764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1322/2600] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:52:19.320025 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6cb0e-741a-4ea3-9028-cee1f8bea35c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:19.331014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6cb0e-741a-4ea3-9028-cee1f8bea35c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:19.335707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e693f-876b-4acf-af69-701175da4228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:19.336355 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e693f-876b-4acf-af69-701175da4228 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:19.336635 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e693f-876b-4acf-af69-701175da4228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:19.337003 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e693f-876b-4acf-af69-701175da4228 admin admin] PATH_INFO: `/v3/projects/451fc7e5438d4fad842e8b2d77a224e1/users/5a30058287354b5fbe5aeed4eb04d3d0/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:19.351921 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e693f-876b-4acf-af69-701175da4228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=451fc7e5438d4fad842e8b2d77a224e1, user_id=5a30058287354b5fbe5aeed4eb04d3d0, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:19.354590 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e693f-876b-4acf-af69-701175da4228 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:19.481069 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1279/2601] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:19 2022] PUT /identity/v3/projects/451fc7e5438d4fad842e8b2d77a224e1/users/5a30058287354b5fbe5aeed4eb04d3d0/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:19.485335 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e8406-deae-4e9a-af62-dd0e63f2793c admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:19.496390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e8406-deae-4e9a-af62-dd0e63f2793c admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:19.553327 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa2953-e400-43a3-bea3-e9adf575f992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:19.553777 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa2953-e400-43a3-bea3-e9adf575f992 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:19.554068 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa2953-e400-43a3-bea3-e9adf575f992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:19.554348 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa2953-e400-43a3-bea3-e9adf575f992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:19.555049 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa2953-e400-43a3-bea3-e9adf575f992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:19.556705 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa2953-e400-43a3-bea3-e9adf575f992 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:19.567378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1323/2602] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:19.571549 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e693f-876b-4acf-af69-701175da4228 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:19.582870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e693f-876b-4acf-af69-701175da4228 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:19.587518 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de29cd-c35f-47c0-b853-a97ca987c756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:19.588177 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de29cd-c35f-47c0-b853-a97ca987c756 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:19.588461 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de29cd-c35f-47c0-b853-a97ca987c756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:19.588737 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de29cd-c35f-47c0-b853-a97ca987c756 admin admin] PATH_INFO: `/v3/projects/451fc7e5438d4fad842e8b2d77a224e1/users/5a30058287354b5fbe5aeed4eb04d3d0/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:19.591203 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de29cd-c35f-47c0-b853-a97ca987c756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=451fc7e5438d4fad842e8b2d77a224e1, user_id=5a30058287354b5fbe5aeed4eb04d3d0, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:19.593963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de29cd-c35f-47c0-b853-a97ca987c756 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:19.604526 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1280/2603] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:19 2022] PUT /identity/v3/projects/451fc7e5438d4fad842e8b2d77a224e1/users/5a30058287354b5fbe5aeed4eb04d3d0/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:19.615480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac84a25-13aa-4ab6-9f81-b1fc3ada5da8 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:19.615772 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac84a25-13aa-4ab6-9f81-b1fc3ada5da8 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:19.616054 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac84a25-13aa-4ab6-9f81-b1fc3ada5da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:19.644046 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-fac84a25-13aa-4ab6-9f81-b1fc3ada5da8 None None] MFA Rules not processed for user `5a30058287354b5fbe5aeed4eb04d3d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:19.645263 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-fac84a25-13aa-4ab6-9f81-b1fc3ada5da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:19.689588 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:19.714481 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1324/2604] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:19 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:19.725796 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de29cd-c35f-47c0-b853-a97ca987c756 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:19.727543 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-44de29cd-c35f-47c0-b853-a97ca987c756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:19.790970 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de29cd-c35f-47c0-b853-a97ca987c756 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:19.795058 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ec48c-9846-437c-ba56-ce353056a60b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:19.795747 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ec48c-9846-437c-ba56-ce353056a60b service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:19.796034 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ec48c-9846-437c-ba56-ce353056a60b service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:19.796373 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ec48c-9846-437c-ba56-ce353056a60b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:19.806090 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ec48c-9846-437c-ba56-ce353056a60b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:19.807571 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ec48c-9846-437c-ba56-ce353056a60b service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:19.818236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1281/2605] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:19 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:21.029911 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac84a25-13aa-4ab6-9f81-b1fc3ada5da8 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:21.098288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac84a25-13aa-4ab6-9f81-b1fc3ada5da8 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:21.103086 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350b05f-a25f-43cf-90be-d1f1cec2fb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:21.103766 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350b05f-a25f-43cf-90be-d1f1cec2fb44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:21.104052 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350b05f-a25f-43cf-90be-d1f1cec2fb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:21.104330 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350b05f-a25f-43cf-90be-d1f1cec2fb44 admin admin] PATH_INFO: `/v3/users/3c5a62ff0f26482bad7e63eb90ab0684` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:21.106114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350b05f-a25f-43cf-90be-d1f1cec2fb44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c5a62ff0f26482bad7e63eb90ab0684)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:21.108092 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350b05f-a25f-43cf-90be-d1f1cec2fb44 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:21.358546 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-e350b05f-a25f-43cf-90be-d1f1cec2fb44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c5a62ff0f26482bad7e63eb90ab0684'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:21.359218 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-e350b05f-a25f-43cf-90be-d1f1cec2fb44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c5a62ff0f26482bad7e63eb90ab0684'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:21.463473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-e350b05f-a25f-43cf-90be-d1f1cec2fb44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c5a62ff0f26482bad7e63eb90ab0684'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:21.477050 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-e350b05f-a25f-43cf-90be-d1f1cec2fb44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c5a62ff0f26482bad7e63eb90ab0684'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:21.484949 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-e350b05f-a25f-43cf-90be-d1f1cec2fb44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c5a62ff0f26482bad7e63eb90ab0684'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:21.491365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1325/2606] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:52:21 2022] DELETE /identity/v3/users/3c5a62ff0f26482bad7e63eb90ab0684 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:21.496358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d48b80-0a38-411d-8a54-9d12997ce657 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:21.496846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d48b80-0a38-411d-8a54-9d12997ce657 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:21.496944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d48b80-0a38-411d-8a54-9d12997ce657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:21.518914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-45d48b80-0a38-411d-8a54-9d12997ce657 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:21.520172 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-45d48b80-0a38-411d-8a54-9d12997ce657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:21.571725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:21.590129 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1282/2607] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:52:21.601127 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350b05f-a25f-43cf-90be-d1f1cec2fb44 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:21.602460 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e350b05f-a25f-43cf-90be-d1f1cec2fb44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:21.660181 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350b05f-a25f-43cf-90be-d1f1cec2fb44 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:21.663926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1d7a3-20b6-45f3-b0ac-3562028b6a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:21.664547 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1d7a3-20b6-45f3-b0ac-3562028b6a1f service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:21.664835 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1d7a3-20b6-45f3-b0ac-3562028b6a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:21.665117 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1d7a3-20b6-45f3-b0ac-3562028b6a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:21.675212 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1d7a3-20b6-45f3-b0ac-3562028b6a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:21.676724 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1d7a3-20b6-45f3-b0ac-3562028b6a1f service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:21.685096 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d48b80-0a38-411d-8a54-9d12997ce657 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:21.688351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-45d48b80-0a38-411d-8a54-9d12997ce657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:21.688487 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1326/2608] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:21.749027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d48b80-0a38-411d-8a54-9d12997ce657 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:21.753377 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd12b1-9442-4439-9d46-852af9f495a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:21.754118 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd12b1-9442-4439-9d46-852af9f495a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:21.754421 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd12b1-9442-4439-9d46-852af9f495a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:21.754700 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd12b1-9442-4439-9d46-852af9f495a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:21.756517 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1ebd12b1-9442-4439-9d46-852af9f495a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:21.829134 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd12b1-9442-4439-9d46-852af9f495a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:21.830615 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd12b1-9442-4439-9d46-852af9f495a4 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:21.840525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1283/2609] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:22.151441 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1d7a3-20b6-45f3-b0ac-3562028b6a1f service neutron] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:22.153179 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-4fb1d7a3-20b6-45f3-b0ac-3562028b6a1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:22.164611 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:22.173960 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1d7a3-20b6-45f3-b0ac-3562028b6a1f service neutron] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:22.174652 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d130c9-427e-4c10-9301-5ffee6c93189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:22.175446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d130c9-427e-4c10-9301-5ffee6c93189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:22.175785 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d130c9-427e-4c10-9301-5ffee6c93189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:22.176066 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d130c9-427e-4c10-9301-5ffee6c93189 admin admin] PATH_INFO: `/v3/projects/c5218d266ab74b9396a4412af69a7f3a` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:22.177283 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d130c9-427e-4c10-9301-5ffee6c93189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5218d266ab74b9396a4412af69a7f3a)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:22.180119 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d130c9-427e-4c10-9301-5ffee6c93189 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:22.317217 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c6d130c9-427e-4c10-9301-5ffee6c93189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5218d266ab74b9396a4412af69a7f3a', 'request_id': 'req-c6d130c9-427e-4c10-9301-5ffee6c93189'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:22.322562 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c6d130c9-427e-4c10-9301-5ffee6c93189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5218d266ab74b9396a4412af69a7f3a', 'request_id': 'req-c6d130c9-427e-4c10-9301-5ffee6c93189'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:22.455829 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c6d130c9-427e-4c10-9301-5ffee6c93189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5218d266ab74b9396a4412af69a7f3a', 'request_id': 'req-c6d130c9-427e-4c10-9301-5ffee6c93189'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:22.469551 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c6d130c9-427e-4c10-9301-5ffee6c93189 admin admin] The token cache is being invalidate because project c5218d266ab74b9396a4412af69a7f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:52:22.470190 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c6d130c9-427e-4c10-9301-5ffee6c93189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:22.470861 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c6d130c9-427e-4c10-9301-5ffee6c93189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:22.472635 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1327/2610] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:52:22 2022] DELETE /identity/v3/projects/c5218d266ab74b9396a4412af69a7f3a => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:22.476891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd12b1-9442-4439-9d46-852af9f495a4 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:22.488678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd12b1-9442-4439-9d46-852af9f495a4 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:22.552171 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88319e-a357-4da6-bd06-8ab6bc977c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:22.552838 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88319e-a357-4da6-bd06-8ab6bc977c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:22.553094 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88319e-a357-4da6-bd06-8ab6bc977c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:22.553374 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88319e-a357-4da6-bd06-8ab6bc977c5a admin admin] PATH_INFO: `/v3/users/5a30058287354b5fbe5aeed4eb04d3d0` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:22.554559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88319e-a357-4da6-bd06-8ab6bc977c5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a30058287354b5fbe5aeed4eb04d3d0)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:22.556530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88319e-a357-4da6-bd06-8ab6bc977c5a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:22.773620 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:22.776453 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2c88319e-a357-4da6-bd06-8ab6bc977c5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a30058287354b5fbe5aeed4eb04d3d0'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:22.778068 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2c88319e-a357-4da6-bd06-8ab6bc977c5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a30058287354b5fbe5aeed4eb04d3d0'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:22.884651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2c88319e-a357-4da6-bd06-8ab6bc977c5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a30058287354b5fbe5aeed4eb04d3d0'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:22.899466 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2c88319e-a357-4da6-bd06-8ab6bc977c5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a30058287354b5fbe5aeed4eb04d3d0'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:22.900263 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2c88319e-a357-4da6-bd06-8ab6bc977c5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a30058287354b5fbe5aeed4eb04d3d0'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:22.913463 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1284/2611] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:52:22 2022] DELETE /identity/v3/users/5a30058287354b5fbe5aeed4eb04d3d0 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:23.350811 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d130c9-427e-4c10-9301-5ffee6c93189 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:23.352511 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c6d130c9-427e-4c10-9301-5ffee6c93189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:23.366986 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d130c9-427e-4c10-9301-5ffee6c93189 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:23.432731 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae60baa-fb2b-4e6d-91e7-cf96b19d801a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:23.433382 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae60baa-fb2b-4e6d-91e7-cf96b19d801a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:23.433669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae60baa-fb2b-4e6d-91e7-cf96b19d801a admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:23.433952 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae60baa-fb2b-4e6d-91e7-cf96b19d801a admin admin] PATH_INFO: `/v3/projects/451fc7e5438d4fad842e8b2d77a224e1` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:23.435256 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae60baa-fb2b-4e6d-91e7-cf96b19d801a admin admin] RBAC: Authorizing `identity:delete_project(project_id=451fc7e5438d4fad842e8b2d77a224e1)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:23.437237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae60baa-fb2b-4e6d-91e7-cf96b19d801a admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:23.596580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-dae60baa-fb2b-4e6d-91e7-cf96b19d801a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451fc7e5438d4fad842e8b2d77a224e1', 'request_id': 'req-dae60baa-fb2b-4e6d-91e7-cf96b19d801a'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:23.602853 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-dae60baa-fb2b-4e6d-91e7-cf96b19d801a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451fc7e5438d4fad842e8b2d77a224e1', 'request_id': 'req-dae60baa-fb2b-4e6d-91e7-cf96b19d801a'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:23.668939 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-dae60baa-fb2b-4e6d-91e7-cf96b19d801a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451fc7e5438d4fad842e8b2d77a224e1', 'request_id': 'req-dae60baa-fb2b-4e6d-91e7-cf96b19d801a'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:23.683023 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-dae60baa-fb2b-4e6d-91e7-cf96b19d801a admin admin] The token cache is being invalidate because project 451fc7e5438d4fad842e8b2d77a224e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:52:23.687748 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-dae60baa-fb2b-4e6d-91e7-cf96b19d801a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:23.687748 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-dae60baa-fb2b-4e6d-91e7-cf96b19d801a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:23.687748 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1328/2612] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:52:23 2022] DELETE /identity/v3/projects/451fc7e5438d4fad842e8b2d77a224e1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:23.691821 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd5713-15c8-4f95-b5d9-a71d74be4ef8 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:23.692329 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd5713-15c8-4f95-b5d9-a71d74be4ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:23.692424 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd5713-15c8-4f95-b5d9-a71d74be4ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:23.714172 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-9bfd5713-15c8-4f95-b5d9-a71d74be4ef8 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:23.716140 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9bfd5713-15c8-4f95-b5d9-a71d74be4ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:23.781143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1285/2613] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:23.790562 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d786924-a433-431d-9264-4f98ab06f27f None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:23.790854 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d786924-a433-431d-9264-4f98ab06f27f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:23.791473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d786924-a433-431d-9264-4f98ab06f27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:23.811930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-3d786924-a433-431d-9264-4f98ab06f27f None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:23.813162 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-3d786924-a433-431d-9264-4f98ab06f27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:23.827346 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1329/2614] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:23.831896 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd5713-15c8-4f95-b5d9-a71d74be4ef8 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:23.842231 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd5713-15c8-4f95-b5d9-a71d74be4ef8 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:23.847175 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be0f4e-e3b3-4895-9d0e-f174d9283629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:23.847787 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be0f4e-e3b3-4895-9d0e-f174d9283629 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:23.848069 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be0f4e-e3b3-4895-9d0e-f174d9283629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:23.848345 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be0f4e-e3b3-4895-9d0e-f174d9283629 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:23.849090 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be0f4e-e3b3-4895-9d0e-f174d9283629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:23.849385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be0f4e-e3b3-4895-9d0e-f174d9283629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:23.851008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be0f4e-e3b3-4895-9d0e-f174d9283629 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:23.865697 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1286/2615] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:23.870825 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d786924-a433-431d-9264-4f98ab06f27f None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:23.880721 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d786924-a433-431d-9264-4f98ab06f27f None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:23.885400 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25671a44-e1a2-42e8-8b07-89c1d3498706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:23.886014 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25671a44-e1a2-42e8-8b07-89c1d3498706 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:23.886311 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25671a44-e1a2-42e8-8b07-89c1d3498706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:23.886674 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25671a44-e1a2-42e8-8b07-89c1d3498706 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:23.887238 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25671a44-e1a2-42e8-8b07-89c1d3498706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:23.889859 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25671a44-e1a2-42e8-8b07-89c1d3498706 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:23.899460 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:24.001746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1330/2616] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:52:23 2022] POST /identity/v3/projects => generated 363 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:24.006261 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be0f4e-e3b3-4895-9d0e-f174d9283629 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:24.017213 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be0f4e-e3b3-4895-9d0e-f174d9283629 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:24.074659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcc368-9389-4b15-96d6-b602a7869e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:24.075429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcc368-9389-4b15-96d6-b602a7869e41 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:24.075858 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcc368-9389-4b15-96d6-b602a7869e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:24.076065 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcc368-9389-4b15-96d6-b602a7869e41 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:24.076996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbcc368-9389-4b15-96d6-b602a7869e41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:24.078952 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbcc368-9389-4b15-96d6-b602a7869e41 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:24.183851 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1287/2617] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:52:24 2022] POST /identity/v3/users => generated 282 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:24.194337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25671a44-e1a2-42e8-8b07-89c1d3498706 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:24.207493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25671a44-e1a2-42e8-8b07-89c1d3498706 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:24.213003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a16c1-574d-446c-bdef-aa4610f68c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:24.213622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a16c1-574d-446c-bdef-aa4610f68c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:24.213907 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a16c1-574d-446c-bdef-aa4610f68c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:24.214203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a16c1-574d-446c-bdef-aa4610f68c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:24.215033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a16c1-574d-446c-bdef-aa4610f68c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:24.216978 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a16c1-574d-446c-bdef-aa4610f68c3d admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:24.229157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1331/2618] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:24.233507 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcc368-9389-4b15-96d6-b602a7869e41 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:24.243792 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcc368-9389-4b15-96d6-b602a7869e41 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:24.249539 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a6abe-3e69-4b27-abe9-d56bdf10b4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:24.250187 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a6abe-3e69-4b27-abe9-d56bdf10b4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:24.250474 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a6abe-3e69-4b27-abe9-d56bdf10b4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:24.250747 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a6abe-3e69-4b27-abe9-d56bdf10b4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:24.251585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a6abe-3e69-4b27-abe9-d56bdf10b4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:24.253183 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a6abe-3e69-4b27-abe9-d56bdf10b4d7 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:24.264154 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1288/2619] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:52:24.278685 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a16c1-574d-446c-bdef-aa4610f68c3d admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:24.289192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a16c1-574d-446c-bdef-aa4610f68c3d admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:24.294492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40d96c-a406-4db2-a9b5-0e412e4ea0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:24.298853 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40d96c-a406-4db2-a9b5-0e412e4ea0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:24.298853 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40d96c-a406-4db2-a9b5-0e412e4ea0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:24.298853 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40d96c-a406-4db2-a9b5-0e412e4ea0e7 admin admin] PATH_INFO: `/v3/projects/ff5c1f8bd9924bcca4ad2b8086332b11/users/20f200ce3eb14296bbc588f904db51db/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:24.312334 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40d96c-a406-4db2-a9b5-0e412e4ea0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff5c1f8bd9924bcca4ad2b8086332b11, user_id=20f200ce3eb14296bbc588f904db51db, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:24.314680 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40d96c-a406-4db2-a9b5-0e412e4ea0e7 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:24.404824 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1332/2620] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:24 2022] PUT /identity/v3/projects/ff5c1f8bd9924bcca4ad2b8086332b11/users/20f200ce3eb14296bbc588f904db51db/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:24.415489 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16334740-5bdd-47ae-858a-437bd30ef812 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:24.415780 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16334740-5bdd-47ae-858a-437bd30ef812 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:24.416058 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16334740-5bdd-47ae-858a-437bd30ef812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:24.445250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-16334740-5bdd-47ae-858a-437bd30ef812 None None] MFA Rules not processed for user `20f200ce3eb14296bbc588f904db51db`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:24.446402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-16334740-5bdd-47ae-858a-437bd30ef812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:24.459233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:24.524766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1289/2621] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:24 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:24.530211 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40d96c-a406-4db2-a9b5-0e412e4ea0e7 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:24.596258 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40d96c-a406-4db2-a9b5-0e412e4ea0e7 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:24.600976 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac299b-a3ac-411f-8baf-db2afe90ca24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:24.601597 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac299b-a3ac-411f-8baf-db2afe90ca24 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:24.601880 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac299b-a3ac-411f-8baf-db2afe90ca24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:24.602157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac299b-a3ac-411f-8baf-db2afe90ca24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:24.602820 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac299b-a3ac-411f-8baf-db2afe90ca24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:24.604774 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac299b-a3ac-411f-8baf-db2afe90ca24 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:24.700985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1333/2622] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:52:24 2022] POST /identity/v3/projects => generated 365 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:24.702622 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16334740-5bdd-47ae-858a-437bd30ef812 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:24.713639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16334740-5bdd-47ae-858a-437bd30ef812 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:24.775781 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35827c-50eb-4a7d-95c5-d9f2f93470ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:24.776404 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35827c-50eb-4a7d-95c5-d9f2f93470ed admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:24.776688 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35827c-50eb-4a7d-95c5-d9f2f93470ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:24.776964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35827c-50eb-4a7d-95c5-d9f2f93470ed admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:24.777633 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35827c-50eb-4a7d-95c5-d9f2f93470ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:24.780391 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35827c-50eb-4a7d-95c5-d9f2f93470ed admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:24.867686 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1290/2623] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:52:24 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:24.869155 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac299b-a3ac-411f-8baf-db2afe90ca24 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:24.879878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac299b-a3ac-411f-8baf-db2afe90ca24 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:24.885295 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c152a-2de0-41d1-9488-e8c4bd038c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:24.885927 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c152a-2de0-41d1-9488-e8c4bd038c0b admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:24.886216 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c152a-2de0-41d1-9488-e8c4bd038c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:24.886497 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c152a-2de0-41d1-9488-e8c4bd038c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:24.887200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c152a-2de0-41d1-9488-e8c4bd038c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:24.889652 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c152a-2de0-41d1-9488-e8c4bd038c0b admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:24.900672 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1334/2624] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:24.905951 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35827c-50eb-4a7d-95c5-d9f2f93470ed admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:24.916459 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35827c-50eb-4a7d-95c5-d9f2f93470ed admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:24.921559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7c0bb-f885-4640-943b-b3bbc87b64bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:24.922221 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7c0bb-f885-4640-943b-b3bbc87b64bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:24.922498 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7c0bb-f885-4640-943b-b3bbc87b64bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:24.922782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7c0bb-f885-4640-943b-b3bbc87b64bf admin admin] PATH_INFO: `/v3/projects/e1231ebc538940bda5ec3de3e91d8d28/users/88d3518f56ba43289b74a8a835ae3f56/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:24.937704 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7c0bb-f885-4640-943b-b3bbc87b64bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1231ebc538940bda5ec3de3e91d8d28, user_id=88d3518f56ba43289b74a8a835ae3f56, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:24.940419 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7c0bb-f885-4640-943b-b3bbc87b64bf admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:25.058061 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1291/2625] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:24 2022] PUT /identity/v3/projects/e1231ebc538940bda5ec3de3e91d8d28/users/88d3518f56ba43289b74a8a835ae3f56/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:25.062241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c152a-2de0-41d1-9488-e8c4bd038c0b admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:25.072377 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c152a-2de0-41d1-9488-e8c4bd038c0b admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:25.130346 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f29cb9-1b15-4efe-bc34-ee598abc6912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:25.130966 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f29cb9-1b15-4efe-bc34-ee598abc6912 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:25.131254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f29cb9-1b15-4efe-bc34-ee598abc6912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:25.131643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f29cb9-1b15-4efe-bc34-ee598abc6912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:25.132271 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f29cb9-1b15-4efe-bc34-ee598abc6912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:25.133882 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f29cb9-1b15-4efe-bc34-ee598abc6912 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:25.144472 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1335/2626] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:25.148874 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7c0bb-f885-4640-943b-b3bbc87b64bf admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:25.160020 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7c0bb-f885-4640-943b-b3bbc87b64bf admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:25.164946 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e8bc9-f665-46b5-857a-a4535bf9c95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:25.165616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e8bc9-f665-46b5-857a-a4535bf9c95a admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:25.165899 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e8bc9-f665-46b5-857a-a4535bf9c95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:25.166175 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e8bc9-f665-46b5-857a-a4535bf9c95a admin admin] PATH_INFO: `/v3/projects/e1231ebc538940bda5ec3de3e91d8d28/users/88d3518f56ba43289b74a8a835ae3f56/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:25.168176 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e8bc9-f665-46b5-857a-a4535bf9c95a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1231ebc538940bda5ec3de3e91d8d28, user_id=88d3518f56ba43289b74a8a835ae3f56, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:25.170884 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e8bc9-f665-46b5-857a-a4535bf9c95a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:25.181653 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1292/2627] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:25 2022] PUT /identity/v3/projects/e1231ebc538940bda5ec3de3e91d8d28/users/88d3518f56ba43289b74a8a835ae3f56/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:25.193450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a27c9a-2862-461d-a2ba-575cfcdff8a4 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:25.193748 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a27c9a-2862-461d-a2ba-575cfcdff8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:25.194038 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a27c9a-2862-461d-a2ba-575cfcdff8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:25.224185 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-c5a27c9a-2862-461d-a2ba-575cfcdff8a4 None None] MFA Rules not processed for user `88d3518f56ba43289b74a8a835ae3f56`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:25.225425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c5a27c9a-2862-461d-a2ba-575cfcdff8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:25.237763 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:25.304261 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1336/2628] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:25 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:25.316190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e8bc9-f665-46b5-857a-a4535bf9c95a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:25.317986 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4b4e8bc9-f665-46b5-857a-a4535bf9c95a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:25.376780 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e8bc9-f665-46b5-857a-a4535bf9c95a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:25.380827 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2e7cb-ec2d-4c1a-a042-73365ce2285a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:25.381442 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2e7cb-ec2d-4c1a-a042-73365ce2285a service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:25.381722 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2e7cb-ec2d-4c1a-a042-73365ce2285a service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:25.381996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2e7cb-ec2d-4c1a-a042-73365ce2285a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:25.391698 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2e7cb-ec2d-4c1a-a042-73365ce2285a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:25.393158 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2e7cb-ec2d-4c1a-a042-73365ce2285a service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:25.404632 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1293/2629] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:25 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:25.664660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a27c9a-2862-461d-a2ba-575cfcdff8a4 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:25.674503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a27c9a-2862-461d-a2ba-575cfcdff8a4 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:25.678176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d7ed9-7b5f-4a89-8343-8cd16a0d0cf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:25.678790 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d7ed9-7b5f-4a89-8343-8cd16a0d0cf6 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:25.679128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d7ed9-7b5f-4a89-8343-8cd16a0d0cf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:25.679439 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d7ed9-7b5f-4a89-8343-8cd16a0d0cf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:25.737973 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d7ed9-7b5f-4a89-8343-8cd16a0d0cf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:25.739482 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d7ed9-7b5f-4a89-8343-8cd16a0d0cf6 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:25.748683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1337/2630] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:25 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:26.131706 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2e7cb-ec2d-4c1a-a042-73365ce2285a service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:26.133121 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-42b2e7cb-ec2d-4c1a-a042-73365ce2285a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:26.146973 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:26.215180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2e7cb-ec2d-4c1a-a042-73365ce2285a service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:26.220829 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ab5f6-78ab-4545-a1fd-493796f81f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:26.221420 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ab5f6-78ab-4545-a1fd-493796f81f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:26.221698 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ab5f6-78ab-4545-a1fd-493796f81f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:26.221977 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ab5f6-78ab-4545-a1fd-493796f81f72 admin admin] PATH_INFO: `/v3/users/6736fb7813e44d1d8a5abb663b2d0f70` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:26.223183 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ab5f6-78ab-4545-a1fd-493796f81f72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6736fb7813e44d1d8a5abb663b2d0f70)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:26.225189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ab5f6-78ab-4545-a1fd-493796f81f72 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:26.398560 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2b1ab5f6-78ab-4545-a1fd-493796f81f72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6736fb7813e44d1d8a5abb663b2d0f70'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:26.399335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2b1ab5f6-78ab-4545-a1fd-493796f81f72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6736fb7813e44d1d8a5abb663b2d0f70'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:26.475070 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2b1ab5f6-78ab-4545-a1fd-493796f81f72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6736fb7813e44d1d8a5abb663b2d0f70'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:26.487716 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2b1ab5f6-78ab-4545-a1fd-493796f81f72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6736fb7813e44d1d8a5abb663b2d0f70'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:26.488395 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-2b1ab5f6-78ab-4545-a1fd-493796f81f72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6736fb7813e44d1d8a5abb663b2d0f70'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:26.500754 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1294/2631] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:52:26 2022] DELETE /identity/v3/users/6736fb7813e44d1d8a5abb663b2d0f70 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:26.505193 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f25ae9-e7c1-4981-bc3d-e021df30c06f None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:26.505485 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f25ae9-e7c1-4981-bc3d-e021df30c06f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:26.505761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f25ae9-e7c1-4981-bc3d-e021df30c06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:26.525055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-a1f25ae9-e7c1-4981-bc3d-e021df30c06f None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:26.526318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a1f25ae9-e7c1-4981-bc3d-e021df30c06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:26.586393 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1338/2632] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:26.597782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ab5f6-78ab-4545-a1fd-493796f81f72 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:26.599183 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2b1ab5f6-78ab-4545-a1fd-493796f81f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:26.656044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ab5f6-78ab-4545-a1fd-493796f81f72 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:26.659678 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05646f03-b633-4712-829d-6c26addb6c1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:26.660293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05646f03-b633-4712-829d-6c26addb6c1d service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:26.660569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05646f03-b633-4712-829d-6c26addb6c1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:26.660838 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05646f03-b633-4712-829d-6c26addb6c1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:26.670109 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05646f03-b633-4712-829d-6c26addb6c1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:26.671556 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05646f03-b633-4712-829d-6c26addb6c1d service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:26.680731 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1295/2633] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:27.111401 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f25ae9-e7c1-4981-bc3d-e021df30c06f None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:27.112903 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a1f25ae9-e7c1-4981-bc3d-e021df30c06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:27.125529 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f25ae9-e7c1-4981-bc3d-e021df30c06f None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:27.130159 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cac6e1-43ad-4c82-943a-999e5f300ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:27.130809 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cac6e1-43ad-4c82-943a-999e5f300ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:27.131090 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cac6e1-43ad-4c82-943a-999e5f300ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:27.131398 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cac6e1-43ad-4c82-943a-999e5f300ffd admin admin] PATH_INFO: `/v3/projects/91d729205d694c0eb8a3a792caab3a55` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:27.132561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cac6e1-43ad-4c82-943a-999e5f300ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=91d729205d694c0eb8a3a792caab3a55)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:27.134544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cac6e1-43ad-4c82-943a-999e5f300ffd admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:27.250927 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:27.254156 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-95cac6e1-43ad-4c82-943a-999e5f300ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d729205d694c0eb8a3a792caab3a55', 'request_id': 'req-95cac6e1-43ad-4c82-943a-999e5f300ffd'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:27.260137 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-95cac6e1-43ad-4c82-943a-999e5f300ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d729205d694c0eb8a3a792caab3a55', 'request_id': 'req-95cac6e1-43ad-4c82-943a-999e5f300ffd'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:27.327174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-95cac6e1-43ad-4c82-943a-999e5f300ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d729205d694c0eb8a3a792caab3a55', 'request_id': 'req-95cac6e1-43ad-4c82-943a-999e5f300ffd'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:27.339080 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-95cac6e1-43ad-4c82-943a-999e5f300ffd admin admin] The token cache is being invalidate because project 91d729205d694c0eb8a3a792caab3a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:52:27.339404 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-95cac6e1-43ad-4c82-943a-999e5f300ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:27.340047 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-95cac6e1-43ad-4c82-943a-999e5f300ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:27.342191 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1339/2634] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:52:27 2022] DELETE /identity/v3/projects/91d729205d694c0eb8a3a792caab3a55 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:27.346305 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05646f03-b633-4712-829d-6c26addb6c1d service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:27.356786 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05646f03-b633-4712-829d-6c26addb6c1d service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:27.390691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:27.420698 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada2427-7260-49c8-b4d5-6472c2a333f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:27.421337 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada2427-7260-49c8-b4d5-6472c2a333f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:27.421662 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada2427-7260-49c8-b4d5-6472c2a333f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:27.421945 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada2427-7260-49c8-b4d5-6472c2a333f4 admin admin] PATH_INFO: `/v3/users/3e0c753810074caebf8a6954f71b6ff8` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:27.423283 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada2427-7260-49c8-b4d5-6472c2a333f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e0c753810074caebf8a6954f71b6ff8)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:27.425481 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada2427-7260-49c8-b4d5-6472c2a333f4 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:27.591773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5ada2427-7260-49c8-b4d5-6472c2a333f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e0c753810074caebf8a6954f71b6ff8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:27.592525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5ada2427-7260-49c8-b4d5-6472c2a333f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e0c753810074caebf8a6954f71b6ff8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:27.645853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5ada2427-7260-49c8-b4d5-6472c2a333f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e0c753810074caebf8a6954f71b6ff8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:27.660626 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5ada2427-7260-49c8-b4d5-6472c2a333f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e0c753810074caebf8a6954f71b6ff8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:27.660848 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5ada2427-7260-49c8-b4d5-6472c2a333f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e0c753810074caebf8a6954f71b6ff8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:27.673885 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1296/2635] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:52:27 2022] DELETE /identity/v3/users/3e0c753810074caebf8a6954f71b6ff8 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:28.165367 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cac6e1-43ad-4c82-943a-999e5f300ffd admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:28.166856 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-95cac6e1-43ad-4c82-943a-999e5f300ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:28.182374 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cac6e1-43ad-4c82-943a-999e5f300ffd admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:28.246094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a247d-42de-44a6-999f-c0b22cb10d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:28.246771 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a247d-42de-44a6-999f-c0b22cb10d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:28.247065 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a247d-42de-44a6-999f-c0b22cb10d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:28.247388 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a247d-42de-44a6-999f-c0b22cb10d60 admin admin] PATH_INFO: `/v3/projects/31518101badc464594e7a41d16905b86` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:28.248614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a247d-42de-44a6-999f-c0b22cb10d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31518101badc464594e7a41d16905b86)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:28.250575 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a247d-42de-44a6-999f-c0b22cb10d60 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:28.412768 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-bb9a247d-42de-44a6-999f-c0b22cb10d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31518101badc464594e7a41d16905b86', 'request_id': 'req-bb9a247d-42de-44a6-999f-c0b22cb10d60'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:28.418113 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-bb9a247d-42de-44a6-999f-c0b22cb10d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31518101badc464594e7a41d16905b86', 'request_id': 'req-bb9a247d-42de-44a6-999f-c0b22cb10d60'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:28.497318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-bb9a247d-42de-44a6-999f-c0b22cb10d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31518101badc464594e7a41d16905b86', 'request_id': 'req-bb9a247d-42de-44a6-999f-c0b22cb10d60'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:28.509435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-bb9a247d-42de-44a6-999f-c0b22cb10d60 admin admin] The token cache is being invalidate because project 31518101badc464594e7a41d16905b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:52:28.513104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-bb9a247d-42de-44a6-999f-c0b22cb10d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:28.513104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-bb9a247d-42de-44a6-999f-c0b22cb10d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:28.513104 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1340/2636] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:52:28 2022] DELETE /identity/v3/projects/31518101badc464594e7a41d16905b86 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:28.516155 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada2427-7260-49c8-b4d5-6472c2a333f4 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:28.517574 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5ada2427-7260-49c8-b4d5-6472c2a333f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:28.531007 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada2427-7260-49c8-b4d5-6472c2a333f4 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:28.588701 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa21c0d-754c-448f-bf3e-7a1c0bb3a6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:28.589350 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa21c0d-754c-448f-bf3e-7a1c0bb3a6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:28.589633 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa21c0d-754c-448f-bf3e-7a1c0bb3a6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:28.589909 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa21c0d-754c-448f-bf3e-7a1c0bb3a6c5 admin admin] PATH_INFO: `/v3/users/c34c8bac08a64f19968f0b3e444874b1` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:28.591064 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa21c0d-754c-448f-bf3e-7a1c0bb3a6c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34c8bac08a64f19968f0b3e444874b1)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:28.593645 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa21c0d-754c-448f-bf3e-7a1c0bb3a6c5 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:28.808483 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-bfa21c0d-754c-448f-bf3e-7a1c0bb3a6c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34c8bac08a64f19968f0b3e444874b1'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:28.809175 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-bfa21c0d-754c-448f-bf3e-7a1c0bb3a6c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34c8bac08a64f19968f0b3e444874b1'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:28.914324 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-bfa21c0d-754c-448f-bf3e-7a1c0bb3a6c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34c8bac08a64f19968f0b3e444874b1'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:28.915801 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:28.928113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-bfa21c0d-754c-448f-bf3e-7a1c0bb3a6c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34c8bac08a64f19968f0b3e444874b1'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:28.928804 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-bfa21c0d-754c-448f-bf3e-7a1c0bb3a6c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34c8bac08a64f19968f0b3e444874b1'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:28.946326 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1297/2637] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:52:28 2022] DELETE /identity/v3/users/c34c8bac08a64f19968f0b3e444874b1 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:29.345608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a247d-42de-44a6-999f-c0b22cb10d60 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:29.347123 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-bb9a247d-42de-44a6-999f-c0b22cb10d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:29.361777 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a247d-42de-44a6-999f-c0b22cb10d60 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:29.384494 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa21c0d-754c-448f-bf3e-7a1c0bb3a6c5 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:29.386541 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-bfa21c0d-754c-448f-bf3e-7a1c0bb3a6c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:29.427008 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca79a5-57e6-4584-95f5-c02c877879fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:29.427688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca79a5-57e6-4584-95f5-c02c877879fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:29.427971 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca79a5-57e6-4584-95f5-c02c877879fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:29.428246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca79a5-57e6-4584-95f5-c02c877879fe admin admin] PATH_INFO: `/v3/projects/e3718e573d264dd78603c565264ec075` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:29.429423 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca79a5-57e6-4584-95f5-c02c877879fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3718e573d264dd78603c565264ec075)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:29.431521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca79a5-57e6-4584-95f5-c02c877879fe admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:29.433952 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:29.461740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa21c0d-754c-448f-bf3e-7a1c0bb3a6c5 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:29.467516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14738598-c420-4ca3-b4b6-7842d062e011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:29.470598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14738598-c420-4ca3-b4b6-7842d062e011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:29.470598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14738598-c420-4ca3-b4b6-7842d062e011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:29.470598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14738598-c420-4ca3-b4b6-7842d062e011 admin admin] PATH_INFO: `/v3/users/20f200ce3eb14296bbc588f904db51db` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:29.470598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14738598-c420-4ca3-b4b6-7842d062e011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f200ce3eb14296bbc588f904db51db)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:29.471843 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14738598-c420-4ca3-b4b6-7842d062e011 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:29.547684 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-85ca79a5-57e6-4584-95f5-c02c877879fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3718e573d264dd78603c565264ec075', 'request_id': 'req-85ca79a5-57e6-4584-95f5-c02c877879fe'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:29.554997 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-85ca79a5-57e6-4584-95f5-c02c877879fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3718e573d264dd78603c565264ec075', 'request_id': 'req-85ca79a5-57e6-4584-95f5-c02c877879fe'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:29.621072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-85ca79a5-57e6-4584-95f5-c02c877879fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3718e573d264dd78603c565264ec075', 'request_id': 'req-85ca79a5-57e6-4584-95f5-c02c877879fe'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:29.633048 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-85ca79a5-57e6-4584-95f5-c02c877879fe admin admin] The token cache is being invalidate because project e3718e573d264dd78603c565264ec075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:52:29.633342 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-85ca79a5-57e6-4584-95f5-c02c877879fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:29.633995 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-85ca79a5-57e6-4584-95f5-c02c877879fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:29.635575 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1341/2638] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:52:29 2022] DELETE /identity/v3/projects/e3718e573d264dd78603c565264ec075 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:29.642103 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbbae3-394f-4e17-9d9b-de1bcf84d034 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:29.642390 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbbae3-394f-4e17-9d9b-de1bcf84d034 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:29.642665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbbae3-394f-4e17-9d9b-de1bcf84d034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:29.662734 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-ddbbbae3-394f-4e17-9d9b-de1bcf84d034 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:29.664049 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ddbbbae3-394f-4e17-9d9b-de1bcf84d034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:29.706457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-14738598-c420-4ca3-b4b6-7842d062e011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f200ce3eb14296bbc588f904db51db'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:29.707398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-14738598-c420-4ca3-b4b6-7842d062e011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f200ce3eb14296bbc588f904db51db'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:29.728263 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1342/2639] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:52:29.737154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74573a54-a29d-4bce-b3e3-5c1bd684cf29 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:29.737382 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74573a54-a29d-4bce-b3e3-5c1bd684cf29 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:29.737667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74573a54-a29d-4bce-b3e3-5c1bd684cf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:29.758748 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-74573a54-a29d-4bce-b3e3-5c1bd684cf29 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:29.759992 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-74573a54-a29d-4bce-b3e3-5c1bd684cf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:29.768888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1343/2640] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:52:29.773117 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74573a54-a29d-4bce-b3e3-5c1bd684cf29 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:29.782622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74573a54-a29d-4bce-b3e3-5c1bd684cf29 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:29.787369 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d36e8-ed23-4a69-92f8-6053ccd50bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:29.787996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d36e8-ed23-4a69-92f8-6053ccd50bdc admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:29.788280 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d36e8-ed23-4a69-92f8-6053ccd50bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:29.788558 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d36e8-ed23-4a69-92f8-6053ccd50bdc admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:29.792307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-14738598-c420-4ca3-b4b6-7842d062e011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f200ce3eb14296bbc588f904db51db'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:29.792443 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d36e8-ed23-4a69-92f8-6053ccd50bdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:29.792443 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d36e8-ed23-4a69-92f8-6053ccd50bdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:29.792443 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d36e8-ed23-4a69-92f8-6053ccd50bdc admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:29.802601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-14738598-c420-4ca3-b4b6-7842d062e011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f200ce3eb14296bbc588f904db51db'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:29.803357 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-14738598-c420-4ca3-b4b6-7842d062e011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f200ce3eb14296bbc588f904db51db'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:29.807306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1344/2641] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:52:29.808249 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d36e8-ed23-4a69-92f8-6053ccd50bdc admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:29.810472 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-242d36e8-ed23-4a69-92f8-6053ccd50bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:29.819799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1298/2642] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:52:29 2022] DELETE /identity/v3/users/20f200ce3eb14296bbc588f904db51db => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:52:29.826914 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d36e8-ed23-4a69-92f8-6053ccd50bdc admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:29.830187 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30686a2c-f9db-4f9a-b5ed-79793757b4a1 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:29.830476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30686a2c-f9db-4f9a-b5ed-79793757b4a1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:29.830758 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30686a2c-f9db-4f9a-b5ed-79793757b4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:29.850452 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-30686a2c-f9db-4f9a-b5ed-79793757b4a1 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:29.851784 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-30686a2c-f9db-4f9a-b5ed-79793757b4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:29.884833 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2d1fe-6f43-49f6-b31a-040c7306a687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:29.885472 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2d1fe-6f43-49f6-b31a-040c7306a687 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:29.885871 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2d1fe-6f43-49f6-b31a-040c7306a687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:29.886211 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2d1fe-6f43-49f6-b31a-040c7306a687 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:29.886798 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2d1fe-6f43-49f6-b31a-040c7306a687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:29.889695 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2d1fe-6f43-49f6-b31a-040c7306a687 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:29.904433 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:29.920029 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1299/2643] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:52:29.929940 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30686a2c-f9db-4f9a-b5ed-79793757b4a1 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:29.931284 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-30686a2c-f9db-4f9a-b5ed-79793757b4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:29.985686 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1345/2644] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:52:29 2022] POST /identity/v3/projects => generated 407 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:52:29.989226 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:29.991334 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2d1fe-6f43-49f6-b31a-040c7306a687 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:30.000059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30686a2c-f9db-4f9a-b5ed-79793757b4a1 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:30.054664 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b78698-0ebf-45e6-9839-231cf78da8e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:30.055536 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b78698-0ebf-45e6-9839-231cf78da8e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:30.055917 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b78698-0ebf-45e6-9839-231cf78da8e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:30.056389 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b78698-0ebf-45e6-9839-231cf78da8e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:30.061538 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2d1fe-6f43-49f6-b31a-040c7306a687 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:30.067758 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b78698-0ebf-45e6-9839-231cf78da8e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:30.067926 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63b7d7-df6a-4a7c-abea-d9065acfb3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:30.068165 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63b7d7-df6a-4a7c-abea-d9065acfb3fc admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:30.068452 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63b7d7-df6a-4a7c-abea-d9065acfb3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:30.068720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63b7d7-df6a-4a7c-abea-d9065acfb3fc admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:30.069021 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b78698-0ebf-45e6-9839-231cf78da8e1 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:30.069389 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63b7d7-df6a-4a7c-abea-d9065acfb3fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:30.071616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63b7d7-df6a-4a7c-abea-d9065acfb3fc admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:30.080490 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1300/2645] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:52:30.172323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1346/2646] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:52:29 2022] POST /identity/v3/users => generated 304 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:30.176614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b78698-0ebf-45e6-9839-231cf78da8e1 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:30.189335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b78698-0ebf-45e6-9839-231cf78da8e1 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:30.194637 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201b9c1-94d8-4731-9491-a8da18b8849c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:30.195387 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201b9c1-94d8-4731-9491-a8da18b8849c admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:30.195789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201b9c1-94d8-4731-9491-a8da18b8849c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:30.196165 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201b9c1-94d8-4731-9491-a8da18b8849c admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:30.197065 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201b9c1-94d8-4731-9491-a8da18b8849c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:30.198692 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201b9c1-94d8-4731-9491-a8da18b8849c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:30.210093 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1301/2647] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:30.214355 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63b7d7-df6a-4a7c-abea-d9065acfb3fc admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:30.225600 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63b7d7-df6a-4a7c-abea-d9065acfb3fc admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:30.230962 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c06b65-ef6b-414f-a421-634fabc09d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:30.233376 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c06b65-ef6b-414f-a421-634fabc09d7a admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:30.233376 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c06b65-ef6b-414f-a421-634fabc09d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:30.233376 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c06b65-ef6b-414f-a421-634fabc09d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:30.233376 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c06b65-ef6b-414f-a421-634fabc09d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:30.234606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c06b65-ef6b-414f-a421-634fabc09d7a admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:30.245443 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1347/2648] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:30.249444 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201b9c1-94d8-4731-9491-a8da18b8849c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:30.259745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201b9c1-94d8-4731-9491-a8da18b8849c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:30.265354 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65076744-f592-4774-bc10-8655bab77b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:30.266031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65076744-f592-4774-bc10-8655bab77b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:30.266304 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65076744-f592-4774-bc10-8655bab77b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:30.266578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65076744-f592-4774-bc10-8655bab77b89 admin admin] PATH_INFO: `/v3/projects/5f1fa847809a46e893680b0d4a601fca/users/70991879c6ed4764baa6303517f6bed2/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:30.282709 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65076744-f592-4774-bc10-8655bab77b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1fa847809a46e893680b0d4a601fca, user_id=70991879c6ed4764baa6303517f6bed2, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:30.285437 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65076744-f592-4774-bc10-8655bab77b89 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:30.381875 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1302/2649] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:30 2022] PUT /identity/v3/projects/5f1fa847809a46e893680b0d4a601fca/users/70991879c6ed4764baa6303517f6bed2/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:30.455660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc4076-d2b7-4ef9-ad01-fcb7ec1fe3ed None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:30.456216 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc4076-d2b7-4ef9-ad01-fcb7ec1fe3ed None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:30.456216 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc4076-d2b7-4ef9-ad01-fcb7ec1fe3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:30.487573 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-a1fc4076-d2b7-4ef9-ad01-fcb7ec1fe3ed None None] MFA Rules not processed for user `70991879c6ed4764baa6303517f6bed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:30.488821 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a1fc4076-d2b7-4ef9-ad01-fcb7ec1fe3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:30.556060 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1348/2650] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:30 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:30.561111 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65076744-f592-4774-bc10-8655bab77b89 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:30.566750 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc4076-d2b7-4ef9-ad01-fcb7ec1fe3ed None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:30.568354 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a1fc4076-d2b7-4ef9-ad01-fcb7ec1fe3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:30.631917 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65076744-f592-4774-bc10-8655bab77b89 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:30.636829 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaeadb0-ad7f-426e-ba74-60070e096d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:30.637454 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaeadb0-ad7f-426e-ba74-60070e096d94 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:30.637737 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaeadb0-ad7f-426e-ba74-60070e096d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:30.638011 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaeadb0-ad7f-426e-ba74-60070e096d94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:30.639457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaeadb0-ad7f-426e-ba74-60070e096d94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:30.641383 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaeadb0-ad7f-426e-ba74-60070e096d94 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:30.641638 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc4076-d2b7-4ef9-ad01-fcb7ec1fe3ed None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:30.646285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca52b4-9268-4214-a357-719ab85a97d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:30.646968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca52b4-9268-4214-a357-719ab85a97d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:30.647255 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca52b4-9268-4214-a357-719ab85a97d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:30.647563 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca52b4-9268-4214-a357-719ab85a97d9 admin admin] PATH_INFO: `/v3/projects/ff5c1f8bd9924bcca4ad2b8086332b11` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:30.648752 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca52b4-9268-4214-a357-719ab85a97d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff5c1f8bd9924bcca4ad2b8086332b11)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:30.650711 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca52b4-9268-4214-a357-719ab85a97d9 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:30.659468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:30.755617 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:30.761947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1303/2651] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:52:30 2022] POST /identity/v3/projects => generated 409 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:52:30.766962 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaeadb0-ad7f-426e-ba74-60070e096d94 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:30.788411 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c4ca52b4-9268-4214-a357-719ab85a97d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff5c1f8bd9924bcca4ad2b8086332b11', 'request_id': 'req-c4ca52b4-9268-4214-a357-719ab85a97d9'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:30.794901 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c4ca52b4-9268-4214-a357-719ab85a97d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff5c1f8bd9924bcca4ad2b8086332b11', 'request_id': 'req-c4ca52b4-9268-4214-a357-719ab85a97d9'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:30.830597 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaeadb0-ad7f-426e-ba74-60070e096d94 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:30.868753 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c4ca52b4-9268-4214-a357-719ab85a97d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff5c1f8bd9924bcca4ad2b8086332b11', 'request_id': 'req-c4ca52b4-9268-4214-a357-719ab85a97d9'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:30.889198 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b5707-054f-41e6-8283-b1a59087878c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:30.889831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b5707-054f-41e6-8283-b1a59087878c admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:30.890123 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b5707-054f-41e6-8283-b1a59087878c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:30.890402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b5707-054f-41e6-8283-b1a59087878c admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:30.890622 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c4ca52b4-9268-4214-a357-719ab85a97d9 admin admin] The token cache is being invalidate because project ff5c1f8bd9924bcca4ad2b8086332b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:52:30.890969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c4ca52b4-9268-4214-a357-719ab85a97d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:30.891086 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b5707-054f-41e6-8283-b1a59087878c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:30.893037 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b5707-054f-41e6-8283-b1a59087878c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:30.895122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c4ca52b4-9268-4214-a357-719ab85a97d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:30.900165 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1349/2652] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:52:30 2022] DELETE /identity/v3/projects/ff5c1f8bd9924bcca4ad2b8086332b11 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:52:30.904700 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca52b4-9268-4214-a357-719ab85a97d9 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:30.906111 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c4ca52b4-9268-4214-a357-719ab85a97d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:30.919159 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca52b4-9268-4214-a357-719ab85a97d9 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:30.924703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b64a8-7b7d-48d1-9ddd-bf6b5cf27aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:30.925345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b64a8-7b7d-48d1-9ddd-bf6b5cf27aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:30.925633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b64a8-7b7d-48d1-9ddd-bf6b5cf27aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:30.925941 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b64a8-7b7d-48d1-9ddd-bf6b5cf27aa5 admin admin] PATH_INFO: `/v3/users/88d3518f56ba43289b74a8a835ae3f56` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:30.927125 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b64a8-7b7d-48d1-9ddd-bf6b5cf27aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88d3518f56ba43289b74a8a835ae3f56)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:30.929097 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b64a8-7b7d-48d1-9ddd-bf6b5cf27aa5 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:30.972895 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1304/2653] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:52:30 2022] POST /identity/v3/users => generated 311 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:52:30.976854 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b5707-054f-41e6-8283-b1a59087878c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:30.978498 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-a75b5707-054f-41e6-8283-b1a59087878c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:30.991049 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b5707-054f-41e6-8283-b1a59087878c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:30.995997 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e99b61-747b-4247-b744-f8a2aac68707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:30.996642 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e99b61-747b-4247-b744-f8a2aac68707 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:30.996926 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e99b61-747b-4247-b744-f8a2aac68707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:30.997203 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e99b61-747b-4247-b744-f8a2aac68707 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:30.998553 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e99b61-747b-4247-b744-f8a2aac68707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:31.000216 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e99b61-747b-4247-b744-f8a2aac68707 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:31.010442 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1305/2654] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:52:31.014732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e99b61-747b-4247-b744-f8a2aac68707 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:31.024934 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e99b61-747b-4247-b744-f8a2aac68707 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:31.029845 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad2a5c-beb3-420e-98e0-4c99970055cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:31.030496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad2a5c-beb3-420e-98e0-4c99970055cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:31.030781 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad2a5c-beb3-420e-98e0-4c99970055cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:31.031059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad2a5c-beb3-420e-98e0-4c99970055cb admin admin] PATH_INFO: `/v3/projects/171411e7346e4e0c935c1b11f037b34a/users/85064eeb241b42d9901d7877ed1b4705/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:31.046610 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad2a5c-beb3-420e-98e0-4c99970055cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=171411e7346e4e0c935c1b11f037b34a, user_id=85064eeb241b42d9901d7877ed1b4705, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:31.049385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad2a5c-beb3-420e-98e0-4c99970055cb admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:31.128545 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0f2b64a8-7b7d-48d1-9ddd-bf6b5cf27aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88d3518f56ba43289b74a8a835ae3f56'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:31.129189 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0f2b64a8-7b7d-48d1-9ddd-bf6b5cf27aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88d3518f56ba43289b74a8a835ae3f56'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:31.162438 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1306/2655] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:31 2022] PUT /identity/v3/projects/171411e7346e4e0c935c1b11f037b34a/users/85064eeb241b42d9901d7877ed1b4705/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:52:31.166520 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad2a5c-beb3-420e-98e0-4c99970055cb admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:31.218087 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0f2b64a8-7b7d-48d1-9ddd-bf6b5cf27aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88d3518f56ba43289b74a8a835ae3f56'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:31.236176 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0f2b64a8-7b7d-48d1-9ddd-bf6b5cf27aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88d3518f56ba43289b74a8a835ae3f56'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:31.236614 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad2a5c-beb3-420e-98e0-4c99970055cb admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:31.248180 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69cfe11-3644-46a9-a233-a114454bdc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:31.250675 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cfe11-3644-46a9-a233-a114454bdc59 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:31.250781 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0f2b64a8-7b7d-48d1-9ddd-bf6b5cf27aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88d3518f56ba43289b74a8a835ae3f56'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:31.250870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cfe11-3644-46a9-a233-a114454bdc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:31.250870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cfe11-3644-46a9-a233-a114454bdc59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:31.250870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69cfe11-3644-46a9-a233-a114454bdc59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:31.251802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69cfe11-3644-46a9-a233-a114454bdc59 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:31.254778 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:31.266463 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1307/2657] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:52:31.270079 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69cfe11-3644-46a9-a233-a114454bdc59 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:31.270701 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1350/2657] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:52:30 2022] DELETE /identity/v3/users/88d3518f56ba43289b74a8a835ae3f56 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:52:31.272098 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e69cfe11-3644-46a9-a233-a114454bdc59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:31.286694 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69cfe11-3644-46a9-a233-a114454bdc59 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:31.352450 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9eff5-d6e4-4f7b-a633-d5f38f056e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:31.353583 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9eff5-d6e4-4f7b-a633-d5f38f056e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:31.353978 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9eff5-d6e4-4f7b-a633-d5f38f056e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:31.354363 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9eff5-d6e4-4f7b-a633-d5f38f056e08 admin admin] PATH_INFO: `/v3/projects/171411e7346e4e0c935c1b11f037b34a/users/85064eeb241b42d9901d7877ed1b4705/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:31.356872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9eff5-d6e4-4f7b-a633-d5f38f056e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=171411e7346e4e0c935c1b11f037b34a, user_id=85064eeb241b42d9901d7877ed1b4705, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:31.359960 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9eff5-d6e4-4f7b-a633-d5f38f056e08 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:31.371685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1308/2658] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:31 2022] PUT /identity/v3/projects/171411e7346e4e0c935c1b11f037b34a/users/85064eeb241b42d9901d7877ed1b4705/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:31.382488 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fab81-3415-472b-a1ba-6d196f8b5ee2 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:31.382839 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fab81-3415-472b-a1ba-6d196f8b5ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:31.383145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fab81-3415-472b-a1ba-6d196f8b5ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:31.412833 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-7f8fab81-3415-472b-a1ba-6d196f8b5ee2 None None] MFA Rules not processed for user `85064eeb241b42d9901d7877ed1b4705`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:31.414044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-7f8fab81-3415-472b-a1ba-6d196f8b5ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:31.475771 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:31.487863 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1351/2659] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:31 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:31.501410 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9eff5-d6e4-4f7b-a633-d5f38f056e08 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:31.503171 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-1ce9eff5-d6e4-4f7b-a633-d5f38f056e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:31.574562 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9eff5-d6e4-4f7b-a633-d5f38f056e08 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:31.579164 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ede6c3-a996-4bca-9339-e0ab374930a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:31.579852 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ede6c3-a996-4bca-9339-e0ab374930a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:31.580154 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ede6c3-a996-4bca-9339-e0ab374930a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:31.580413 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ede6c3-a996-4bca-9339-e0ab374930a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:31.589815 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ede6c3-a996-4bca-9339-e0ab374930a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:31.591482 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ede6c3-a996-4bca-9339-e0ab374930a8 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:31.601901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1309/2660] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:31 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:31.689319 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fab81-3415-472b-a1ba-6d196f8b5ee2 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:31.691732 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-7f8fab81-3415-472b-a1ba-6d196f8b5ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:31.781334 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fab81-3415-472b-a1ba-6d196f8b5ee2 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:31.786338 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747796f8-71e0-4be9-8117-c1b4384d6b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:31.786982 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747796f8-71e0-4be9-8117-c1b4384d6b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:31.787301 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747796f8-71e0-4be9-8117-c1b4384d6b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:31.792483 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747796f8-71e0-4be9-8117-c1b4384d6b9c admin admin] PATH_INFO: `/v3/projects/e1231ebc538940bda5ec3de3e91d8d28` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:31.792483 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747796f8-71e0-4be9-8117-c1b4384d6b9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1231ebc538940bda5ec3de3e91d8d28)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:31.792483 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747796f8-71e0-4be9-8117-c1b4384d6b9c admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:31.944837 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-747796f8-71e0-4be9-8117-c1b4384d6b9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1231ebc538940bda5ec3de3e91d8d28', 'request_id': 'req-747796f8-71e0-4be9-8117-c1b4384d6b9c'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:31.950564 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-747796f8-71e0-4be9-8117-c1b4384d6b9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1231ebc538940bda5ec3de3e91d8d28', 'request_id': 'req-747796f8-71e0-4be9-8117-c1b4384d6b9c'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:32.050415 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-747796f8-71e0-4be9-8117-c1b4384d6b9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1231ebc538940bda5ec3de3e91d8d28', 'request_id': 'req-747796f8-71e0-4be9-8117-c1b4384d6b9c'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:32.056476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ede6c3-a996-4bca-9339-e0ab374930a8 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:32.062922 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-747796f8-71e0-4be9-8117-c1b4384d6b9c admin admin] The token cache is being invalidate because project e1231ebc538940bda5ec3de3e91d8d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:52:32.063208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-747796f8-71e0-4be9-8117-c1b4384d6b9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:32.063913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-747796f8-71e0-4be9-8117-c1b4384d6b9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:32.067334 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1352/2661] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:52:31 2022] DELETE /identity/v3/projects/e1231ebc538940bda5ec3de3e91d8d28 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:32.073785 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ede6c3-a996-4bca-9339-e0ab374930a8 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:32.073990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c487370-6e36-49d6-875b-d8c7a0a9dded None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:32.073990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c487370-6e36-49d6-875b-d8c7a0a9dded None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:32.074167 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c487370-6e36-49d6-875b-d8c7a0a9dded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:32.098089 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-3c487370-6e36-49d6-875b-d8c7a0a9dded None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:32.099483 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-3c487370-6e36-49d6-875b-d8c7a0a9dded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:32.137110 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62355b0d-bc1a-4f27-b022-c44f17fe8789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:32.137874 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62355b0d-bc1a-4f27-b022-c44f17fe8789 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:32.138400 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62355b0d-bc1a-4f27-b022-c44f17fe8789 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:32.138774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62355b0d-bc1a-4f27-b022-c44f17fe8789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:32.140726 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-62355b0d-bc1a-4f27-b022-c44f17fe8789 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:32.177142 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1353/2662] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:52:32.181100 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864e960-066d-43cc-8910-8b4f2bd5191d None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:32.181646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864e960-066d-43cc-8910-8b4f2bd5191d None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:32.182165 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864e960-066d-43cc-8910-8b4f2bd5191d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:32.195246 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:32.206493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-9864e960-066d-43cc-8910-8b4f2bd5191d None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:32.207761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-9864e960-066d-43cc-8910-8b4f2bd5191d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:32.211199 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62355b0d-bc1a-4f27-b022-c44f17fe8789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:32.212735 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62355b0d-bc1a-4f27-b022-c44f17fe8789 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:32.217264 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1354/2663] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:32.221921 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864e960-066d-43cc-8910-8b4f2bd5191d None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:32.224944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1310/2664] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:32 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:52:32.231784 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864e960-066d-43cc-8910-8b4f2bd5191d None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:32.237140 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81385a11-76db-41c2-b3bf-5aa2c108a090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:32.238163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81385a11-76db-41c2-b3bf-5aa2c108a090 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:32.238163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81385a11-76db-41c2-b3bf-5aa2c108a090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:32.238449 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81385a11-76db-41c2-b3bf-5aa2c108a090 admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:32.239069 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81385a11-76db-41c2-b3bf-5aa2c108a090 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:32.239559 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81385a11-76db-41c2-b3bf-5aa2c108a090 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:32.241541 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81385a11-76db-41c2-b3bf-5aa2c108a090 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:32.258769 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1355/2665] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:32.260084 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62355b0d-bc1a-4f27-b022-c44f17fe8789 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:32.273260 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62355b0d-bc1a-4f27-b022-c44f17fe8789 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:32.279535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5e70e-7253-46b3-9d94-4914dc7919ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:32.280345 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5e70e-7253-46b3-9d94-4914dc7919ff admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:32.280692 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5e70e-7253-46b3-9d94-4914dc7919ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:32.281066 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5e70e-7253-46b3-9d94-4914dc7919ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:32.282041 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5e70e-7253-46b3-9d94-4914dc7919ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:32.283851 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5e70e-7253-46b3-9d94-4914dc7919ff admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:32.406448 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1311/2666] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:52:32 2022] POST /identity/v3/projects => generated 393 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:52:32.407930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81385a11-76db-41c2-b3bf-5aa2c108a090 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:32.414978 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:32.421980 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81385a11-76db-41c2-b3bf-5aa2c108a090 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:32.497038 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec64e5-20c9-4d96-a0bf-268a9b7c69b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:32.498522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec64e5-20c9-4d96-a0bf-268a9b7c69b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:32.498624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec64e5-20c9-4d96-a0bf-268a9b7c69b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:32.499016 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec64e5-20c9-4d96-a0bf-268a9b7c69b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:32.499866 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec64e5-20c9-4d96-a0bf-268a9b7c69b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:32.502174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec64e5-20c9-4d96-a0bf-268a9b7c69b1 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:32.594746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1356/2667] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:52:32 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:32.599284 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5e70e-7253-46b3-9d94-4914dc7919ff admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:32.610825 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5e70e-7253-46b3-9d94-4914dc7919ff admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:32.615766 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccd685-66bd-4816-9869-c29d4a2ab343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:32.616378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccd685-66bd-4816-9869-c29d4a2ab343 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:32.616653 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccd685-66bd-4816-9869-c29d4a2ab343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:32.616922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccd685-66bd-4816-9869-c29d4a2ab343 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:32.617635 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccd685-66bd-4816-9869-c29d4a2ab343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:32.619224 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccd685-66bd-4816-9869-c29d4a2ab343 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:32.630857 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1312/2668] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:52:32.634850 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec64e5-20c9-4d96-a0bf-268a9b7c69b1 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:32.644828 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec64e5-20c9-4d96-a0bf-268a9b7c69b1 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:32.649934 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918fdb9-57c8-4b3c-80b7-0c100b404be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:32.650584 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918fdb9-57c8-4b3c-80b7-0c100b404be7 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:32.650970 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918fdb9-57c8-4b3c-80b7-0c100b404be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:32.651183 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918fdb9-57c8-4b3c-80b7-0c100b404be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:32.651921 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918fdb9-57c8-4b3c-80b7-0c100b404be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:32.654517 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918fdb9-57c8-4b3c-80b7-0c100b404be7 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:32.668872 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1357/2669] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:32.670924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccd685-66bd-4816-9869-c29d4a2ab343 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:32.683239 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccd685-66bd-4816-9869-c29d4a2ab343 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:32.689970 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f5ee1-5573-416b-ae1e-1961051f2387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:32.689970 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f5ee1-5573-416b-ae1e-1961051f2387 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:32.689970 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f5ee1-5573-416b-ae1e-1961051f2387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:32.689970 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f5ee1-5573-416b-ae1e-1961051f2387 admin admin] PATH_INFO: `/v3/projects/0cf96e31c83e40d0be3049d57889a064/users/385eaec8458b48cdad14b2d1cf5bfe8d/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:32.719474 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f5ee1-5573-416b-ae1e-1961051f2387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf96e31c83e40d0be3049d57889a064, user_id=385eaec8458b48cdad14b2d1cf5bfe8d, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:32.724092 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f5ee1-5573-416b-ae1e-1961051f2387 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:32.854144 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1313/2670] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:32 2022] PUT /identity/v3/projects/0cf96e31c83e40d0be3049d57889a064/users/385eaec8458b48cdad14b2d1cf5bfe8d/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:32.866361 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c809db7-d54e-4524-99f9-fef1d3c0e7bc None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:32.866877 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c809db7-d54e-4524-99f9-fef1d3c0e7bc None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:32.867396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c809db7-d54e-4524-99f9-fef1d3c0e7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:32.909844 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-5c809db7-d54e-4524-99f9-fef1d3c0e7bc None None] MFA Rules not processed for user `385eaec8458b48cdad14b2d1cf5bfe8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:32.911631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5c809db7-d54e-4524-99f9-fef1d3c0e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:32.985915 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1358/2671] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:32.990409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f5ee1-5573-416b-ae1e-1961051f2387 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:33.076929 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f5ee1-5573-416b-ae1e-1961051f2387 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:33.082292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a877112-8612-466a-9937-137aab9275b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:33.082946 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a877112-8612-466a-9937-137aab9275b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:33.083231 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a877112-8612-466a-9937-137aab9275b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:33.083539 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a877112-8612-466a-9937-137aab9275b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:33.084267 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a877112-8612-466a-9937-137aab9275b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:33.086204 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a877112-8612-466a-9937-137aab9275b4 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:33.211781 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1314/2672] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:52:32 2022] POST /identity/v3/projects => generated 393 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:33.212969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c809db7-d54e-4524-99f9-fef1d3c0e7bc None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:33.225120 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c809db7-d54e-4524-99f9-fef1d3c0e7bc None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:33.286388 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53412af-8379-4602-a217-6aec08227345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:33.287024 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53412af-8379-4602-a217-6aec08227345 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:33.287336 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53412af-8379-4602-a217-6aec08227345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:33.287617 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53412af-8379-4602-a217-6aec08227345 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:33.288291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53412af-8379-4602-a217-6aec08227345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:33.290238 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53412af-8379-4602-a217-6aec08227345 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:33.411737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1359/2673] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:52:33 2022] POST /identity/v3/users => generated 303 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:33.415828 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a877112-8612-466a-9937-137aab9275b4 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:33.426817 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a877112-8612-466a-9937-137aab9275b4 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:33.431989 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becfacd4-c047-478c-8e15-818f310bba5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:33.432618 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfacd4-c047-478c-8e15-818f310bba5e admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:33.432908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfacd4-c047-478c-8e15-818f310bba5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:33.433374 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfacd4-c047-478c-8e15-818f310bba5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:33.434104 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becfacd4-c047-478c-8e15-818f310bba5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:33.436319 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becfacd4-c047-478c-8e15-818f310bba5e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:33.448224 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1315/2674] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:33.453780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53412af-8379-4602-a217-6aec08227345 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:33.459120 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:33.464845 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53412af-8379-4602-a217-6aec08227345 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:33.471528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55e9ea-8737-4b51-95e2-2362e2aa1a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:33.472578 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55e9ea-8737-4b51-95e2-2362e2aa1a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:33.472858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55e9ea-8737-4b51-95e2-2362e2aa1a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:33.473139 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55e9ea-8737-4b51-95e2-2362e2aa1a9f admin admin] PATH_INFO: `/v3/projects/89c6d3410d7d47188c171584c0965e5d/users/1b495e7c589d423eb683171852c056d4/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:33.492582 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55e9ea-8737-4b51-95e2-2362e2aa1a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=89c6d3410d7d47188c171584c0965e5d, user_id=1b495e7c589d423eb683171852c056d4, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:33.495723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55e9ea-8737-4b51-95e2-2362e2aa1a9f admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:33.571939 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1360/2675] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:33 2022] PUT /identity/v3/projects/89c6d3410d7d47188c171584c0965e5d/users/1b495e7c589d423eb683171852c056d4/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:33.577235 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becfacd4-c047-478c-8e15-818f310bba5e admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:33.588000 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becfacd4-c047-478c-8e15-818f310bba5e admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:33.664685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf259ed-e5f3-449d-8451-256210ac5382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:33.665502 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf259ed-e5f3-449d-8451-256210ac5382 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:33.665887 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf259ed-e5f3-449d-8451-256210ac5382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:33.666265 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf259ed-e5f3-449d-8451-256210ac5382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:33.667104 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf259ed-e5f3-449d-8451-256210ac5382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:33.668877 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf259ed-e5f3-449d-8451-256210ac5382 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:33.681672 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1316/2676] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:52:33.684548 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55e9ea-8737-4b51-95e2-2362e2aa1a9f admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:33.696375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55e9ea-8737-4b51-95e2-2362e2aa1a9f admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:33.706822 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea06cb-eee1-4740-a32a-de92693b3222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:33.707606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea06cb-eee1-4740-a32a-de92693b3222 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:33.707896 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea06cb-eee1-4740-a32a-de92693b3222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:33.708674 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea06cb-eee1-4740-a32a-de92693b3222 admin admin] PATH_INFO: `/v3/projects/89c6d3410d7d47188c171584c0965e5d/users/1b495e7c589d423eb683171852c056d4/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:33.716830 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea06cb-eee1-4740-a32a-de92693b3222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89c6d3410d7d47188c171584c0965e5d, user_id=1b495e7c589d423eb683171852c056d4, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:33.719852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea06cb-eee1-4740-a32a-de92693b3222 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:33.744815 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1361/2677] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:33 2022] PUT /identity/v3/projects/89c6d3410d7d47188c171584c0965e5d/users/1b495e7c589d423eb683171852c056d4/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:33.745300 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a42a24-1eb1-495b-9a2c-7068d442ef03 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:33.745846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a42a24-1eb1-495b-9a2c-7068d442ef03 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:33.746267 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a42a24-1eb1-495b-9a2c-7068d442ef03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:33.754051 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:33.780401 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-e7a42a24-1eb1-495b-9a2c-7068d442ef03 None None] MFA Rules not processed for user `1b495e7c589d423eb683171852c056d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:33.781846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e7a42a24-1eb1-495b-9a2c-7068d442ef03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:33.854960 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1317/2678] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:33.866346 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea06cb-eee1-4740-a32a-de92693b3222 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:33.868097 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b1ea06cb-eee1-4740-a32a-de92693b3222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:33.932151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea06cb-eee1-4740-a32a-de92693b3222 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:33.935897 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87b3c2-9f2d-4089-9106-ad3288fd2b22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:33.936542 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87b3c2-9f2d-4089-9106-ad3288fd2b22 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:33.937151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87b3c2-9f2d-4089-9106-ad3288fd2b22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:33.937362 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87b3c2-9f2d-4089-9106-ad3288fd2b22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:33.947701 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87b3c2-9f2d-4089-9106-ad3288fd2b22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:33.949150 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87b3c2-9f2d-4089-9106-ad3288fd2b22 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:33.959734 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1362/2679] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:34.010958 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a42a24-1eb1-495b-9a2c-7068d442ef03 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:34.012374 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e7a42a24-1eb1-495b-9a2c-7068d442ef03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:34.025242 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a42a24-1eb1-495b-9a2c-7068d442ef03 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:34.029641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fc707-2a07-4c1d-b647-5c34ed0b732c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:34.030260 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fc707-2a07-4c1d-b647-5c34ed0b732c service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:34.030538 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fc707-2a07-4c1d-b647-5c34ed0b732c service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:34.030813 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fc707-2a07-4c1d-b647-5c34ed0b732c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:34.087870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fc707-2a07-4c1d-b647-5c34ed0b732c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:34.089440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fc707-2a07-4c1d-b647-5c34ed0b732c service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:34.100457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1318/2680] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:39.123949 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87b3c2-9f2d-4089-9106-ad3288fd2b22 service cinder] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:39.196450 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87b3c2-9f2d-4089-9106-ad3288fd2b22 service cinder] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:39.201730 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd300a-93b4-4015-aa75-ec565cfb6c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:39.202589 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd300a-93b4-4015-aa75-ec565cfb6c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:39.202875 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd300a-93b4-4015-aa75-ec565cfb6c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:39.203191 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd300a-93b4-4015-aa75-ec565cfb6c13 admin admin] PATH_INFO: `/v3/users/385eaec8458b48cdad14b2d1cf5bfe8d` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:39.207189 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd300a-93b4-4015-aa75-ec565cfb6c13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=385eaec8458b48cdad14b2d1cf5bfe8d)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:39.209109 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd300a-93b4-4015-aa75-ec565cfb6c13 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:39.426050 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-98bd300a-93b4-4015-aa75-ec565cfb6c13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '385eaec8458b48cdad14b2d1cf5bfe8d'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:39.426707 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-98bd300a-93b4-4015-aa75-ec565cfb6c13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '385eaec8458b48cdad14b2d1cf5bfe8d'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:39.512894 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-98bd300a-93b4-4015-aa75-ec565cfb6c13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '385eaec8458b48cdad14b2d1cf5bfe8d'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:39.525569 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:39.526783 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-98bd300a-93b4-4015-aa75-ec565cfb6c13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '385eaec8458b48cdad14b2d1cf5bfe8d'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:39.533828 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-98bd300a-93b4-4015-aa75-ec565cfb6c13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '385eaec8458b48cdad14b2d1cf5bfe8d'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:39.539995 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1363/2681] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:52:39 2022] DELETE /identity/v3/users/385eaec8458b48cdad14b2d1cf5bfe8d => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:39.544940 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7403f1-f045-48ba-a8d3-287abbb1c31d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:39.545475 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7403f1-f045-48ba-a8d3-287abbb1c31d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:39.545600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7403f1-f045-48ba-a8d3-287abbb1c31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:39.565367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-cf7403f1-f045-48ba-a8d3-287abbb1c31d None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:39.566593 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cf7403f1-f045-48ba-a8d3-287abbb1c31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:39.626274 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1319/2682] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:39.636207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd300a-93b4-4015-aa75-ec565cfb6c13 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:39.637718 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-98bd300a-93b4-4015-aa75-ec565cfb6c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:39.707975 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd300a-93b4-4015-aa75-ec565cfb6c13 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:39.711671 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10a703-d3f2-4dc5-bf84-a309cdff05b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:39.712291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10a703-d3f2-4dc5-bf84-a309cdff05b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:39.712594 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10a703-d3f2-4dc5-bf84-a309cdff05b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:39.712983 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10a703-d3f2-4dc5-bf84-a309cdff05b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:39.725145 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10a703-d3f2-4dc5-bf84-a309cdff05b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:39.726609 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10a703-d3f2-4dc5-bf84-a309cdff05b9 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:39.741012 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1364/2683] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:39.880034 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7403f1-f045-48ba-a8d3-287abbb1c31d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:39.881398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cf7403f1-f045-48ba-a8d3-287abbb1c31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:39.893493 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7403f1-f045-48ba-a8d3-287abbb1c31d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:39.898045 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab243aba-b4e6-47fc-a7d0-2767f18eb640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:39.899123 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab243aba-b4e6-47fc-a7d0-2767f18eb640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:39.899123 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab243aba-b4e6-47fc-a7d0-2767f18eb640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:39.899453 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab243aba-b4e6-47fc-a7d0-2767f18eb640 admin admin] PATH_INFO: `/v3/users/70991879c6ed4764baa6303517f6bed2` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:39.900429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab243aba-b4e6-47fc-a7d0-2767f18eb640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70991879c6ed4764baa6303517f6bed2)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:39.902385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab243aba-b4e6-47fc-a7d0-2767f18eb640 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:39.926299 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:40.161914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ab243aba-b4e6-47fc-a7d0-2767f18eb640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70991879c6ed4764baa6303517f6bed2'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:40.162589 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ab243aba-b4e6-47fc-a7d0-2767f18eb640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70991879c6ed4764baa6303517f6bed2'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:40.238776 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ab243aba-b4e6-47fc-a7d0-2767f18eb640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70991879c6ed4764baa6303517f6bed2'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:40.261009 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ab243aba-b4e6-47fc-a7d0-2767f18eb640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70991879c6ed4764baa6303517f6bed2'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:40.262371 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ab243aba-b4e6-47fc-a7d0-2767f18eb640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70991879c6ed4764baa6303517f6bed2'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:40.279385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1320/2684] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:52:39 2022] DELETE /identity/v3/users/70991879c6ed4764baa6303517f6bed2 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:40.286000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49532f-214c-4eee-b380-98c9d3decbd2 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:40.286624 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49532f-214c-4eee-b380-98c9d3decbd2 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:40.286927 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49532f-214c-4eee-b380-98c9d3decbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:40.311786 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-5f49532f-214c-4eee-b380-98c9d3decbd2 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:40.313420 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5f49532f-214c-4eee-b380-98c9d3decbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:40.388365 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1365/2685] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:40.390835 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab243aba-b4e6-47fc-a7d0-2767f18eb640 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:40.392896 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-ab243aba-b4e6-47fc-a7d0-2767f18eb640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:40.407228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49532f-214c-4eee-b380-98c9d3decbd2 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:40.415573 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5f49532f-214c-4eee-b380-98c9d3decbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:40.421272 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab243aba-b4e6-47fc-a7d0-2767f18eb640 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:40.429528 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855290e-e28a-4737-9cb8-8c4bbe940e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:40.430924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855290e-e28a-4737-9cb8-8c4bbe940e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:40.431701 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855290e-e28a-4737-9cb8-8c4bbe940e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:40.432499 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855290e-e28a-4737-9cb8-8c4bbe940e16 admin admin] PATH_INFO: `/v3/projects/0cf96e31c83e40d0be3049d57889a064` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:40.433949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855290e-e28a-4737-9cb8-8c4bbe940e16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cf96e31c83e40d0be3049d57889a064)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:40.436960 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855290e-e28a-4737-9cb8-8c4bbe940e16 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:40.497466 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49532f-214c-4eee-b380-98c9d3decbd2 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:40.502485 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba642c-cb89-41b3-8d27-a5c96bbc4aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:40.505027 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba642c-cb89-41b3-8d27-a5c96bbc4aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:40.505027 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba642c-cb89-41b3-8d27-a5c96bbc4aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:40.505027 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba642c-cb89-41b3-8d27-a5c96bbc4aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:40.513937 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba642c-cb89-41b3-8d27-a5c96bbc4aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:40.515983 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba642c-cb89-41b3-8d27-a5c96bbc4aa6 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:40.526660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1366/2686] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:40.573907 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5855290e-e28a-4737-9cb8-8c4bbe940e16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cf96e31c83e40d0be3049d57889a064', 'request_id': 'req-5855290e-e28a-4737-9cb8-8c4bbe940e16'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:40.580357 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5855290e-e28a-4737-9cb8-8c4bbe940e16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cf96e31c83e40d0be3049d57889a064', 'request_id': 'req-5855290e-e28a-4737-9cb8-8c4bbe940e16'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:40.657822 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5855290e-e28a-4737-9cb8-8c4bbe940e16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cf96e31c83e40d0be3049d57889a064', 'request_id': 'req-5855290e-e28a-4737-9cb8-8c4bbe940e16'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:40.671838 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5855290e-e28a-4737-9cb8-8c4bbe940e16 admin admin] The token cache is being invalidate because project 0cf96e31c83e40d0be3049d57889a064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:52:40.672529 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5855290e-e28a-4737-9cb8-8c4bbe940e16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:40.673377 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5855290e-e28a-4737-9cb8-8c4bbe940e16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:40.675236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1321/2687] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:52:40 2022] DELETE /identity/v3/projects/0cf96e31c83e40d0be3049d57889a064 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:40.679406 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba642c-cb89-41b3-8d27-a5c96bbc4aa6 service neutron] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:40.689669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba642c-cb89-41b3-8d27-a5c96bbc4aa6 service neutron] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:40.722642 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:40.749606 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f860b4-c507-40e0-8839-0638aff2994f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:40.750334 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f860b4-c507-40e0-8839-0638aff2994f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:40.750615 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f860b4-c507-40e0-8839-0638aff2994f admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:40.750893 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f860b4-c507-40e0-8839-0638aff2994f admin admin] PATH_INFO: `/v3/users/1b495e7c589d423eb683171852c056d4` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:40.752139 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f860b4-c507-40e0-8839-0638aff2994f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b495e7c589d423eb683171852c056d4)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:40.754075 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f860b4-c507-40e0-8839-0638aff2994f admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:40.960156 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-31f860b4-c507-40e0-8839-0638aff2994f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b495e7c589d423eb683171852c056d4'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:40.961216 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-31f860b4-c507-40e0-8839-0638aff2994f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b495e7c589d423eb683171852c056d4'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:41.044931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-31f860b4-c507-40e0-8839-0638aff2994f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b495e7c589d423eb683171852c056d4'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:41.064225 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-31f860b4-c507-40e0-8839-0638aff2994f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b495e7c589d423eb683171852c056d4'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:41.075829 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-31f860b4-c507-40e0-8839-0638aff2994f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b495e7c589d423eb683171852c056d4'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:41.083178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1367/2688] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:52:40 2022] DELETE /identity/v3/users/1b495e7c589d423eb683171852c056d4 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:41.144921 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855290e-e28a-4737-9cb8-8c4bbe940e16 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:41.146818 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5855290e-e28a-4737-9cb8-8c4bbe940e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:41.171522 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855290e-e28a-4737-9cb8-8c4bbe940e16 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:41.241186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadd6f9-d251-486e-933c-09fead562600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:41.241186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadd6f9-d251-486e-933c-09fead562600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:41.241186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadd6f9-d251-486e-933c-09fead562600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:41.241186 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadd6f9-d251-486e-933c-09fead562600 admin admin] PATH_INFO: `/v3/projects/5f1fa847809a46e893680b0d4a601fca` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:41.243458 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadd6f9-d251-486e-933c-09fead562600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f1fa847809a46e893680b0d4a601fca)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:41.244325 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadd6f9-d251-486e-933c-09fead562600 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:41.272233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:41.402665 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cfadd6f9-d251-486e-933c-09fead562600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f1fa847809a46e893680b0d4a601fca', 'request_id': 'req-cfadd6f9-d251-486e-933c-09fead562600'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:41.411874 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cfadd6f9-d251-486e-933c-09fead562600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f1fa847809a46e893680b0d4a601fca', 'request_id': 'req-cfadd6f9-d251-486e-933c-09fead562600'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:41.504014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cfadd6f9-d251-486e-933c-09fead562600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f1fa847809a46e893680b0d4a601fca', 'request_id': 'req-cfadd6f9-d251-486e-933c-09fead562600'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:41.526941 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cfadd6f9-d251-486e-933c-09fead562600 admin admin] The token cache is being invalidate because project 5f1fa847809a46e893680b0d4a601fca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:52:41.527433 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cfadd6f9-d251-486e-933c-09fead562600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:41.528294 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cfadd6f9-d251-486e-933c-09fead562600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:41.530646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1322/2689] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:52:41 2022] DELETE /identity/v3/projects/5f1fa847809a46e893680b0d4a601fca => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:41.534590 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f860b4-c507-40e0-8839-0638aff2994f admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:41.536761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-31f860b4-c507-40e0-8839-0638aff2994f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:41.556517 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f860b4-c507-40e0-8839-0638aff2994f admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:41.613042 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadd6f9-d251-486e-933c-09fead562600 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:41.614626 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cfadd6f9-d251-486e-933c-09fead562600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:41.654318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e46bc-4de8-4ab1-96ed-675d1c6b7be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:41.654999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e46bc-4de8-4ab1-96ed-675d1c6b7be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:41.655324 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e46bc-4de8-4ab1-96ed-675d1c6b7be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:41.655653 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e46bc-4de8-4ab1-96ed-675d1c6b7be5 admin admin] PATH_INFO: `/v3/users/85064eeb241b42d9901d7877ed1b4705` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:41.656903 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e46bc-4de8-4ab1-96ed-675d1c6b7be5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85064eeb241b42d9901d7877ed1b4705)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:41.658870 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e46bc-4de8-4ab1-96ed-675d1c6b7be5 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:41.704433 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadd6f9-d251-486e-933c-09fead562600 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:41.709358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b0bdf-7904-40f3-9b04-e573dafcc0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:41.710007 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b0bdf-7904-40f3-9b04-e573dafcc0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:41.710287 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b0bdf-7904-40f3-9b04-e573dafcc0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:41.710559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b0bdf-7904-40f3-9b04-e573dafcc0c1 admin admin] PATH_INFO: `/v3/projects/89c6d3410d7d47188c171584c0965e5d` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:41.711750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b0bdf-7904-40f3-9b04-e573dafcc0c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89c6d3410d7d47188c171584c0965e5d)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:41.713659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b0bdf-7904-40f3-9b04-e573dafcc0c1 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:41.872625 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c37e46bc-4de8-4ab1-96ed-675d1c6b7be5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85064eeb241b42d9901d7877ed1b4705'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:41.873392 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c37e46bc-4de8-4ab1-96ed-675d1c6b7be5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85064eeb241b42d9901d7877ed1b4705'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:41.876295 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-386b0bdf-7904-40f3-9b04-e573dafcc0c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89c6d3410d7d47188c171584c0965e5d', 'request_id': 'req-386b0bdf-7904-40f3-9b04-e573dafcc0c1'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:41.882394 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-386b0bdf-7904-40f3-9b04-e573dafcc0c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89c6d3410d7d47188c171584c0965e5d', 'request_id': 'req-386b0bdf-7904-40f3-9b04-e573dafcc0c1'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:41.938033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c37e46bc-4de8-4ab1-96ed-675d1c6b7be5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85064eeb241b42d9901d7877ed1b4705'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:41.939552 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:41.955476 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c37e46bc-4de8-4ab1-96ed-675d1c6b7be5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85064eeb241b42d9901d7877ed1b4705'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:41.963800 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-c37e46bc-4de8-4ab1-96ed-675d1c6b7be5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85064eeb241b42d9901d7877ed1b4705'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:41.971236 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1368/2690] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:52:41 2022] DELETE /identity/v3/users/85064eeb241b42d9901d7877ed1b4705 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:52:42.062331 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-386b0bdf-7904-40f3-9b04-e573dafcc0c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89c6d3410d7d47188c171584c0965e5d', 'request_id': 'req-386b0bdf-7904-40f3-9b04-e573dafcc0c1'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:42.080958 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-386b0bdf-7904-40f3-9b04-e573dafcc0c1 admin admin] The token cache is being invalidate because project 89c6d3410d7d47188c171584c0965e5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:52:42.081549 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-386b0bdf-7904-40f3-9b04-e573dafcc0c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:42.082668 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-386b0bdf-7904-40f3-9b04-e573dafcc0c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:42.084953 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1323/2691] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:52:41 2022] DELETE /identity/v3/projects/89c6d3410d7d47188c171584c0965e5d => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:52:42.090059 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c68e2c-a686-4551-a430-453926c5c415 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.090353 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c68e2c-a686-4551-a430-453926c5c415 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.093248 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c68e2c-a686-4551-a430-453926c5c415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.112252 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-65c68e2c-a686-4551-a430-453926c5c415 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:42.113538 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-65c68e2c-a686-4551-a430-453926c5c415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:42.177296 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1369/2692] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:42.185353 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6edcec-ea23-4bc3-ab53-6ec381785b40 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.186043 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6edcec-ea23-4bc3-ab53-6ec381785b40 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.186043 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6edcec-ea23-4bc3-ab53-6ec381785b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.207028 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-6e6edcec-ea23-4bc3-ab53-6ec381785b40 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:42.208397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6e6edcec-ea23-4bc3-ab53-6ec381785b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:42.216902 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1324/2693] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:42.226465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c68e2c-a686-4551-a430-453926c5c415 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:42.233699 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c68e2c-a686-4551-a430-453926c5c415 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:42.240094 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabaef8-264e-4733-af60-9eb2266f0d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:42.240488 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabaef8-264e-4733-af60-9eb2266f0d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.240666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabaef8-264e-4733-af60-9eb2266f0d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.240952 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabaef8-264e-4733-af60-9eb2266f0d87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.241667 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabaef8-264e-4733-af60-9eb2266f0d87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:42.241985 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabaef8-264e-4733-af60-9eb2266f0d87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:42.243687 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabaef8-264e-4733-af60-9eb2266f0d87 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:42.260494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1370/2694] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:42.261913 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6edcec-ea23-4bc3-ab53-6ec381785b40 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:42.272603 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6edcec-ea23-4bc3-ab53-6ec381785b40 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:42.277886 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594f702-e40e-4a49-b2be-e9bbf2be6195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:42.278056 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594f702-e40e-4a49-b2be-e9bbf2be6195 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.278202 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594f702-e40e-4a49-b2be-e9bbf2be6195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.278478 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594f702-e40e-4a49-b2be-e9bbf2be6195 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.280494 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594f702-e40e-4a49-b2be-e9bbf2be6195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:42.282437 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594f702-e40e-4a49-b2be-e9bbf2be6195 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:42.381565 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1325/2695] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:52:42 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:52:42.385770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabaef8-264e-4733-af60-9eb2266f0d87 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:42.396508 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabaef8-264e-4733-af60-9eb2266f0d87 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:42.424581 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594f702-e40e-4a49-b2be-e9bbf2be6195 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:42.427629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6594f702-e40e-4a49-b2be-e9bbf2be6195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:42.444605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:42.469765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b5cc7-cde9-4242-a3fb-43f2dac00fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:42.470398 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b5cc7-cde9-4242-a3fb-43f2dac00fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.470729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b5cc7-cde9-4242-a3fb-43f2dac00fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.471011 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b5cc7-cde9-4242-a3fb-43f2dac00fa2 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.471708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b5cc7-cde9-4242-a3fb-43f2dac00fa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:42.473662 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b5cc7-cde9-4242-a3fb-43f2dac00fa2 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:42.511975 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594f702-e40e-4a49-b2be-e9bbf2be6195 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:42.522148 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d098a9-54e4-49c2-8eab-f227dd4c5d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:42.522911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d098a9-54e4-49c2-8eab-f227dd4c5d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.523391 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d098a9-54e4-49c2-8eab-f227dd4c5d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.523876 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d098a9-54e4-49c2-8eab-f227dd4c5d95 admin admin] PATH_INFO: `/v3/projects/171411e7346e4e0c935c1b11f037b34a` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.525280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d098a9-54e4-49c2-8eab-f227dd4c5d95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=171411e7346e4e0c935c1b11f037b34a)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:42.527815 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d098a9-54e4-49c2-8eab-f227dd4c5d95 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:42.532852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1371/2696] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:52:42 2022] POST /identity/v3/users => generated 285 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:42.541933 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b5cc7-cde9-4242-a3fb-43f2dac00fa2 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:42.553689 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b5cc7-cde9-4242-a3fb-43f2dac00fa2 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:42.558788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaf77f-a7ac-496d-9500-36b4eabc75df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:42.559446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaf77f-a7ac-496d-9500-36b4eabc75df admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.559731 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaf77f-a7ac-496d-9500-36b4eabc75df admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.560004 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaf77f-a7ac-496d-9500-36b4eabc75df admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.560708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becaf77f-a7ac-496d-9500-36b4eabc75df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:42.563087 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becaf77f-a7ac-496d-9500-36b4eabc75df admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:42.574305 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1372/2697] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:52:42.579124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaf77f-a7ac-496d-9500-36b4eabc75df admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:42.588597 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaf77f-a7ac-496d-9500-36b4eabc75df admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:42.593527 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866fc2d-d1e3-4795-87c4-11e17a0bccd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:42.594249 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866fc2d-d1e3-4795-87c4-11e17a0bccd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.594599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866fc2d-d1e3-4795-87c4-11e17a0bccd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.594878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866fc2d-d1e3-4795-87c4-11e17a0bccd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.595663 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866fc2d-d1e3-4795-87c4-11e17a0bccd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:42.597271 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866fc2d-d1e3-4795-87c4-11e17a0bccd0 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:42.607849 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1373/2698] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:52:42.611886 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-81d098a9-54e4-49c2-8eab-f227dd4c5d95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '171411e7346e4e0c935c1b11f037b34a', 'request_id': 'req-81d098a9-54e4-49c2-8eab-f227dd4c5d95'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:42.612055 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866fc2d-d1e3-4795-87c4-11e17a0bccd0 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:42.617920 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-81d098a9-54e4-49c2-8eab-f227dd4c5d95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '171411e7346e4e0c935c1b11f037b34a', 'request_id': 'req-81d098a9-54e4-49c2-8eab-f227dd4c5d95'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:42.621690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866fc2d-d1e3-4795-87c4-11e17a0bccd0 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:42.647208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:42.682595 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f12f0f-56cb-4a24-b852-66a778f9aec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:42.683292 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f12f0f-56cb-4a24-b852-66a778f9aec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.683615 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f12f0f-56cb-4a24-b852-66a778f9aec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.683870 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f12f0f-56cb-4a24-b852-66a778f9aec2 admin admin] PATH_INFO: `/v3/projects/28337803267c4622a85e204a9a310f50/users/29c6d80970a647d3b806e25192721260/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.686844 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-81d098a9-54e4-49c2-8eab-f227dd4c5d95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '171411e7346e4e0c935c1b11f037b34a', 'request_id': 'req-81d098a9-54e4-49c2-8eab-f227dd4c5d95'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:42.707838 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-81d098a9-54e4-49c2-8eab-f227dd4c5d95 admin admin] The token cache is being invalidate because project 171411e7346e4e0c935c1b11f037b34a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:52:42.708233 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-81d098a9-54e4-49c2-8eab-f227dd4c5d95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:42.708866 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f12f0f-56cb-4a24-b852-66a778f9aec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28337803267c4622a85e204a9a310f50, user_id=29c6d80970a647d3b806e25192721260, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:42.709005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-81d098a9-54e4-49c2-8eab-f227dd4c5d95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:42.710732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1326/2699] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:52:42 2022] DELETE /identity/v3/projects/171411e7346e4e0c935c1b11f037b34a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:52:42.711638 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f12f0f-56cb-4a24-b852-66a778f9aec2 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:42.715521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d516ed-8f31-4039-a62b-2b8c1ad8046e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.715869 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d516ed-8f31-4039-a62b-2b8c1ad8046e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.716149 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d516ed-8f31-4039-a62b-2b8c1ad8046e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.736738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-e2d516ed-8f31-4039-a62b-2b8c1ad8046e None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:42.737940 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e2d516ed-8f31-4039-a62b-2b8c1ad8046e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:42.746618 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1327/2700] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:52:42.755072 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902545e-8a44-4632-b8eb-9e9083703fc5 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.755400 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902545e-8a44-4632-b8eb-9e9083703fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.755681 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902545e-8a44-4632-b8eb-9e9083703fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.775536 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1374/2701] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:42 2022] PUT /identity/v3/projects/28337803267c4622a85e204a9a310f50/users/29c6d80970a647d3b806e25192721260/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:52:42.778542 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-e902545e-8a44-4632-b8eb-9e9083703fc5 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:42.779856 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e902545e-8a44-4632-b8eb-9e9083703fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:42.792583 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b69da4-5d2d-4cdf-b2ee-d7bb3a095282 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.792930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b69da4-5d2d-4cdf-b2ee-d7bb3a095282 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.793143 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b69da4-5d2d-4cdf-b2ee-d7bb3a095282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.828079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-13b69da4-5d2d-4cdf-b2ee-d7bb3a095282 None None] MFA Rules not processed for user `29c6d80970a647d3b806e25192721260`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:42.829493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-13b69da4-5d2d-4cdf-b2ee-d7bb3a095282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:42.856795 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1328/2702] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:52:42.858617 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902545e-8a44-4632-b8eb-9e9083703fc5 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:42.868188 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902545e-8a44-4632-b8eb-9e9083703fc5 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:42.873333 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c2947-fb0b-4bdb-a325-492b5ba4912e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:42.874910 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c2947-fb0b-4bdb-a325-492b5ba4912e admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.874910 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c2947-fb0b-4bdb-a325-492b5ba4912e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.875138 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c2947-fb0b-4bdb-a325-492b5ba4912e admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.875860 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c2947-fb0b-4bdb-a325-492b5ba4912e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:42.876173 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c2947-fb0b-4bdb-a325-492b5ba4912e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:42.877815 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c2947-fb0b-4bdb-a325-492b5ba4912e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:42.894576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1329/2703] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:42.899411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c2947-fb0b-4bdb-a325-492b5ba4912e admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:42.906793 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1375/2704] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:42.910579 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c2947-fb0b-4bdb-a325-492b5ba4912e admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:42.915450 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd4637-4017-46bb-a546-52e51833fa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:42.916065 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd4637-4017-46bb-a546-52e51833fa5e admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.916342 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd4637-4017-46bb-a546-52e51833fa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.916612 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd4637-4017-46bb-a546-52e51833fa5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.917275 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd4637-4017-46bb-a546-52e51833fa5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:42.919168 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd4637-4017-46bb-a546-52e51833fa5e admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:42.919370 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b69da4-5d2d-4cdf-b2ee-d7bb3a095282 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:42.920987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-13b69da4-5d2d-4cdf-b2ee-d7bb3a095282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:43.002085 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b69da4-5d2d-4cdf-b2ee-d7bb3a095282 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:43.003081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1330/2705] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:52:42 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:52:43.009684 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd4637-4017-46bb-a546-52e51833fa5e admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:43.015359 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:43.078920 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1bfb6b-98ff-4293-a255-9531435c5b7e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49a34cd99ab47bb92af6ed2f82fefde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:43.079505 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bfb6b-98ff-4293-a255-9531435c5b7e service glance] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:43.079784 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bfb6b-98ff-4293-a255-9531435c5b7e service glance] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:43.080054 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bfb6b-98ff-4293-a255-9531435c5b7e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:43.090032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:43.131921 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd4637-4017-46bb-a546-52e51833fa5e admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:43.131921 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed2d2e-3d7e-4743-8e75-e500a75078a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:43.131921 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed2d2e-3d7e-4743-8e75-e500a75078a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:43.131921 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed2d2e-3d7e-4743-8e75-e500a75078a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:43.132671 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed2d2e-3d7e-4743-8e75-e500a75078a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:43.132671 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed2d2e-3d7e-4743-8e75-e500a75078a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:43.132671 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed2d2e-3d7e-4743-8e75-e500a75078a2 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:43.144369 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1bfb6b-98ff-4293-a255-9531435c5b7e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:43.145831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1bfb6b-98ff-4293-a255-9531435c5b7e service glance] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:43.155843 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1376/2706] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:52:43.206923 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1331/2707] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:52:43 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:43.212027 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1bfb6b-98ff-4293-a255-9531435c5b7e service glance] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:43.225603 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1bfb6b-98ff-4293-a255-9531435c5b7e service glance] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:43.232514 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc992962-ef42-4044-b120-4c762c1760a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:43.234486 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc992962-ef42-4044-b120-4c762c1760a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:43.234666 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc992962-ef42-4044-b120-4c762c1760a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:43.235037 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc992962-ef42-4044-b120-4c762c1760a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:43.235844 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc992962-ef42-4044-b120-4c762c1760a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:43.237544 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc992962-ef42-4044-b120-4c762c1760a4 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:43.248779 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1377/2708] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:43.252696 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed2d2e-3d7e-4743-8e75-e500a75078a2 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:43.264501 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed2d2e-3d7e-4743-8e75-e500a75078a2 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:43.268600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cedda-1aaf-4372-bd9a-942afe598d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:43.269320 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cedda-1aaf-4372-bd9a-942afe598d18 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:43.269788 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cedda-1aaf-4372-bd9a-942afe598d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:43.270236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cedda-1aaf-4372-bd9a-942afe598d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:43.270961 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cedda-1aaf-4372-bd9a-942afe598d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:43.272630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cedda-1aaf-4372-bd9a-942afe598d18 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:43.290723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc992962-ef42-4044-b120-4c762c1760a4 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:43.295381 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1332/2709] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:43.302241 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc992962-ef42-4044-b120-4c762c1760a4 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:43.309378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b894c8-ecf4-4b21-85cc-40c3cb376d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:43.309378 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b894c8-ecf4-4b21-85cc-40c3cb376d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:43.309807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b894c8-ecf4-4b21-85cc-40c3cb376d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:43.310892 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b894c8-ecf4-4b21-85cc-40c3cb376d88 admin admin] PATH_INFO: `/v3/projects/288d268fc2b94691b32830524be4c517/users/82ea97d7800940ffa02653b479219178/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:43.328599 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b894c8-ecf4-4b21-85cc-40c3cb376d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=288d268fc2b94691b32830524be4c517, user_id=82ea97d7800940ffa02653b479219178, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:43.331615 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b894c8-ecf4-4b21-85cc-40c3cb376d88 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:43.484764 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1378/2710] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:43 2022] PUT /identity/v3/projects/288d268fc2b94691b32830524be4c517/users/82ea97d7800940ffa02653b479219178/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:43.503000 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187f8c0-0853-4ffc-ae98-ee33d447ce45 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:43.503705 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187f8c0-0853-4ffc-ae98-ee33d447ce45 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:43.503977 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187f8c0-0853-4ffc-ae98-ee33d447ce45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:43.541922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b187f8c0-0853-4ffc-ae98-ee33d447ce45 None None] MFA Rules not processed for user `82ea97d7800940ffa02653b479219178`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:43.543222 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b187f8c0-0853-4ffc-ae98-ee33d447ce45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:43.624590 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1333/2711] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:43.629277 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b894c8-ecf4-4b21-85cc-40c3cb376d88 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:43.695348 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b894c8-ecf4-4b21-85cc-40c3cb376d88 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:43.700046 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bdb01-b5da-4a1e-bc1b-8a9f3f3aff2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:43.700669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bdb01-b5da-4a1e-bc1b-8a9f3f3aff2f admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:43.701208 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bdb01-b5da-4a1e-bc1b-8a9f3f3aff2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:43.701487 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bdb01-b5da-4a1e-bc1b-8a9f3f3aff2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:43.702318 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583bdb01-b5da-4a1e-bc1b-8a9f3f3aff2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:43.704286 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583bdb01-b5da-4a1e-bc1b-8a9f3f3aff2f admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:43.785345 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1379/2712] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:52:43 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:43.789537 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187f8c0-0853-4ffc-ae98-ee33d447ce45 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:43.800995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187f8c0-0853-4ffc-ae98-ee33d447ce45 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:43.863141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600d965-cc66-4fc2-bb44-6fe0d67dff46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:43.863819 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600d965-cc66-4fc2-bb44-6fe0d67dff46 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:43.864104 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600d965-cc66-4fc2-bb44-6fe0d67dff46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:43.864383 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600d965-cc66-4fc2-bb44-6fe0d67dff46 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:43.865083 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600d965-cc66-4fc2-bb44-6fe0d67dff46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:43.867064 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600d965-cc66-4fc2-bb44-6fe0d67dff46 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:43.990427 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:43.996574 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1334/2713] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:52:43 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:44.002383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bdb01-b5da-4a1e-bc1b-8a9f3f3aff2f admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:44.030970 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bdb01-b5da-4a1e-bc1b-8a9f3f3aff2f admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:44.031480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fd611-22bd-4ff6-a4b9-494488ef3808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:44.032091 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fd611-22bd-4ff6-a4b9-494488ef3808 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:44.032434 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fd611-22bd-4ff6-a4b9-494488ef3808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:44.032907 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fd611-22bd-4ff6-a4b9-494488ef3808 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:44.033780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6fd611-22bd-4ff6-a4b9-494488ef3808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:44.035708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6fd611-22bd-4ff6-a4b9-494488ef3808 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:44.048822 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1380/2714] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:44.053250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600d965-cc66-4fc2-bb44-6fe0d67dff46 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:44.065019 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600d965-cc66-4fc2-bb44-6fe0d67dff46 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:44.069797 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fd1ed-11aa-46bb-b12c-c1b9620d7713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:44.070491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fd1ed-11aa-46bb-b12c-c1b9620d7713 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:44.070911 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fd1ed-11aa-46bb-b12c-c1b9620d7713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:44.071198 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fd1ed-11aa-46bb-b12c-c1b9620d7713 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:44.071931 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fd1ed-11aa-46bb-b12c-c1b9620d7713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:44.073532 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fd1ed-11aa-46bb-b12c-c1b9620d7713 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:44.085302 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1335/2715] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:52:44.096153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fd611-22bd-4ff6-a4b9-494488ef3808 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:44.100833 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fd611-22bd-4ff6-a4b9-494488ef3808 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:44.105610 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36e54c-9c72-4642-80b3-f356a4250158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:44.106290 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36e54c-9c72-4642-80b3-f356a4250158 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:44.106631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36e54c-9c72-4642-80b3-f356a4250158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:44.107071 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36e54c-9c72-4642-80b3-f356a4250158 admin admin] PATH_INFO: `/v3/projects/c48396fa48754565971bd5eaef8b7c15/users/2afe0f7cd9884cf286291496e397b147/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:44.126278 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36e54c-9c72-4642-80b3-f356a4250158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48396fa48754565971bd5eaef8b7c15, user_id=2afe0f7cd9884cf286291496e397b147, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:44.129087 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36e54c-9c72-4642-80b3-f356a4250158 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:44.199922 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1381/2716] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:44 2022] PUT /identity/v3/projects/c48396fa48754565971bd5eaef8b7c15/users/2afe0f7cd9884cf286291496e397b147/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:44.211692 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808e3a9-6f53-4212-9dbb-fe767e18a4d5 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:44.212011 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808e3a9-6f53-4212-9dbb-fe767e18a4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:44.212290 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808e3a9-6f53-4212-9dbb-fe767e18a4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:44.247359 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c808e3a9-6f53-4212-9dbb-fe767e18a4d5 None None] MFA Rules not processed for user `2afe0f7cd9884cf286291496e397b147`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:44.248457 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c808e3a9-6f53-4212-9dbb-fe767e18a4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:44.315745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1336/2717] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:44.320518 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36e54c-9c72-4642-80b3-f356a4250158 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:44.351590 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:44.391402 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36e54c-9c72-4642-80b3-f356a4250158 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:44.396600 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac7501-4407-4cd2-a128-05012a9a8df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:44.397234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac7501-4407-4cd2-a128-05012a9a8df7 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:44.397584 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac7501-4407-4cd2-a128-05012a9a8df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:44.397890 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac7501-4407-4cd2-a128-05012a9a8df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:44.398574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac7501-4407-4cd2-a128-05012a9a8df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:44.400566 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac7501-4407-4cd2-a128-05012a9a8df7 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:44.525183 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1382/2718] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:52:44 2022] POST /identity/v3/projects => generated 375 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:44.529193 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808e3a9-6f53-4212-9dbb-fe767e18a4d5 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:44.550023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808e3a9-6f53-4212-9dbb-fe767e18a4d5 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:44.623075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7b5c4-973e-4fb9-b644-a1b45dc02b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:44.624447 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7b5c4-973e-4fb9-b644-a1b45dc02b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:44.624835 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7b5c4-973e-4fb9-b644-a1b45dc02b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:44.625590 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7b5c4-973e-4fb9-b644-a1b45dc02b7d admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:44.625901 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7b5c4-973e-4fb9-b644-a1b45dc02b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:44.627895 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7b5c4-973e-4fb9-b644-a1b45dc02b7d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:44.723591 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1337/2719] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:52:44 2022] POST /identity/v3/users => generated 294 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:44.724924 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac7501-4407-4cd2-a128-05012a9a8df7 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:44.738130 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac7501-4407-4cd2-a128-05012a9a8df7 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:44.742899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7629e-e7c6-4155-8480-78f8f804ff19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:44.743555 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7629e-e7c6-4155-8480-78f8f804ff19 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:44.743894 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7629e-e7c6-4155-8480-78f8f804ff19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:44.744160 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7629e-e7c6-4155-8480-78f8f804ff19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:44.744879 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7629e-e7c6-4155-8480-78f8f804ff19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:44.746531 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7629e-e7c6-4155-8480-78f8f804ff19 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:44.757876 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1383/2720] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:44.762150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7b5c4-973e-4fb9-b644-a1b45dc02b7d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:44.772826 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7b5c4-973e-4fb9-b644-a1b45dc02b7d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:44.777427 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dd2f4-8a67-4346-80b3-cdce1bd2871f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:44.778081 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dd2f4-8a67-4346-80b3-cdce1bd2871f admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:44.778365 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dd2f4-8a67-4346-80b3-cdce1bd2871f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:44.778641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dd2f4-8a67-4346-80b3-cdce1bd2871f admin admin] PATH_INFO: `/v3/projects/3d1f2d448d704e2180af6f1593cfe5be/users/67ecf0e7707642e3914baa3a6bf8d443/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:44.797897 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dd2f4-8a67-4346-80b3-cdce1bd2871f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1f2d448d704e2180af6f1593cfe5be, user_id=67ecf0e7707642e3914baa3a6bf8d443, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:44.800843 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dd2f4-8a67-4346-80b3-cdce1bd2871f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:44.864192 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1338/2721] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:44 2022] PUT /identity/v3/projects/3d1f2d448d704e2180af6f1593cfe5be/users/67ecf0e7707642e3914baa3a6bf8d443/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:44.868473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7629e-e7c6-4155-8480-78f8f804ff19 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:44.883930 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7629e-e7c6-4155-8480-78f8f804ff19 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:44.946253 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732ce28-1292-423f-b19e-94deba998181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:44.946936 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732ce28-1292-423f-b19e-94deba998181 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:44.947228 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732ce28-1292-423f-b19e-94deba998181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:44.947536 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732ce28-1292-423f-b19e-94deba998181 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:44.948243 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732ce28-1292-423f-b19e-94deba998181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:44.949870 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732ce28-1292-423f-b19e-94deba998181 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:44.961062 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1384/2722] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:44.965562 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dd2f4-8a67-4346-80b3-cdce1bd2871f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:44.977497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dd2f4-8a67-4346-80b3-cdce1bd2871f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:44.982382 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed5eb6-0755-41ab-8294-bfac53154e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:44.983727 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed5eb6-0755-41ab-8294-bfac53154e6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:44.984019 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed5eb6-0755-41ab-8294-bfac53154e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:44.984324 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed5eb6-0755-41ab-8294-bfac53154e6f admin admin] PATH_INFO: `/v3/projects/3d1f2d448d704e2180af6f1593cfe5be/users/67ecf0e7707642e3914baa3a6bf8d443/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:44.986293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed5eb6-0755-41ab-8294-bfac53154e6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1f2d448d704e2180af6f1593cfe5be, user_id=67ecf0e7707642e3914baa3a6bf8d443, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:44.989014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed5eb6-0755-41ab-8294-bfac53154e6f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:45.001583 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1339/2723] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:44 2022] PUT /identity/v3/projects/3d1f2d448d704e2180af6f1593cfe5be/users/67ecf0e7707642e3914baa3a6bf8d443/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:45.013183 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d87c6-6d34-4ca1-8a0c-c037cff32213 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:45.013480 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d87c6-6d34-4ca1-8a0c-c037cff32213 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:45.013847 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d87c6-6d34-4ca1-8a0c-c037cff32213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:45.046226 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-9e7d87c6-6d34-4ca1-8a0c-c037cff32213 None None] MFA Rules not processed for user `67ecf0e7707642e3914baa3a6bf8d443`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:45.047672 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-9e7d87c6-6d34-4ca1-8a0c-c037cff32213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:45.149877 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1385/2724] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:45.160585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed5eb6-0755-41ab-8294-bfac53154e6f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:45.162328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-32ed5eb6-0755-41ab-8294-bfac53154e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:45.205639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:45.234143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed5eb6-0755-41ab-8294-bfac53154e6f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:45.238403 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6b951-a24c-4123-91a1-01b006594fd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:45.239164 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6b951-a24c-4123-91a1-01b006594fd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:45.239533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6b951-a24c-4123-91a1-01b006594fd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:45.239834 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6b951-a24c-4123-91a1-01b006594fd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:45.303194 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6b951-a24c-4123-91a1-01b006594fd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:45.304739 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6b951-a24c-4123-91a1-01b006594fd0 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:45.314665 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1340/2725] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:45.930802 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac9072-ded9-4b04-9562-9cfe0c506e41 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:45.931435 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac9072-ded9-4b04-9562-9cfe0c506e41 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:45.931850 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac9072-ded9-4b04-9562-9cfe0c506e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:45.959463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-a4ac9072-ded9-4b04-9562-9cfe0c506e41 None None] MFA Rules not processed for user `7063b5053f164bba83cd0c17d66cbdff`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:45.961803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a4ac9072-ded9-4b04-9562-9cfe0c506e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:45.980190 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:46.026041 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1386/2726] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:47.390191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6b951-a24c-4123-91a1-01b006594fd0 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:47.400872 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6b951-a24c-4123-91a1-01b006594fd0 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:47.405298 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4677c26-5a53-4c3b-af93-b6a581be4aed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:47.405965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4677c26-5a53-4c3b-af93-b6a581be4aed service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:47.406235 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4677c26-5a53-4c3b-af93-b6a581be4aed service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:47.406512 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4677c26-5a53-4c3b-af93-b6a581be4aed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:47.466219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4677c26-5a53-4c3b-af93-b6a581be4aed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:47.468649 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4677c26-5a53-4c3b-af93-b6a581be4aed service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:47.478946 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1341/2727] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:52:49.107050 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac9072-ded9-4b04-9562-9cfe0c506e41 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:49.118289 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac9072-ded9-4b04-9562-9cfe0c506e41 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:49.122043 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922ef93-a841-4165-9615-3c138bb57044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:49.122760 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922ef93-a841-4165-9615-3c138bb57044 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:49.123050 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922ef93-a841-4165-9615-3c138bb57044 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:49.123442 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922ef93-a841-4165-9615-3c138bb57044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:49.133832 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922ef93-a841-4165-9615-3c138bb57044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:49.135339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922ef93-a841-4165-9615-3c138bb57044 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:49.145592 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1387/2728] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:53.885174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4677c26-5a53-4c3b-af93-b6a581be4aed service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:53.948442 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4677c26-5a53-4c3b-af93-b6a581be4aed service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:53.954392 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f02267-aeb4-41e8-90e9-31979a347ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:53.955086 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f02267-aeb4-41e8-90e9-31979a347ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:53.955412 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f02267-aeb4-41e8-90e9-31979a347ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:53.955694 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f02267-aeb4-41e8-90e9-31979a347ec6 admin admin] PATH_INFO: `/v3/users/82ea97d7800940ffa02653b479219178` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:53.956979 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f02267-aeb4-41e8-90e9-31979a347ec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82ea97d7800940ffa02653b479219178)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:53.958936 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f02267-aeb4-41e8-90e9-31979a347ec6 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:54.045856 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:54.203946 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-29f02267-aeb4-41e8-90e9-31979a347ec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82ea97d7800940ffa02653b479219178'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:54.204902 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-29f02267-aeb4-41e8-90e9-31979a347ec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82ea97d7800940ffa02653b479219178'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:54.291008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-29f02267-aeb4-41e8-90e9-31979a347ec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82ea97d7800940ffa02653b479219178'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:54.304028 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-29f02267-aeb4-41e8-90e9-31979a347ec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82ea97d7800940ffa02653b479219178'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:54.304704 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-29f02267-aeb4-41e8-90e9-31979a347ec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82ea97d7800940ffa02653b479219178'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:54.317740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1342/2729] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:52:53 2022] DELETE /identity/v3/users/82ea97d7800940ffa02653b479219178 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:54.322501 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa8af3-65cf-4a5d-83ed-38a285b1a2f3 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:54.323126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa8af3-65cf-4a5d-83ed-38a285b1a2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:54.323126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa8af3-65cf-4a5d-83ed-38a285b1a2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:54.343908 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-b4aa8af3-65cf-4a5d-83ed-38a285b1a2f3 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:54.345192 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b4aa8af3-65cf-4a5d-83ed-38a285b1a2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:54.404456 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1388/2730] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:54.415090 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f02267-aeb4-41e8-90e9-31979a347ec6 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:54.416545 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-29f02267-aeb4-41e8-90e9-31979a347ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:54.477063 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f02267-aeb4-41e8-90e9-31979a347ec6 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:54.480764 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b45e54-fa21-460f-903a-56842c5f8eb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:54.481413 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b45e54-fa21-460f-903a-56842c5f8eb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:54.481689 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b45e54-fa21-460f-903a-56842c5f8eb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:54.481959 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b45e54-fa21-460f-903a-56842c5f8eb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:54.492342 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b45e54-fa21-460f-903a-56842c5f8eb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:54.493770 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b45e54-fa21-460f-903a-56842c5f8eb6 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:54.503442 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1343/2731] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:55.011657 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa8af3-65cf-4a5d-83ed-38a285b1a2f3 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:55.013146 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b4aa8af3-65cf-4a5d-83ed-38a285b1a2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:55.028659 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa8af3-65cf-4a5d-83ed-38a285b1a2f3 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:55.033818 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5232d33-c510-4cb3-b2dd-99641d44b75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:55.034469 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5232d33-c510-4cb3-b2dd-99641d44b75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:55.034754 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5232d33-c510-4cb3-b2dd-99641d44b75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:55.035082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5232d33-c510-4cb3-b2dd-99641d44b75f admin admin] PATH_INFO: `/v3/projects/288d268fc2b94691b32830524be4c517` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:55.036325 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5232d33-c510-4cb3-b2dd-99641d44b75f admin admin] RBAC: Authorizing `identity:delete_project(project_id=288d268fc2b94691b32830524be4c517)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:55.038322 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5232d33-c510-4cb3-b2dd-99641d44b75f admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:55.159132 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f5232d33-c510-4cb3-b2dd-99641d44b75f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '288d268fc2b94691b32830524be4c517', 'request_id': 'req-f5232d33-c510-4cb3-b2dd-99641d44b75f'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:55.164915 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f5232d33-c510-4cb3-b2dd-99641d44b75f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '288d268fc2b94691b32830524be4c517', 'request_id': 'req-f5232d33-c510-4cb3-b2dd-99641d44b75f'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:55.244269 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f5232d33-c510-4cb3-b2dd-99641d44b75f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '288d268fc2b94691b32830524be4c517', 'request_id': 'req-f5232d33-c510-4cb3-b2dd-99641d44b75f'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:55.256981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f5232d33-c510-4cb3-b2dd-99641d44b75f admin admin] The token cache is being invalidate because project 288d268fc2b94691b32830524be4c517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:52:55.257262 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f5232d33-c510-4cb3-b2dd-99641d44b75f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:55.257925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-f5232d33-c510-4cb3-b2dd-99641d44b75f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:55.259608 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1389/2732] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:52:55 2022] DELETE /identity/v3/projects/288d268fc2b94691b32830524be4c517 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:55.263781 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b45e54-fa21-460f-903a-56842c5f8eb6 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:55.274840 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b45e54-fa21-460f-903a-56842c5f8eb6 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:55.336562 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c22bc-c1ac-42f3-ab58-ae3a1d299ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:55.337448 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c22bc-c1ac-42f3-ab58-ae3a1d299ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:55.337836 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c22bc-c1ac-42f3-ab58-ae3a1d299ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:55.338226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c22bc-c1ac-42f3-ab58-ae3a1d299ba3 admin admin] PATH_INFO: `/v3/users/2afe0f7cd9884cf286291496e397b147` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:55.339596 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c22bc-c1ac-42f3-ab58-ae3a1d299ba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2afe0f7cd9884cf286291496e397b147)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:55.341924 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c22bc-c1ac-42f3-ab58-ae3a1d299ba3 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:55.523702 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-bd2c22bc-c1ac-42f3-ab58-ae3a1d299ba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2afe0f7cd9884cf286291496e397b147'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:55.524295 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-bd2c22bc-c1ac-42f3-ab58-ae3a1d299ba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2afe0f7cd9884cf286291496e397b147'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:55.526166 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:55.627618 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-bd2c22bc-c1ac-42f3-ab58-ae3a1d299ba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2afe0f7cd9884cf286291496e397b147'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:55.640578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-bd2c22bc-c1ac-42f3-ab58-ae3a1d299ba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2afe0f7cd9884cf286291496e397b147'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:55.641257 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-bd2c22bc-c1ac-42f3-ab58-ae3a1d299ba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2afe0f7cd9884cf286291496e397b147'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:55.654078 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1344/2733] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:52:55 2022] DELETE /identity/v3/users/2afe0f7cd9884cf286291496e397b147 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:56.178742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5232d33-c510-4cb3-b2dd-99641d44b75f admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:56.180347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-f5232d33-c510-4cb3-b2dd-99641d44b75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:56.194312 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5232d33-c510-4cb3-b2dd-99641d44b75f admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:56.230353 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:56.255171 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60772a40-14ed-4351-a820-10a54eae7125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:56.256120 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60772a40-14ed-4351-a820-10a54eae7125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:56.256409 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60772a40-14ed-4351-a820-10a54eae7125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:56.257117 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60772a40-14ed-4351-a820-10a54eae7125 admin admin] PATH_INFO: `/v3/projects/c48396fa48754565971bd5eaef8b7c15` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:56.258967 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60772a40-14ed-4351-a820-10a54eae7125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c48396fa48754565971bd5eaef8b7c15)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:56.261151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60772a40-14ed-4351-a820-10a54eae7125 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:56.336970 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-60772a40-14ed-4351-a820-10a54eae7125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48396fa48754565971bd5eaef8b7c15', 'request_id': 'req-60772a40-14ed-4351-a820-10a54eae7125'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:56.342688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-60772a40-14ed-4351-a820-10a54eae7125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48396fa48754565971bd5eaef8b7c15', 'request_id': 'req-60772a40-14ed-4351-a820-10a54eae7125'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:56.393506 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-60772a40-14ed-4351-a820-10a54eae7125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48396fa48754565971bd5eaef8b7c15', 'request_id': 'req-60772a40-14ed-4351-a820-10a54eae7125'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:56.405856 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-60772a40-14ed-4351-a820-10a54eae7125 admin admin] The token cache is being invalidate because project c48396fa48754565971bd5eaef8b7c15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:52:56.406097 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-60772a40-14ed-4351-a820-10a54eae7125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:56.406739 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-60772a40-14ed-4351-a820-10a54eae7125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:56.408688 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1390/2734] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:52:56 2022] DELETE /identity/v3/projects/c48396fa48754565971bd5eaef8b7c15 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:52:56.412758 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c22bc-c1ac-42f3-ab58-ae3a1d299ba3 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:56.414241 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-bd2c22bc-c1ac-42f3-ab58-ae3a1d299ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:56.427741 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c22bc-c1ac-42f3-ab58-ae3a1d299ba3 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:56.487952 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1e63a-0626-4c25-84b5-6202509bc94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:56.488602 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1e63a-0626-4c25-84b5-6202509bc94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:56.488888 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1e63a-0626-4c25-84b5-6202509bc94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:56.489168 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1e63a-0626-4c25-84b5-6202509bc94f admin admin] PATH_INFO: `/v3/users/67ecf0e7707642e3914baa3a6bf8d443` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:56.490338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1e63a-0626-4c25-84b5-6202509bc94f admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ecf0e7707642e3914baa3a6bf8d443)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:56.492329 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1e63a-0626-4c25-84b5-6202509bc94f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:56.640616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-21c1e63a-0626-4c25-84b5-6202509bc94f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ecf0e7707642e3914baa3a6bf8d443'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:56.641281 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-21c1e63a-0626-4c25-84b5-6202509bc94f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ecf0e7707642e3914baa3a6bf8d443'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:56.730280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-21c1e63a-0626-4c25-84b5-6202509bc94f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ecf0e7707642e3914baa3a6bf8d443'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:56.744117 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-21c1e63a-0626-4c25-84b5-6202509bc94f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ecf0e7707642e3914baa3a6bf8d443'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:56.744820 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-21c1e63a-0626-4c25-84b5-6202509bc94f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ecf0e7707642e3914baa3a6bf8d443'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:56.759757 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1345/2735] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:52:56 2022] DELETE /identity/v3/users/67ecf0e7707642e3914baa3a6bf8d443 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:57.154231 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60772a40-14ed-4351-a820-10a54eae7125 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:57.156147 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-60772a40-14ed-4351-a820-10a54eae7125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:57.174897 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60772a40-14ed-4351-a820-10a54eae7125 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:57.260025 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7963a1-a0f9-432d-8def-4470be94171c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:57.260736 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7963a1-a0f9-432d-8def-4470be94171c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:57.261074 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7963a1-a0f9-432d-8def-4470be94171c admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:57.261358 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7963a1-a0f9-432d-8def-4470be94171c admin admin] PATH_INFO: `/v3/projects/3d1f2d448d704e2180af6f1593cfe5be` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:57.262636 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7963a1-a0f9-432d-8def-4470be94171c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d1f2d448d704e2180af6f1593cfe5be)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:57.264630 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7963a1-a0f9-432d-8def-4470be94171c admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:57.416003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-3d7963a1-a0f9-432d-8def-4470be94171c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d1f2d448d704e2180af6f1593cfe5be', 'request_id': 'req-3d7963a1-a0f9-432d-8def-4470be94171c'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:57.425043 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-3d7963a1-a0f9-432d-8def-4470be94171c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d1f2d448d704e2180af6f1593cfe5be', 'request_id': 'req-3d7963a1-a0f9-432d-8def-4470be94171c'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:57.519647 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-3d7963a1-a0f9-432d-8def-4470be94171c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d1f2d448d704e2180af6f1593cfe5be', 'request_id': 'req-3d7963a1-a0f9-432d-8def-4470be94171c'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:57.523498 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:57.534539 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-3d7963a1-a0f9-432d-8def-4470be94171c admin admin] The token cache is being invalidate because project 3d1f2d448d704e2180af6f1593cfe5be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:52:57.540912 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-3d7963a1-a0f9-432d-8def-4470be94171c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:57.540912 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-3d7963a1-a0f9-432d-8def-4470be94171c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:52:57.542611 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1391/2736] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:52:57 2022] DELETE /identity/v3/projects/3d1f2d448d704e2180af6f1593cfe5be => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:57.548985 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725e465-29cf-451d-a58c-2d30a55b8fb2 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:57.549624 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725e465-29cf-451d-a58c-2d30a55b8fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:57.549624 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725e465-29cf-451d-a58c-2d30a55b8fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:57.571253 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b725e465-29cf-451d-a58c-2d30a55b8fb2 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:57.572525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b725e465-29cf-451d-a58c-2d30a55b8fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:57.618643 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:57.639015 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1346/2737] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:57.648206 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c802e1-ee28-4ecc-96d7-62a799c019d3 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:57.648496 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c802e1-ee28-4ecc-96d7-62a799c019d3 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:57.648803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c802e1-ee28-4ecc-96d7-62a799c019d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:57.671124 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-d3c802e1-ee28-4ecc-96d7-62a799c019d3 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:57.676649 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-d3c802e1-ee28-4ecc-96d7-62a799c019d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:57.681691 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1392/2738] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:57.686266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725e465-29cf-451d-a58c-2d30a55b8fb2 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:57.697369 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725e465-29cf-451d-a58c-2d30a55b8fb2 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:57.702841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1748a2-b4cd-4942-9aab-a42930a5f101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:57.705335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1748a2-b4cd-4942-9aab-a42930a5f101 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:57.705335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1748a2-b4cd-4942-9aab-a42930a5f101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:57.705335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1748a2-b4cd-4942-9aab-a42930a5f101 admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:57.705335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1748a2-b4cd-4942-9aab-a42930a5f101 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:57.705744 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1748a2-b4cd-4942-9aab-a42930a5f101 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:57.707379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1748a2-b4cd-4942-9aab-a42930a5f101 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:57.719729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1347/2739] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:57.725464 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c802e1-ee28-4ecc-96d7-62a799c019d3 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:57.739697 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c802e1-ee28-4ecc-96d7-62a799c019d3 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:57.741795 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d86fd-aff4-4668-94ed-4113ef916f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:57.742457 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d86fd-aff4-4668-94ed-4113ef916f6e admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:57.742744 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d86fd-aff4-4668-94ed-4113ef916f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:57.743022 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d86fd-aff4-4668-94ed-4113ef916f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:57.743746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d86fd-aff4-4668-94ed-4113ef916f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:57.745679 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d86fd-aff4-4668-94ed-4113ef916f6e admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:57.905203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1393/2740] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:52:57 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:57.909547 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1748a2-b4cd-4942-9aab-a42930a5f101 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:57.920416 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1748a2-b4cd-4942-9aab-a42930a5f101 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:57.978528 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df580fe-c5ff-4172-954a-08e812adb001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:57.979150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df580fe-c5ff-4172-954a-08e812adb001 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:57.979466 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df580fe-c5ff-4172-954a-08e812adb001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:57.979747 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df580fe-c5ff-4172-954a-08e812adb001 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:57.980430 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df580fe-c5ff-4172-954a-08e812adb001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:57.982384 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df580fe-c5ff-4172-954a-08e812adb001 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:58.096656 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1348/2741] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:52:57 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:58.103903 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d86fd-aff4-4668-94ed-4113ef916f6e admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:58.111709 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d86fd-aff4-4668-94ed-4113ef916f6e admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:58.116627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546953e7-9e5f-4d76-9627-dce324e7411f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:58.117264 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546953e7-9e5f-4d76-9627-dce324e7411f admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:58.117553 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546953e7-9e5f-4d76-9627-dce324e7411f admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:58.117834 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546953e7-9e5f-4d76-9627-dce324e7411f admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:58.118574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546953e7-9e5f-4d76-9627-dce324e7411f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:58.120239 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546953e7-9e5f-4d76-9627-dce324e7411f admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:58.131242 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1394/2742] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:58.136777 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df580fe-c5ff-4172-954a-08e812adb001 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:58.147418 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df580fe-c5ff-4172-954a-08e812adb001 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:58.152792 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe086e34-d0f4-4045-81a0-6760b82a2fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:58.152792 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe086e34-d0f4-4045-81a0-6760b82a2fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:58.153058 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe086e34-d0f4-4045-81a0-6760b82a2fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:58.153194 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe086e34-d0f4-4045-81a0-6760b82a2fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:58.153892 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe086e34-d0f4-4045-81a0-6760b82a2fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:58.155533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe086e34-d0f4-4045-81a0-6760b82a2fe3 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:58.166938 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1349/2743] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:52:58.171133 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546953e7-9e5f-4d76-9627-dce324e7411f admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:58.181925 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546953e7-9e5f-4d76-9627-dce324e7411f admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:58.186595 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9df691-361e-4a2f-9684-85cd2ce745b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:58.187302 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9df691-361e-4a2f-9684-85cd2ce745b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:58.187603 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9df691-361e-4a2f-9684-85cd2ce745b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:58.187885 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9df691-361e-4a2f-9684-85cd2ce745b2 admin admin] PATH_INFO: `/v3/projects/985febd7475449c89c3e0706c91d20ff/users/3ba185b6e1924704b1baea9db6f9acb5/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:58.202895 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9df691-361e-4a2f-9684-85cd2ce745b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=985febd7475449c89c3e0706c91d20ff, user_id=3ba185b6e1924704b1baea9db6f9acb5, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:58.206117 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9df691-361e-4a2f-9684-85cd2ce745b2 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:58.296896 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1395/2744] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:52:58 2022] PUT /identity/v3/projects/985febd7475449c89c3e0706c91d20ff/users/3ba185b6e1924704b1baea9db6f9acb5/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:58.309087 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bed919-487e-4b0f-999c-fb553df5edc7 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:58.309380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bed919-487e-4b0f-999c-fb553df5edc7 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:58.309659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bed919-487e-4b0f-999c-fb553df5edc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:58.338867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-47bed919-487e-4b0f-999c-fb553df5edc7 None None] MFA Rules not processed for user `3ba185b6e1924704b1baea9db6f9acb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:58.373042 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-47bed919-487e-4b0f-999c-fb553df5edc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:58.403815 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1350/2745] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:52:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:52:58.416073 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9df691-361e-4a2f-9684-85cd2ce745b2 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:58.417796 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-8d9df691-361e-4a2f-9684-85cd2ce745b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:58.477808 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9df691-361e-4a2f-9684-85cd2ce745b2 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:58.481434 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8796bd7-20ab-4c20-b68c-cfd45fec4e43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:58.482077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8796bd7-20ab-4c20-b68c-cfd45fec4e43 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:58.482355 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8796bd7-20ab-4c20-b68c-cfd45fec4e43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:58.482627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8796bd7-20ab-4c20-b68c-cfd45fec4e43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:58.491615 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8796bd7-20ab-4c20-b68c-cfd45fec4e43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:58.493234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8796bd7-20ab-4c20-b68c-cfd45fec4e43 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:58.503001 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1396/2746] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:53:01.897016 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bed919-487e-4b0f-999c-fb553df5edc7 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:01.956552 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:01.984669 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bed919-487e-4b0f-999c-fb553df5edc7 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:01.991375 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f886e-14ad-49f2-8331-a985dd1923b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:01.991721 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f886e-14ad-49f2-8331-a985dd1923b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:01.992016 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f886e-14ad-49f2-8331-a985dd1923b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:01.992291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f886e-14ad-49f2-8331-a985dd1923b3 admin admin] PATH_INFO: `/v3/users/3ba185b6e1924704b1baea9db6f9acb5` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:01.993532 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f886e-14ad-49f2-8331-a985dd1923b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba185b6e1924704b1baea9db6f9acb5)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:01.995578 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f886e-14ad-49f2-8331-a985dd1923b3 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:02.276641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-742f886e-14ad-49f2-8331-a985dd1923b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba185b6e1924704b1baea9db6f9acb5'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:02.277328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-742f886e-14ad-49f2-8331-a985dd1923b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba185b6e1924704b1baea9db6f9acb5'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:02.394258 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-742f886e-14ad-49f2-8331-a985dd1923b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba185b6e1924704b1baea9db6f9acb5'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:02.413853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-742f886e-14ad-49f2-8331-a985dd1923b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba185b6e1924704b1baea9db6f9acb5'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:02.414516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-742f886e-14ad-49f2-8331-a985dd1923b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba185b6e1924704b1baea9db6f9acb5'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:02.427545 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1351/2747] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:53:01 2022] DELETE /identity/v3/users/3ba185b6e1924704b1baea9db6f9acb5 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:53:02.432211 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f587b-5449-40fd-b03d-f8fccec44a23 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:02.432717 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f587b-5449-40fd-b03d-f8fccec44a23 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:02.432886 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f587b-5449-40fd-b03d-f8fccec44a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:02.452831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-283f587b-5449-40fd-b03d-f8fccec44a23 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:02.454854 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-283f587b-5449-40fd-b03d-f8fccec44a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:02.520978 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1397/2748] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:53:02.532059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f886e-14ad-49f2-8331-a985dd1923b3 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:02.534396 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-742f886e-14ad-49f2-8331-a985dd1923b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:02.601577 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f886e-14ad-49f2-8331-a985dd1923b3 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:02.605821 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0808db-80b2-4867-8a85-ae56b8248917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:02.606461 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0808db-80b2-4867-8a85-ae56b8248917 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:02.606733 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0808db-80b2-4867-8a85-ae56b8248917 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:02.607022 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0808db-80b2-4867-8a85-ae56b8248917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:02.617459 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0808db-80b2-4867-8a85-ae56b8248917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:02.618916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0808db-80b2-4867-8a85-ae56b8248917 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:02.631595 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1352/2749] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:53:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:53:03.120205 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f587b-5449-40fd-b03d-f8fccec44a23 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:03.121655 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-283f587b-5449-40fd-b03d-f8fccec44a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:03.134913 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f587b-5449-40fd-b03d-f8fccec44a23 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:03.139836 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39228a-d751-42af-8177-73fbf5e108aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:03.140487 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39228a-d751-42af-8177-73fbf5e108aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:03.140771 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39228a-d751-42af-8177-73fbf5e108aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:03.141049 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39228a-d751-42af-8177-73fbf5e108aa admin admin] PATH_INFO: `/v3/projects/985febd7475449c89c3e0706c91d20ff` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:03.142991 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39228a-d751-42af-8177-73fbf5e108aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=985febd7475449c89c3e0706c91d20ff)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:03.145097 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39228a-d751-42af-8177-73fbf5e108aa admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:03.256843 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:03.270931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-5d39228a-d751-42af-8177-73fbf5e108aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985febd7475449c89c3e0706c91d20ff', 'request_id': 'req-5d39228a-d751-42af-8177-73fbf5e108aa'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:03.276623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-5d39228a-d751-42af-8177-73fbf5e108aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985febd7475449c89c3e0706c91d20ff', 'request_id': 'req-5d39228a-d751-42af-8177-73fbf5e108aa'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:03.382297 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-5d39228a-d751-42af-8177-73fbf5e108aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985febd7475449c89c3e0706c91d20ff', 'request_id': 'req-5d39228a-d751-42af-8177-73fbf5e108aa'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:03.396557 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-5d39228a-d751-42af-8177-73fbf5e108aa admin admin] The token cache is being invalidate because project 985febd7475449c89c3e0706c91d20ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:53:03.396942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-5d39228a-d751-42af-8177-73fbf5e108aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:03.397631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-5d39228a-d751-42af-8177-73fbf5e108aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:03.399219 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1398/2750] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:53:03 2022] DELETE /identity/v3/projects/985febd7475449c89c3e0706c91d20ff => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:53:10.717348 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0808db-80b2-4867-8a85-ae56b8248917 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:10.720181 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cf0808db-80b2-4867-8a85-ae56b8248917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:10.796831 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:10.802593 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0808db-80b2-4867-8a85-ae56b8248917 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:10.858859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba80c6-cb52-46d5-aad8-b8e04557a2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:10.859482 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba80c6-cb52-46d5-aad8-b8e04557a2f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:10.859811 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba80c6-cb52-46d5-aad8-b8e04557a2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:10.860089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba80c6-cb52-46d5-aad8-b8e04557a2f3 admin admin] PATH_INFO: `/v3/users/29c6d80970a647d3b806e25192721260` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:10.861273 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba80c6-cb52-46d5-aad8-b8e04557a2f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29c6d80970a647d3b806e25192721260)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:10.863199 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba80c6-cb52-46d5-aad8-b8e04557a2f3 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:11.043230 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4fba80c6-cb52-46d5-aad8-b8e04557a2f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29c6d80970a647d3b806e25192721260'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:11.043973 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4fba80c6-cb52-46d5-aad8-b8e04557a2f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29c6d80970a647d3b806e25192721260'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:11.158692 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4fba80c6-cb52-46d5-aad8-b8e04557a2f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29c6d80970a647d3b806e25192721260'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:11.172023 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4fba80c6-cb52-46d5-aad8-b8e04557a2f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29c6d80970a647d3b806e25192721260'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:11.172757 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-4fba80c6-cb52-46d5-aad8-b8e04557a2f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29c6d80970a647d3b806e25192721260'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:11.186890 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1353/2751] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:53:10 2022] DELETE /identity/v3/users/29c6d80970a647d3b806e25192721260 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:53:11.191612 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d297c7-7f5d-40c5-b393-a6ae16480771 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:11.192170 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d297c7-7f5d-40c5-b393-a6ae16480771 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:11.192170 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d297c7-7f5d-40c5-b393-a6ae16480771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:11.221839 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-a2d297c7-7f5d-40c5-b393-a6ae16480771 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:11.223068 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a2d297c7-7f5d-40c5-b393-a6ae16480771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:11.287203 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1399/2752] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:53:11.297076 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba80c6-cb52-46d5-aad8-b8e04557a2f3 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:11.298608 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4fba80c6-cb52-46d5-aad8-b8e04557a2f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:11.377693 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba80c6-cb52-46d5-aad8-b8e04557a2f3 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:11.382111 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66568f1-5e29-43a0-806a-d4ce5cb04352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:11.382748 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66568f1-5e29-43a0-806a-d4ce5cb04352 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:11.383033 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66568f1-5e29-43a0-806a-d4ce5cb04352 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:11.383342 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66568f1-5e29-43a0-806a-d4ce5cb04352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:11.393685 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66568f1-5e29-43a0-806a-d4ce5cb04352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:11.395290 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66568f1-5e29-43a0-806a-d4ce5cb04352 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:11.405385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1354/2753] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:53:11.783737 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d297c7-7f5d-40c5-b393-a6ae16480771 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:11.785829 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a2d297c7-7f5d-40c5-b393-a6ae16480771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:11.798697 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d297c7-7f5d-40c5-b393-a6ae16480771 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:11.804473 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970f0cf-b5fa-4c18-b3fa-bc3bd6494a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:11.807874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970f0cf-b5fa-4c18-b3fa-bc3bd6494a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:11.807874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970f0cf-b5fa-4c18-b3fa-bc3bd6494a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:11.807874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970f0cf-b5fa-4c18-b3fa-bc3bd6494a4f admin admin] PATH_INFO: `/v3/projects/28337803267c4622a85e204a9a310f50` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:11.807874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970f0cf-b5fa-4c18-b3fa-bc3bd6494a4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=28337803267c4622a85e204a9a310f50)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:11.808810 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970f0cf-b5fa-4c18-b3fa-bc3bd6494a4f admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:11.942128 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4970f0cf-b5fa-4c18-b3fa-bc3bd6494a4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28337803267c4622a85e204a9a310f50', 'request_id': 'req-4970f0cf-b5fa-4c18-b3fa-bc3bd6494a4f'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:11.947704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4970f0cf-b5fa-4c18-b3fa-bc3bd6494a4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28337803267c4622a85e204a9a310f50', 'request_id': 'req-4970f0cf-b5fa-4c18-b3fa-bc3bd6494a4f'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:12.044336 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4970f0cf-b5fa-4c18-b3fa-bc3bd6494a4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28337803267c4622a85e204a9a310f50', 'request_id': 'req-4970f0cf-b5fa-4c18-b3fa-bc3bd6494a4f'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:12.056521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4970f0cf-b5fa-4c18-b3fa-bc3bd6494a4f admin admin] The token cache is being invalidate because project 28337803267c4622a85e204a9a310f50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:53:12.056833 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4970f0cf-b5fa-4c18-b3fa-bc3bd6494a4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:12.057517 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-4970f0cf-b5fa-4c18-b3fa-bc3bd6494a4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:12.059206 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1400/2754] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:53:11 2022] DELETE /identity/v3/projects/28337803267c4622a85e204a9a310f50 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:53:12.064322 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56825ce9-97ee-46bf-ba0a-f02d46556743 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:12.064832 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56825ce9-97ee-46bf-ba0a-f02d46556743 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:12.064947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56825ce9-97ee-46bf-ba0a-f02d46556743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:12.075330 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:12.116072 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-56825ce9-97ee-46bf-ba0a-f02d46556743 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:12.117281 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-56825ce9-97ee-46bf-ba0a-f02d46556743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:12.177050 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1355/2755] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:53:12.245928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0d162-c2fa-4440-9218-5375c3e16c17 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:12.246504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0d162-c2fa-4440-9218-5375c3e16c17 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:12.246504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0d162-c2fa-4440-9218-5375c3e16c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:12.266039 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-5ef0d162-c2fa-4440-9218-5375c3e16c17 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:12.267240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5ef0d162-c2fa-4440-9218-5375c3e16c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:12.275760 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1401/2756] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:53:12.279891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56825ce9-97ee-46bf-ba0a-f02d46556743 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:12.290253 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56825ce9-97ee-46bf-ba0a-f02d46556743 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:12.294873 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56d19e-d0f4-4bc9-836b-c45e46e814cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:12.295515 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56d19e-d0f4-4bc9-836b-c45e46e814cc admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:12.295800 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56d19e-d0f4-4bc9-836b-c45e46e814cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:12.296078 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56d19e-d0f4-4bc9-836b-c45e46e814cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:12.297362 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56d19e-d0f4-4bc9-836b-c45e46e814cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:12.297675 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56d19e-d0f4-4bc9-836b-c45e46e814cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:12.299305 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56d19e-d0f4-4bc9-836b-c45e46e814cc admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:12.311861 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1356/2757] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:12.316135 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0d162-c2fa-4440-9218-5375c3e16c17 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:12.325946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0d162-c2fa-4440-9218-5375c3e16c17 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:12.331107 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f2cc3-7350-42bd-bb0c-48078f3190a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:12.331753 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f2cc3-7350-42bd-bb0c-48078f3190a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:12.332068 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f2cc3-7350-42bd-bb0c-48078f3190a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:12.332429 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f2cc3-7350-42bd-bb0c-48078f3190a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:12.333151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f2cc3-7350-42bd-bb0c-48078f3190a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:12.335069 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f2cc3-7350-42bd-bb0c-48078f3190a4 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:12.435935 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1402/2758] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:53:12 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:53:12.440565 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56d19e-d0f4-4bc9-836b-c45e46e814cc admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:12.452011 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56d19e-d0f4-4bc9-836b-c45e46e814cc admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:12.508628 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88486789-982b-40b6-8099-a3a95f4d8393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:12.509196 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88486789-982b-40b6-8099-a3a95f4d8393 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:12.509496 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88486789-982b-40b6-8099-a3a95f4d8393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:12.509749 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88486789-982b-40b6-8099-a3a95f4d8393 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:12.510405 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88486789-982b-40b6-8099-a3a95f4d8393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:12.512351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88486789-982b-40b6-8099-a3a95f4d8393 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:12.621943 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1357/2759] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:53:12 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:53:12.626142 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f2cc3-7350-42bd-bb0c-48078f3190a4 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:12.637694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f2cc3-7350-42bd-bb0c-48078f3190a4 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:12.642359 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6725ab-1c35-454d-abc3-ce32aa46a227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:12.642969 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6725ab-1c35-454d-abc3-ce32aa46a227 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:12.643256 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6725ab-1c35-454d-abc3-ce32aa46a227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:12.649757 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6725ab-1c35-454d-abc3-ce32aa46a227 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:12.649757 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6725ab-1c35-454d-abc3-ce32aa46a227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:12.649757 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6725ab-1c35-454d-abc3-ce32aa46a227 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:12.649757 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:12.656471 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1403/2760] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:53:12.660605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88486789-982b-40b6-8099-a3a95f4d8393 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:12.671200 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88486789-982b-40b6-8099-a3a95f4d8393 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:12.678502 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2831cb-8c8e-4ddd-9f6b-1de0ca62dd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:12.678502 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2831cb-8c8e-4ddd-9f6b-1de0ca62dd3a admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:12.678502 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2831cb-8c8e-4ddd-9f6b-1de0ca62dd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:12.678502 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2831cb-8c8e-4ddd-9f6b-1de0ca62dd3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:12.679031 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2831cb-8c8e-4ddd-9f6b-1de0ca62dd3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:12.680078 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2831cb-8c8e-4ddd-9f6b-1de0ca62dd3a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:12.691049 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1358/2761] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:53:12.697328 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6725ab-1c35-454d-abc3-ce32aa46a227 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:12.708033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6725ab-1c35-454d-abc3-ce32aa46a227 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:12.712947 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac574c16-9249-4f94-b906-9eca67584c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:12.713613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574c16-9249-4f94-b906-9eca67584c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:12.713899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574c16-9249-4f94-b906-9eca67584c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:12.714243 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574c16-9249-4f94-b906-9eca67584c34 admin admin] PATH_INFO: `/v3/projects/8be080744f514295a40f9ebab2a18fbf/users/ac6858df050e4488a4f8a7a608a04352/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:12.731620 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac574c16-9249-4f94-b906-9eca67584c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be080744f514295a40f9ebab2a18fbf, user_id=ac6858df050e4488a4f8a7a608a04352, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:12.734665 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac574c16-9249-4f94-b906-9eca67584c34 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:12.862618 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1404/2762] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:53:12 2022] PUT /identity/v3/projects/8be080744f514295a40f9ebab2a18fbf/users/ac6858df050e4488a4f8a7a608a04352/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:53:12.868536 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bdbcb-6967-4f2c-a29e-4bd66675df91 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:12.868830 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bdbcb-6967-4f2c-a29e-4bd66675df91 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:12.869139 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bdbcb-6967-4f2c-a29e-4bd66675df91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:12.889769 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-4b9bdbcb-6967-4f2c-a29e-4bd66675df91 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:12.891044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4b9bdbcb-6967-4f2c-a29e-4bd66675df91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:12.935136 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:12.950789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1359/2763] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:53:12.961722 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac574c16-9249-4f94-b906-9eca67584c34 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:12.963736 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ac574c16-9249-4f94-b906-9eca67584c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:13.021675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac574c16-9249-4f94-b906-9eca67584c34 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:13.025330 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7badef8-dd30-48d4-972d-f15c5e34968a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:13.025946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7badef8-dd30-48d4-972d-f15c5e34968a service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:13.026747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7badef8-dd30-48d4-972d-f15c5e34968a service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:13.026747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7badef8-dd30-48d4-972d-f15c5e34968a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:13.036247 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7badef8-dd30-48d4-972d-f15c5e34968a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:13.042976 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7badef8-dd30-48d4-972d-f15c5e34968a service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:13.047327 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1405/2764] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:53:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:53:18.361659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c147f9b-b7fe-4ba7-8b10-21da8dc8ce2c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:18.362154 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c147f9b-b7fe-4ba7-8b10-21da8dc8ce2c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:18.362397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c147f9b-b7fe-4ba7-8b10-21da8dc8ce2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:18.394396 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-4c147f9b-b7fe-4ba7-8b10-21da8dc8ce2c None None] MFA Rules not processed for user `ac6858df050e4488a4f8a7a608a04352`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:18.396394 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-4c147f9b-b7fe-4ba7-8b10-21da8dc8ce2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:18.476387 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1360/2765] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:53:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:53:18.481119 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7badef8-dd30-48d4-972d-f15c5e34968a service neutron] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:18.492659 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7badef8-dd30-48d4-972d-f15c5e34968a service neutron] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:18.497386 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b6f42-fb22-472d-a75f-bebac6013136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:18.498000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b6f42-fb22-472d-a75f-bebac6013136 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:18.498288 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b6f42-fb22-472d-a75f-bebac6013136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:18.498561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b6f42-fb22-472d-a75f-bebac6013136 admin admin] PATH_INFO: `/v3/projects` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:18.499232 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b6f42-fb22-472d-a75f-bebac6013136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:18.501243 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b6f42-fb22-472d-a75f-bebac6013136 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:18.595490 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1406/2766] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:53:18 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:53:18.599535 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c147f9b-b7fe-4ba7-8b10-21da8dc8ce2c None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:18.610668 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c147f9b-b7fe-4ba7-8b10-21da8dc8ce2c None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:18.671539 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6666584-5770-4ca6-86a1-9a35b9f7f430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:18.672160 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6666584-5770-4ca6-86a1-9a35b9f7f430 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:18.672441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6666584-5770-4ca6-86a1-9a35b9f7f430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:18.672710 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6666584-5770-4ca6-86a1-9a35b9f7f430 admin admin] PATH_INFO: `/v3/users` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:18.673391 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6666584-5770-4ca6-86a1-9a35b9f7f430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:18.675326 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6666584-5770-4ca6-86a1-9a35b9f7f430 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:18.740248 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1361/2767] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:53:18 2022] POST /identity/v3/users => generated 299 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:53:18.745704 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b6f42-fb22-472d-a75f-bebac6013136 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:18.757785 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b6f42-fb22-472d-a75f-bebac6013136 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:18.762707 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec8cc8-c01f-4d6e-a18d-6f1ac63f8fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:18.763383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec8cc8-c01f-4d6e-a18d-6f1ac63f8fdd admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:18.763669 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec8cc8-c01f-4d6e-a18d-6f1ac63f8fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:18.763946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec8cc8-c01f-4d6e-a18d-6f1ac63f8fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:18.764675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec8cc8-c01f-4d6e-a18d-6f1ac63f8fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:18.766403 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec8cc8-c01f-4d6e-a18d-6f1ac63f8fdd admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:18.780079 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1407/2768] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:53:18.787154 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6666584-5770-4ca6-86a1-9a35b9f7f430 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:18.800184 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6666584-5770-4ca6-86a1-9a35b9f7f430 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:18.805747 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d57c78-e694-4152-81c5-3e110c1878f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:18.806439 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d57c78-e694-4152-81c5-3e110c1878f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:18.806726 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d57c78-e694-4152-81c5-3e110c1878f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:18.807005 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d57c78-e694-4152-81c5-3e110c1878f8 admin admin] PATH_INFO: `/v3/projects/34b59d5317a84a828aaf1e4a4f146843/users/148c5d210a52406aae427d0bc0931801/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:18.822912 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d57c78-e694-4152-81c5-3e110c1878f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b59d5317a84a828aaf1e4a4f146843, user_id=148c5d210a52406aae427d0bc0931801, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:18.825841 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d57c78-e694-4152-81c5-3e110c1878f8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:18.913261 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1362/2769] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:53:18 2022] PUT /identity/v3/projects/34b59d5317a84a828aaf1e4a4f146843/users/148c5d210a52406aae427d0bc0931801/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:53:18.917687 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec8cc8-c01f-4d6e-a18d-6f1ac63f8fdd admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:18.928584 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec8cc8-c01f-4d6e-a18d-6f1ac63f8fdd admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:18.988160 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcacfd-2c5d-47c2-ba95-b03149d43631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:18.988802 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcacfd-2c5d-47c2-ba95-b03149d43631 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:18.989185 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcacfd-2c5d-47c2-ba95-b03149d43631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:18.989642 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcacfd-2c5d-47c2-ba95-b03149d43631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:18.990339 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcacfd-2c5d-47c2-ba95-b03149d43631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:18.991996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcacfd-2c5d-47c2-ba95-b03149d43631 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:19.005840 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1408/2770] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:53:19.009859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d57c78-e694-4152-81c5-3e110c1878f8 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:19.021190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d57c78-e694-4152-81c5-3e110c1878f8 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:19.028075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af1431-d4bc-436a-bd1a-3ef48e3175a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:19.029141 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af1431-d4bc-436a-bd1a-3ef48e3175a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:19.029275 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af1431-d4bc-436a-bd1a-3ef48e3175a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:19.029605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af1431-d4bc-436a-bd1a-3ef48e3175a5 admin admin] PATH_INFO: `/v3/projects/34b59d5317a84a828aaf1e4a4f146843/users/148c5d210a52406aae427d0bc0931801/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:19.031906 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af1431-d4bc-436a-bd1a-3ef48e3175a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b59d5317a84a828aaf1e4a4f146843, user_id=148c5d210a52406aae427d0bc0931801, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:19.034743 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af1431-d4bc-436a-bd1a-3ef48e3175a5 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:19.053385 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1363/2771] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:53:19 2022] PUT /identity/v3/projects/34b59d5317a84a828aaf1e4a4f146843/users/148c5d210a52406aae427d0bc0931801/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:53:24.154693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcacfd-2c5d-47c2-ba95-b03149d43631 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:24.156561 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-a2fcacfd-2c5d-47c2-ba95-b03149d43631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:24.212729 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:24.304395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcacfd-2c5d-47c2-ba95-b03149d43631 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:24.402458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e65a3-5402-4886-ab5b-0becd67a87d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa971da983ea48c3b6d4c68a5d454bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:24.403215 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e65a3-5402-4886-ab5b-0becd67a87d4 service placement] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:24.411588 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e65a3-5402-4886-ab5b-0becd67a87d4 service placement] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:24.411588 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e65a3-5402-4886-ab5b-0becd67a87d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:24.411588 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2e7e65a3-5402-4886-ab5b-0becd67a87d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:24.421225 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e65a3-5402-4886-ab5b-0becd67a87d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:24.423412 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e65a3-5402-4886-ab5b-0becd67a87d4 service placement] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:24.436504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1409/2772] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:53:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:53:25.268487 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686f1a3-1b88-42b7-98f0-08bf54004fad None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:25.269078 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686f1a3-1b88-42b7-98f0-08bf54004fad None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:25.269078 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686f1a3-1b88-42b7-98f0-08bf54004fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:25.304339 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-2686f1a3-1b88-42b7-98f0-08bf54004fad None None] MFA Rules not processed for user `148c5d210a52406aae427d0bc0931801`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:25.305611 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-2686f1a3-1b88-42b7-98f0-08bf54004fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:25.342947 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:25.421819 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1364/2773] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:53:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:53:25.434965 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e65a3-5402-4886-ab5b-0becd67a87d4 service placement] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:25.436720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2e7e65a3-5402-4886-ab5b-0becd67a87d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:25.501427 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e65a3-5402-4886-ab5b-0becd67a87d4 service placement] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:25.507244 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300fe08-4d6c-444b-b3fa-0bff37ff834e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49a34cd99ab47bb92af6ed2f82fefde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:25.508045 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300fe08-4d6c-444b-b3fa-0bff37ff834e service glance] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:25.508383 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300fe08-4d6c-444b-b3fa-0bff37ff834e service glance] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:25.508702 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300fe08-4d6c-444b-b3fa-0bff37ff834e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:25.594990 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300fe08-4d6c-444b-b3fa-0bff37ff834e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:25.596530 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300fe08-4d6c-444b-b3fa-0bff37ff834e service glance] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:25.607646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1410/2774] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:53:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:53:25.889346 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011b361-479b-44d3-b321-977783e95dcf None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:25.889666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011b361-479b-44d3-b321-977783e95dcf None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:25.889951 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011b361-479b-44d3-b321-977783e95dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:25.931559 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-9011b361-479b-44d3-b321-977783e95dcf None None] MFA Rules not processed for user `5b4c4184e87b4dc5a4047310cd0122ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:25.932401 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9011b361-479b-44d3-b321-977783e95dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:26.019900 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1365/2775] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 18:53:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:53:26.218344 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300fe08-4d6c-444b-b3fa-0bff37ff834e service glance] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:26.219803 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e300fe08-4d6c-444b-b3fa-0bff37ff834e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:26.227442 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:26.298677 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300fe08-4d6c-444b-b3fa-0bff37ff834e service glance] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:26.304680 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db4407-b5c3-4ea3-a0b1-aa254f74010a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7832398e97af4e539e10d1eef49f6d6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:26.305341 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db4407-b5c3-4ea3-a0b1-aa254f74010a service swift] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:26.310130 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db4407-b5c3-4ea3-a0b1-aa254f74010a service swift] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:26.310130 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db4407-b5c3-4ea3-a0b1-aa254f74010a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:26.316068 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db4407-b5c3-4ea3-a0b1-aa254f74010a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:26.318733 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db4407-b5c3-4ea3-a0b1-aa254f74010a service swift] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:26.328644 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1411/2776] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 18:53:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:53:36.010527 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=52 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:36.324623 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=30 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:36.573455 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a466f-07f5-4bea-8423-9f914817fa87 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:36.573740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a466f-07f5-4bea-8423-9f914817fa87 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:36.574016 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a466f-07f5-4bea-8423-9f914817fa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:36.593889 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-de0a466f-07f5-4bea-8423-9f914817fa87 None None] MFA Rules not processed for user `ac6858df050e4488a4f8a7a608a04352`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:36.595024 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-de0a466f-07f5-4bea-8423-9f914817fa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:36.602485 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1366/2777] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:53:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:53:40.711684 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863157a5-ab55-4d37-916e-75fa411c8a68 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:40.712254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863157a5-ab55-4d37-916e-75fa411c8a68 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:40.712254 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863157a5-ab55-4d37-916e-75fa411c8a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:40.738230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-863157a5-ab55-4d37-916e-75fa411c8a68 None None] MFA Rules not processed for user `5b4c4184e87b4dc5a4047310cd0122ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:40.739836 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-863157a5-ab55-4d37-916e-75fa411c8a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:40.748152 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1412/2778] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 18:53:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:53:40.762305 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a466f-07f5-4bea-8423-9f914817fa87 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:40.777086 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a466f-07f5-4bea-8423-9f914817fa87 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:40.782651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd859896-ad78-4631-92d0-acdb7aa12ddf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7832398e97af4e539e10d1eef49f6d6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:40.783351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd859896-ad78-4631-92d0-acdb7aa12ddf service swift] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:40.783771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd859896-ad78-4631-92d0-acdb7aa12ddf service swift] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:40.784086 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd859896-ad78-4631-92d0-acdb7aa12ddf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:40.794491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd859896-ad78-4631-92d0-acdb7aa12ddf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:40.796538 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd859896-ad78-4631-92d0-acdb7aa12ddf service swift] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:40.807310 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1367/2779] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 18:53:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:53:46.976600 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863157a5-ab55-4d37-916e-75fa411c8a68 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:46.978291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-863157a5-ab55-4d37-916e-75fa411c8a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:47.077616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863157a5-ab55-4d37-916e-75fa411c8a68 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:47.081806 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c9127-3149-47e3-a0da-9f5a7dc36707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:47.082569 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c9127-3149-47e3-a0da-9f5a7dc36707 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:47.082963 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c9127-3149-47e3-a0da-9f5a7dc36707 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:47.083396 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c9127-3149-47e3-a0da-9f5a7dc36707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:47.085412 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-860c9127-3149-47e3-a0da-9f5a7dc36707 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:47.183751 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c9127-3149-47e3-a0da-9f5a7dc36707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:47.185614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c9127-3149-47e3-a0da-9f5a7dc36707 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:47.205167 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1413/2780] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:53:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:53:50.310641 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd859896-ad78-4631-92d0-acdb7aa12ddf service swift] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:50.322906 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd859896-ad78-4631-92d0-acdb7aa12ddf service swift] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:50.328350 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621d4c0-a03c-4335-8194-ebeb71d0dec6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa971da983ea48c3b6d4c68a5d454bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:50.328965 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621d4c0-a03c-4335-8194-ebeb71d0dec6 service placement] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:50.329248 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621d4c0-a03c-4335-8194-ebeb71d0dec6 service placement] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:50.329534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621d4c0-a03c-4335-8194-ebeb71d0dec6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:50.331371 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b621d4c0-a03c-4335-8194-ebeb71d0dec6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:50.343705 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621d4c0-a03c-4335-8194-ebeb71d0dec6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:50.346737 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621d4c0-a03c-4335-8194-ebeb71d0dec6 service placement] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:50.366080 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1368/2781] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:53:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:53:50.457312 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c9127-3149-47e3-a0da-9f5a7dc36707 service neutron] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:50.459758 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-860c9127-3149-47e3-a0da-9f5a7dc36707 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:50.475594 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c9127-3149-47e3-a0da-9f5a7dc36707 service neutron] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:50.481110 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49af07-59c4-4edf-a4fa-34d44ffea201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:50.481535 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49af07-59c4-4edf-a4fa-34d44ffea201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:50.481715 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49af07-59c4-4edf-a4fa-34d44ffea201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:50.481991 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49af07-59c4-4edf-a4fa-34d44ffea201 admin admin] PATH_INFO: `/v3/users/868f014b54ad407e8c8f5656d1cc8484` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:50.483337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49af07-59c4-4edf-a4fa-34d44ffea201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=868f014b54ad407e8c8f5656d1cc8484)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:50.485528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49af07-59c4-4edf-a4fa-34d44ffea201 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:50.731214 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-1e49af07-59c4-4edf-a4fa-34d44ffea201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '868f014b54ad407e8c8f5656d1cc8484'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:50.731783 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-1e49af07-59c4-4edf-a4fa-34d44ffea201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '868f014b54ad407e8c8f5656d1cc8484'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:50.803727 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-1e49af07-59c4-4edf-a4fa-34d44ffea201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '868f014b54ad407e8c8f5656d1cc8484'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:50.827243 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-1e49af07-59c4-4edf-a4fa-34d44ffea201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '868f014b54ad407e8c8f5656d1cc8484'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:50.827243 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:50.827243 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-1e49af07-59c4-4edf-a4fa-34d44ffea201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '868f014b54ad407e8c8f5656d1cc8484'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:50.831711 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1414/2782] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:53:50 2022] DELETE /identity/v3/users/868f014b54ad407e8c8f5656d1cc8484 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:53:51.098000 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621d4c0-a03c-4335-8194-ebeb71d0dec6 service placement] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:51.105003 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621d4c0-a03c-4335-8194-ebeb71d0dec6 service placement] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:51.172080 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc608f79-2bca-402e-b738-4e18294847d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:51.172839 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc608f79-2bca-402e-b738-4e18294847d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:51.173111 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc608f79-2bca-402e-b738-4e18294847d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:51.173389 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc608f79-2bca-402e-b738-4e18294847d2 admin admin] PATH_INFO: `/v3/projects/f16dd5b6c48548a9909d6b2d9bef715f` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:51.174573 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc608f79-2bca-402e-b738-4e18294847d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f16dd5b6c48548a9909d6b2d9bef715f)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:51.176534 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc608f79-2bca-402e-b738-4e18294847d2 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:51.299483 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cc608f79-2bca-402e-b738-4e18294847d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f16dd5b6c48548a9909d6b2d9bef715f', 'request_id': 'req-cc608f79-2bca-402e-b738-4e18294847d2'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:51.306046 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cc608f79-2bca-402e-b738-4e18294847d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f16dd5b6c48548a9909d6b2d9bef715f', 'request_id': 'req-cc608f79-2bca-402e-b738-4e18294847d2'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:51.368399 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cc608f79-2bca-402e-b738-4e18294847d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f16dd5b6c48548a9909d6b2d9bef715f', 'request_id': 'req-cc608f79-2bca-402e-b738-4e18294847d2'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:51.380770 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cc608f79-2bca-402e-b738-4e18294847d2 admin admin] The token cache is being invalidate because project f16dd5b6c48548a9909d6b2d9bef715f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:53:51.381058 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cc608f79-2bca-402e-b738-4e18294847d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:51.381798 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-cc608f79-2bca-402e-b738-4e18294847d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:51.383809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1369/2783] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:53:51 2022] DELETE /identity/v3/projects/f16dd5b6c48548a9909d6b2d9bef715f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:53:51.388261 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49af07-59c4-4edf-a4fa-34d44ffea201 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:51.389981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-1e49af07-59c4-4edf-a4fa-34d44ffea201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:51.405648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49af07-59c4-4edf-a4fa-34d44ffea201 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:51.472336 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2e202-fdaf-4385-ba64-42b3d938be6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:51.473036 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2e202-fdaf-4385-ba64-42b3d938be6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:51.473250 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2e202-fdaf-4385-ba64-42b3d938be6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:51.473526 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2e202-fdaf-4385-ba64-42b3d938be6a admin admin] PATH_INFO: `/v3/users/646e798fdc7140aab56af751d180da45` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:51.474694 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2e202-fdaf-4385-ba64-42b3d938be6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=646e798fdc7140aab56af751d180da45)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:51.477295 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2e202-fdaf-4385-ba64-42b3d938be6a admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:51.665899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-99a2e202-fdaf-4385-ba64-42b3d938be6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '646e798fdc7140aab56af751d180da45'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:51.665899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-99a2e202-fdaf-4385-ba64-42b3d938be6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '646e798fdc7140aab56af751d180da45'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:51.740283 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-99a2e202-fdaf-4385-ba64-42b3d938be6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '646e798fdc7140aab56af751d180da45'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:51.753586 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-99a2e202-fdaf-4385-ba64-42b3d938be6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '646e798fdc7140aab56af751d180da45'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:51.760616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-99a2e202-fdaf-4385-ba64-42b3d938be6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '646e798fdc7140aab56af751d180da45'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:51.766772 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1415/2784] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:53:51 2022] DELETE /identity/v3/users/646e798fdc7140aab56af751d180da45 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:53:52.040541 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc608f79-2bca-402e-b738-4e18294847d2 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:52.041919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cc608f79-2bca-402e-b738-4e18294847d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:52.055156 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc608f79-2bca-402e-b738-4e18294847d2 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:52.113964 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:52.120793 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f03ab9-6f9a-4649-9c6f-4a68e29e4fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:52.121071 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f03ab9-6f9a-4649-9c6f-4a68e29e4fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:52.121357 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f03ab9-6f9a-4649-9c6f-4a68e29e4fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:52.121634 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f03ab9-6f9a-4649-9c6f-4a68e29e4fb4 admin admin] PATH_INFO: `/v3/projects/d1d735afd8e9406c86e926c8fddb783d` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:52.122967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f03ab9-6f9a-4649-9c6f-4a68e29e4fb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d735afd8e9406c86e926c8fddb783d)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:52.124802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f03ab9-6f9a-4649-9c6f-4a68e29e4fb4 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:52.247225 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-64f03ab9-6f9a-4649-9c6f-4a68e29e4fb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d735afd8e9406c86e926c8fddb783d', 'request_id': 'req-64f03ab9-6f9a-4649-9c6f-4a68e29e4fb4'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:52.253049 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-64f03ab9-6f9a-4649-9c6f-4a68e29e4fb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d735afd8e9406c86e926c8fddb783d', 'request_id': 'req-64f03ab9-6f9a-4649-9c6f-4a68e29e4fb4'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:52.368564 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-64f03ab9-6f9a-4649-9c6f-4a68e29e4fb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d735afd8e9406c86e926c8fddb783d', 'request_id': 'req-64f03ab9-6f9a-4649-9c6f-4a68e29e4fb4'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:52.380278 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-64f03ab9-6f9a-4649-9c6f-4a68e29e4fb4 admin admin] The token cache is being invalidate because project d1d735afd8e9406c86e926c8fddb783d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:53:52.380566 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-64f03ab9-6f9a-4649-9c6f-4a68e29e4fb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:52.381957 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-64f03ab9-6f9a-4649-9c6f-4a68e29e4fb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:53:52.384044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1370/2785] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:53:52 2022] DELETE /identity/v3/projects/d1d735afd8e9406c86e926c8fddb783d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:53:59.832521 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df84492-31e9-4b0a-97e5-edd9dd583d9e None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:59.833054 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df84492-31e9-4b0a-97e5-edd9dd583d9e None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:59.833054 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df84492-31e9-4b0a-97e5-edd9dd583d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:59.852340 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-5df84492-31e9-4b0a-97e5-edd9dd583d9e None None] MFA Rules not processed for user `7063b5053f164bba83cd0c17d66cbdff`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:59.853556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5df84492-31e9-4b0a-97e5-edd9dd583d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:59.908093 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1416/2786] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:53:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:54:02.614273 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:03.327528 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f03ab9-6f9a-4649-9c6f-4a68e29e4fb4 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:03.329882 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-64f03ab9-6f9a-4649-9c6f-4a68e29e4fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:54:03.394660 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f03ab9-6f9a-4649-9c6f-4a68e29e4fb4 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:03.398867 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0e6be-80e4-4d9b-8a1a-f7a1a0fbbf3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:03.399531 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0e6be-80e4-4d9b-8a1a-f7a1a0fbbf3f service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:03.399818 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0e6be-80e4-4d9b-8a1a-f7a1a0fbbf3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:03.400095 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0e6be-80e4-4d9b-8a1a-f7a1a0fbbf3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:03.402025 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-33a0e6be-80e4-4d9b-8a1a-f7a1a0fbbf3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:54:03.471497 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0e6be-80e4-4d9b-8a1a-f7a1a0fbbf3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:03.472949 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0e6be-80e4-4d9b-8a1a-f7a1a0fbbf3f service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:03.484153 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1371/2787] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:54:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:54:09.901440 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=80,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:13.480046 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=50 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:12.499306 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df84492-31e9-4b0a-97e5-edd9dd583d9e None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:12.500813 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5df84492-31e9-4b0a-97e5-edd9dd583d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:12.568894 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df84492-31e9-4b0a-97e5-edd9dd583d9e None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:12.574003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93ccf6-6ff3-4371-8465-2f42d96d5b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:12.574656 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93ccf6-6ff3-4371-8465-2f42d96d5b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:12.574967 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93ccf6-6ff3-4371-8465-2f42d96d5b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:12.575248 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93ccf6-6ff3-4371-8465-2f42d96d5b9d admin admin] PATH_INFO: `/v3/users/7063b5053f164bba83cd0c17d66cbdff` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:12.576508 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93ccf6-6ff3-4371-8465-2f42d96d5b9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7063b5053f164bba83cd0c17d66cbdff)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:12.578523 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93ccf6-6ff3-4371-8465-2f42d96d5b9d admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:12.768823 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ec93ccf6-6ff3-4371-8465-2f42d96d5b9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7063b5053f164bba83cd0c17d66cbdff'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:12.769401 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ec93ccf6-6ff3-4371-8465-2f42d96d5b9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7063b5053f164bba83cd0c17d66cbdff'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:12.841528 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ec93ccf6-6ff3-4371-8465-2f42d96d5b9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7063b5053f164bba83cd0c17d66cbdff'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:12.856642 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ec93ccf6-6ff3-4371-8465-2f42d96d5b9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7063b5053f164bba83cd0c17d66cbdff'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:12.864974 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-ec93ccf6-6ff3-4371-8465-2f42d96d5b9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7063b5053f164bba83cd0c17d66cbdff'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:12.871257 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1417/2788] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:55:12 2022] DELETE /identity/v3/users/7063b5053f164bba83cd0c17d66cbdff => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:13.174476 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0e6be-80e4-4d9b-8a1a-f7a1a0fbbf3f service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:13.186609 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0e6be-80e4-4d9b-8a1a-f7a1a0fbbf3f service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:13.255354 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d1ac8-d7eb-48a3-86fd-6823f3b00b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:13.256021 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d1ac8-d7eb-48a3-86fd-6823f3b00b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:13.256303 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d1ac8-d7eb-48a3-86fd-6823f3b00b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:13.256585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d1ac8-d7eb-48a3-86fd-6823f3b00b0d admin admin] PATH_INFO: `/v3/projects/52d2a291e9e94d30b7bb8f47d7506fb7` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:13.258882 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d1ac8-d7eb-48a3-86fd-6823f3b00b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=52d2a291e9e94d30b7bb8f47d7506fb7)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:13.260866 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d1ac8-d7eb-48a3-86fd-6823f3b00b0d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:13.362532 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8f7d1ac8-d7eb-48a3-86fd-6823f3b00b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52d2a291e9e94d30b7bb8f47d7506fb7', 'request_id': 'req-8f7d1ac8-d7eb-48a3-86fd-6823f3b00b0d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:13.368525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8f7d1ac8-d7eb-48a3-86fd-6823f3b00b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52d2a291e9e94d30b7bb8f47d7506fb7', 'request_id': 'req-8f7d1ac8-d7eb-48a3-86fd-6823f3b00b0d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:13.412967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8f7d1ac8-d7eb-48a3-86fd-6823f3b00b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52d2a291e9e94d30b7bb8f47d7506fb7', 'request_id': 'req-8f7d1ac8-d7eb-48a3-86fd-6823f3b00b0d'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:13.425549 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8f7d1ac8-d7eb-48a3-86fd-6823f3b00b0d admin admin] The token cache is being invalidate because project 52d2a291e9e94d30b7bb8f47d7506fb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:55:13.425775 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8f7d1ac8-d7eb-48a3-86fd-6823f3b00b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:13.426491 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8f7d1ac8-d7eb-48a3-86fd-6823f3b00b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:13.428107 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1372/2789] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:55:13 2022] DELETE /identity/v3/projects/52d2a291e9e94d30b7bb8f47d7506fb7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:13.433308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766e9af-3e09-4729-897a-464441e6982b None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:13.433709 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766e9af-3e09-4729-897a-464441e6982b None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:13.434010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766e9af-3e09-4729-897a-464441e6982b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:13.455324 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-b766e9af-3e09-4729-897a-464441e6982b None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:13.456650 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b766e9af-3e09-4729-897a-464441e6982b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:13.519118 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1418/2790] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:13.527634 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd807b64-fef1-48db-a57e-c3defab0b987 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:13.527927 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd807b64-fef1-48db-a57e-c3defab0b987 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:13.528205 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd807b64-fef1-48db-a57e-c3defab0b987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:13.549753 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-cd807b64-fef1-48db-a57e-c3defab0b987 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:13.550974 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-cd807b64-fef1-48db-a57e-c3defab0b987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:13.559358 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1373/2791] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:13.563781 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766e9af-3e09-4729-897a-464441e6982b None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:13.574201 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766e9af-3e09-4729-897a-464441e6982b None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:13.578703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669bd27-95d5-4660-b38e-51bcfc3535fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:13.579331 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669bd27-95d5-4660-b38e-51bcfc3535fb admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:13.579616 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669bd27-95d5-4660-b38e-51bcfc3535fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:13.579889 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669bd27-95d5-4660-b38e-51bcfc3535fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:13.580577 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669bd27-95d5-4660-b38e-51bcfc3535fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:13.580881 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669bd27-95d5-4660-b38e-51bcfc3535fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:13.583045 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669bd27-95d5-4660-b38e-51bcfc3535fb admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:13.594611 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1419/2792] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:13.599782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd807b64-fef1-48db-a57e-c3defab0b987 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:13.609091 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd807b64-fef1-48db-a57e-c3defab0b987 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:13.613713 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d974b9-f4b3-4aa8-bbf2-b4369824985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:13.614318 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d974b9-f4b3-4aa8-bbf2-b4369824985b admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:13.614600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d974b9-f4b3-4aa8-bbf2-b4369824985b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:13.614892 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d974b9-f4b3-4aa8-bbf2-b4369824985b admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:13.615631 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d974b9-f4b3-4aa8-bbf2-b4369824985b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:13.617549 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d974b9-f4b3-4aa8-bbf2-b4369824985b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:13.716530 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1374/2793] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:55:13 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:55:13.720686 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669bd27-95d5-4660-b38e-51bcfc3535fb admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:13.731291 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669bd27-95d5-4660-b38e-51bcfc3535fb admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:13.735244 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:13.787964 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5809a-023e-43c9-a474-a3f038f534a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:13.788576 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5809a-023e-43c9-a474-a3f038f534a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:13.788859 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5809a-023e-43c9-a474-a3f038f534a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:13.789139 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5809a-023e-43c9-a474-a3f038f534a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:13.789786 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5809a-023e-43c9-a474-a3f038f534a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:13.791738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5809a-023e-43c9-a474-a3f038f534a5 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:13.920938 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1420/2794] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:55:13 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:55:13.925278 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d974b9-f4b3-4aa8-bbf2-b4369824985b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:13.936115 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d974b9-f4b3-4aa8-bbf2-b4369824985b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:13.941397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce487cc2-6037-428a-a12b-62440d3df63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:13.941397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce487cc2-6037-428a-a12b-62440d3df63c admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:13.942156 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce487cc2-6037-428a-a12b-62440d3df63c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:13.942335 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce487cc2-6037-428a-a12b-62440d3df63c admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:13.943041 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce487cc2-6037-428a-a12b-62440d3df63c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:13.944786 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce487cc2-6037-428a-a12b-62440d3df63c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:13.955368 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1375/2795] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:55:13.960249 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5809a-023e-43c9-a474-a3f038f534a5 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:13.970645 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5809a-023e-43c9-a474-a3f038f534a5 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:13.975838 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3502d-40bd-444e-998f-6189c76715b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:13.976461 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3502d-40bd-444e-998f-6189c76715b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:13.976744 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3502d-40bd-444e-998f-6189c76715b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:13.977050 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3502d-40bd-444e-998f-6189c76715b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:13.977755 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3502d-40bd-444e-998f-6189c76715b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:13.979395 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3502d-40bd-444e-998f-6189c76715b5 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:13.990946 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1421/2796] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:55:13.994914 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce487cc2-6037-428a-a12b-62440d3df63c admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:14.006103 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce487cc2-6037-428a-a12b-62440d3df63c admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:14.010820 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8a73d-767e-4677-98f8-5129ce93a92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:14.011543 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8a73d-767e-4677-98f8-5129ce93a92f admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:14.011827 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8a73d-767e-4677-98f8-5129ce93a92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:14.012114 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8a73d-767e-4677-98f8-5129ce93a92f admin admin] PATH_INFO: `/v3/projects/e2926d35c9db425f95d2a1ac95e17a38/users/8c22f590aa564684ae75364311242403/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:14.028738 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8a73d-767e-4677-98f8-5129ce93a92f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2926d35c9db425f95d2a1ac95e17a38, user_id=8c22f590aa564684ae75364311242403, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:14.033171 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8a73d-767e-4677-98f8-5129ce93a92f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:14.133069 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1376/2797] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:55:13 2022] PUT /identity/v3/projects/e2926d35c9db425f95d2a1ac95e17a38/users/8c22f590aa564684ae75364311242403/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:55:14.144886 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7be5c-c03a-4154-8778-e731e96cf82b None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:14.145158 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7be5c-c03a-4154-8778-e731e96cf82b None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:14.145447 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7be5c-c03a-4154-8778-e731e96cf82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:14.173820 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-e7b7be5c-c03a-4154-8778-e731e96cf82b None None] MFA Rules not processed for user `8c22f590aa564684ae75364311242403`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:14.175053 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-e7b7be5c-c03a-4154-8778-e731e96cf82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:14.239774 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1422/2798] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:14.252401 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8a73d-767e-4677-98f8-5129ce93a92f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:14.254290 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e6f8a73d-767e-4677-98f8-5129ce93a92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:14.278971 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:14.367621 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8a73d-767e-4677-98f8-5129ce93a92f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:14.374834 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19278fda-afd7-4678-8220-5fad283d9042 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be769d4dd016466f9174e7d5e47a2a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:14.375665 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19278fda-afd7-4678-8220-5fad283d9042 service nova] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:14.376093 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19278fda-afd7-4678-8220-5fad283d9042 service nova] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:14.376485 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19278fda-afd7-4678-8220-5fad283d9042 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:14.385950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19278fda-afd7-4678-8220-5fad283d9042 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:14.387613 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19278fda-afd7-4678-8220-5fad283d9042 service nova] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:14.397291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1377/2799] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:55:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:55:14.630385 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7be5c-c03a-4154-8778-e731e96cf82b None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:14.705615 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7be5c-c03a-4154-8778-e731e96cf82b None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:14.710981 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a2d2c-fea8-4041-92a2-11617a435f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:14.711750 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a2d2c-fea8-4041-92a2-11617a435f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:14.712030 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a2d2c-fea8-4041-92a2-11617a435f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:14.712310 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a2d2c-fea8-4041-92a2-11617a435f3e admin admin] PATH_INFO: `/v3/users/8c22f590aa564684ae75364311242403` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:14.713506 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a2d2c-fea8-4041-92a2-11617a435f3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c22f590aa564684ae75364311242403)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:14.715495 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a2d2c-fea8-4041-92a2-11617a435f3e admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:14.732708 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:14.952587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-b04a2d2c-fea8-4041-92a2-11617a435f3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c22f590aa564684ae75364311242403'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:14.953305 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-b04a2d2c-fea8-4041-92a2-11617a435f3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c22f590aa564684ae75364311242403'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:15.036117 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-b04a2d2c-fea8-4041-92a2-11617a435f3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c22f590aa564684ae75364311242403'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:15.049062 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-b04a2d2c-fea8-4041-92a2-11617a435f3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c22f590aa564684ae75364311242403'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:15.057120 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-b04a2d2c-fea8-4041-92a2-11617a435f3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c22f590aa564684ae75364311242403'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:15.063542 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1423/2800] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:55:14 2022] DELETE /identity/v3/users/8c22f590aa564684ae75364311242403 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:15.068805 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd99ad-1ccb-4cef-899e-3ae962115b2e None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:15.069097 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd99ad-1ccb-4cef-899e-3ae962115b2e None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:15.069378 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd99ad-1ccb-4cef-899e-3ae962115b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:15.089017 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-c6cd99ad-1ccb-4cef-899e-3ae962115b2e None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:15.090229 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c6cd99ad-1ccb-4cef-899e-3ae962115b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:15.148773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1378/2801] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:15.158644 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a2d2c-fea8-4041-92a2-11617a435f3e admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:15.160076 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b04a2d2c-fea8-4041-92a2-11617a435f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:15.215479 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a2d2c-fea8-4041-92a2-11617a435f3e admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:15.219029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9091326-c062-4b21-ba35-2393095a74fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:15.219673 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9091326-c062-4b21-ba35-2393095a74fa service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:15.219952 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9091326-c062-4b21-ba35-2393095a74fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:15.220221 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9091326-c062-4b21-ba35-2393095a74fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:15.229941 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9091326-c062-4b21-ba35-2393095a74fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:15.231443 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9091326-c062-4b21-ba35-2393095a74fa service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:15.241997 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1424/2802] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:55:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:55:15.704533 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd99ad-1ccb-4cef-899e-3ae962115b2e None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:15.706000 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c6cd99ad-1ccb-4cef-899e-3ae962115b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:15.718583 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd99ad-1ccb-4cef-899e-3ae962115b2e None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:15.724011 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea8666-c1d6-44bd-84e5-9a47e9f02fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:15.724703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea8666-c1d6-44bd-84e5-9a47e9f02fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:15.725009 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea8666-c1d6-44bd-84e5-9a47e9f02fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:15.725288 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea8666-c1d6-44bd-84e5-9a47e9f02fc1 admin admin] PATH_INFO: `/v3/projects/e2926d35c9db425f95d2a1ac95e17a38` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:15.733714 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea8666-c1d6-44bd-84e5-9a47e9f02fc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2926d35c9db425f95d2a1ac95e17a38)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:15.733714 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea8666-c1d6-44bd-84e5-9a47e9f02fc1 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:15.877501 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-79ea8666-c1d6-44bd-84e5-9a47e9f02fc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2926d35c9db425f95d2a1ac95e17a38', 'request_id': 'req-79ea8666-c1d6-44bd-84e5-9a47e9f02fc1'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:15.883122 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-79ea8666-c1d6-44bd-84e5-9a47e9f02fc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2926d35c9db425f95d2a1ac95e17a38', 'request_id': 'req-79ea8666-c1d6-44bd-84e5-9a47e9f02fc1'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:15.966915 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-79ea8666-c1d6-44bd-84e5-9a47e9f02fc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2926d35c9db425f95d2a1ac95e17a38', 'request_id': 'req-79ea8666-c1d6-44bd-84e5-9a47e9f02fc1'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:15.979154 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-79ea8666-c1d6-44bd-84e5-9a47e9f02fc1 admin admin] The token cache is being invalidate because project e2926d35c9db425f95d2a1ac95e17a38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:55:15.979469 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-79ea8666-c1d6-44bd-84e5-9a47e9f02fc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:15.980171 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-79ea8666-c1d6-44bd-84e5-9a47e9f02fc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:15.981862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1379/2803] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:55:15 2022] DELETE /identity/v3/projects/e2926d35c9db425f95d2a1ac95e17a38 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:15.986543 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb4069-614a-492f-8149-87fb63246bed None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:15.987058 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb4069-614a-492f-8149-87fb63246bed None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:15.987175 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb4069-614a-492f-8149-87fb63246bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:16.007460 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-bbbb4069-614a-492f-8149-87fb63246bed None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:16.014726 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-bbbb4069-614a-492f-8149-87fb63246bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:16.068635 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1425/2804] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:16.077078 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcaf48-90ba-4129-8eb8-1b1ab3115bb6 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:16.077367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcaf48-90ba-4129-8eb8-1b1ab3115bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:16.077642 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcaf48-90ba-4129-8eb8-1b1ab3115bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:16.091928 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:16.097307 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-f3fcaf48-90ba-4129-8eb8-1b1ab3115bb6 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:16.103383 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-f3fcaf48-90ba-4129-8eb8-1b1ab3115bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:16.106978 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1380/2805] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:16.111238 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb4069-614a-492f-8149-87fb63246bed None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:16.121746 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb4069-614a-492f-8149-87fb63246bed None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:16.126393 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f4d5f-0fa1-45de-8044-b6cd8c2b475a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:16.129919 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f4d5f-0fa1-45de-8044-b6cd8c2b475a admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:16.129919 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f4d5f-0fa1-45de-8044-b6cd8c2b475a admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:16.129919 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f4d5f-0fa1-45de-8044-b6cd8c2b475a admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:16.129919 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f4d5f-0fa1-45de-8044-b6cd8c2b475a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:16.129919 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f4d5f-0fa1-45de-8044-b6cd8c2b475a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:16.130723 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f4d5f-0fa1-45de-8044-b6cd8c2b475a admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:16.142491 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1426/2806] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:16.146971 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcaf48-90ba-4129-8eb8-1b1ab3115bb6 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:16.156102 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcaf48-90ba-4129-8eb8-1b1ab3115bb6 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:16.161285 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d074195-314e-4093-b022-443d796f97d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:16.161892 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d074195-314e-4093-b022-443d796f97d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:16.162173 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d074195-314e-4093-b022-443d796f97d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:16.162442 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d074195-314e-4093-b022-443d796f97d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:16.163102 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d074195-314e-4093-b022-443d796f97d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:16.165076 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d074195-314e-4093-b022-443d796f97d7 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:16.283370 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1381/2807] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:55:16 2022] POST /identity/v3/projects => generated 405 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:55:16.288237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f4d5f-0fa1-45de-8044-b6cd8c2b475a admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:16.298274 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f4d5f-0fa1-45de-8044-b6cd8c2b475a admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:16.319707 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:16.357467 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9dc1fe-2d7c-456d-9302-919a8b479bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:16.358089 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dc1fe-2d7c-456d-9302-919a8b479bbb admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:16.358371 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dc1fe-2d7c-456d-9302-919a8b479bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:16.358648 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dc1fe-2d7c-456d-9302-919a8b479bbb admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:16.359335 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9dc1fe-2d7c-456d-9302-919a8b479bbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:16.361250 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9dc1fe-2d7c-456d-9302-919a8b479bbb admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:16.487178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1427/2808] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:55:16 2022] POST /identity/v3/users => generated 303 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:55:16.491940 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d074195-314e-4093-b022-443d796f97d7 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:16.502310 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d074195-314e-4093-b022-443d796f97d7 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:16.507150 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5937a8-ca0a-48e7-9920-f7493187759b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:16.507793 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5937a8-ca0a-48e7-9920-f7493187759b admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:16.508174 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5937a8-ca0a-48e7-9920-f7493187759b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:16.508472 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5937a8-ca0a-48e7-9920-f7493187759b admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:16.509185 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5937a8-ca0a-48e7-9920-f7493187759b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:16.510779 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5937a8-ca0a-48e7-9920-f7493187759b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:16.521791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1382/2809] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:55:16.526024 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9dc1fe-2d7c-456d-9302-919a8b479bbb admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:16.537154 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9dc1fe-2d7c-456d-9302-919a8b479bbb admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:16.542001 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8bb79-07a6-4df8-8c9f-f4179522addf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:16.542755 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8bb79-07a6-4df8-8c9f-f4179522addf admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:16.543307 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8bb79-07a6-4df8-8c9f-f4179522addf admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:16.543603 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8bb79-07a6-4df8-8c9f-f4179522addf admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:16.544446 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8bb79-07a6-4df8-8c9f-f4179522addf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:16.546523 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8bb79-07a6-4df8-8c9f-f4179522addf admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:16.557409 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1428/2810] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:55:16.562117 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5937a8-ca0a-48e7-9920-f7493187759b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:16.572906 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5937a8-ca0a-48e7-9920-f7493187759b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:16.577690 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeeb6bb-c46e-4371-9c76-61fa645e9f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:16.578368 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeeb6bb-c46e-4371-9c76-61fa645e9f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:16.578650 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeeb6bb-c46e-4371-9c76-61fa645e9f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:16.578929 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeeb6bb-c46e-4371-9c76-61fa645e9f92 admin admin] PATH_INFO: `/v3/projects/22c7ab5d46284d16b1380b6bd5733a26/users/637ce930b8df48ab8664751e37a2fb92/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:16.594441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeeb6bb-c46e-4371-9c76-61fa645e9f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c7ab5d46284d16b1380b6bd5733a26, user_id=637ce930b8df48ab8664751e37a2fb92, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:16.597668 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeeb6bb-c46e-4371-9c76-61fa645e9f92 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:16.652589 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1383/2811] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:55:16 2022] PUT /identity/v3/projects/22c7ab5d46284d16b1380b6bd5733a26/users/637ce930b8df48ab8664751e37a2fb92/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:16.657713 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf105d7-3441-45c9-86df-d02c317b7527 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:16.658009 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf105d7-3441-45c9-86df-d02c317b7527 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:16.658310 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf105d7-3441-45c9-86df-d02c317b7527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:16.677755 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-6cf105d7-3441-45c9-86df-d02c317b7527 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:16.678956 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-6cf105d7-3441-45c9-86df-d02c317b7527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:16.738619 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1429/2812] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:16.748444 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeeb6bb-c46e-4371-9c76-61fa645e9f92 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:16.750267 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-3aeeb6bb-c46e-4371-9c76-61fa645e9f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:16.809524 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeeb6bb-c46e-4371-9c76-61fa645e9f92 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:16.813203 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ccced-0748-4b21-8db4-868f1cdec87a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:16.813819 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ccced-0748-4b21-8db4-868f1cdec87a service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:16.814224 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ccced-0748-4b21-8db4-868f1cdec87a service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:16.814508 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ccced-0748-4b21-8db4-868f1cdec87a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:16.824958 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ccced-0748-4b21-8db4-868f1cdec87a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:16.826402 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ccced-0748-4b21-8db4-868f1cdec87a service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:16.836730 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1384/2813] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:55:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:55:18.174201 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d6780-8f60-4b58-ad95-0dfadf32d174 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:18.174795 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d6780-8f60-4b58-ad95-0dfadf32d174 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:18.174795 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d6780-8f60-4b58-ad95-0dfadf32d174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:18.204550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-420d6780-8f60-4b58-ad95-0dfadf32d174 None None] MFA Rules not processed for user `637ce930b8df48ab8664751e37a2fb92`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:18.205777 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-420d6780-8f60-4b58-ad95-0dfadf32d174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:18.275804 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1430/2814] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:18 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:18.280437 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ccced-0748-4b21-8db4-868f1cdec87a service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:18.291463 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ccced-0748-4b21-8db4-868f1cdec87a service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:18.296605 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dce1d-5060-467d-ad78-87b3bc62f1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:18.297280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dce1d-5060-467d-ad78-87b3bc62f1dc admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:18.297570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dce1d-5060-467d-ad78-87b3bc62f1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:18.297846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dce1d-5060-467d-ad78-87b3bc62f1dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:18.298545 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036dce1d-5060-467d-ad78-87b3bc62f1dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:18.300513 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036dce1d-5060-467d-ad78-87b3bc62f1dc admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:18.407857 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1385/2815] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:55:18 2022] POST /identity/v3/projects => generated 403 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:55:18.409643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d6780-8f60-4b58-ad95-0dfadf32d174 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:18.421742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d6780-8f60-4b58-ad95-0dfadf32d174 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:18.442067 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dce1d-5060-467d-ad78-87b3bc62f1dc admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:18.455030 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:18.483034 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4d319-9781-4be9-9aaf-b0575ed4decd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:18.483693 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4d319-9781-4be9-9aaf-b0575ed4decd admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:18.483971 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4d319-9781-4be9-9aaf-b0575ed4decd admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:18.484246 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4d319-9781-4be9-9aaf-b0575ed4decd admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:18.484936 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4d319-9781-4be9-9aaf-b0575ed4decd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:18.486896 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4d319-9781-4be9-9aaf-b0575ed4decd admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:18.502916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dce1d-5060-467d-ad78-87b3bc62f1dc admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:18.507416 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6c202-a4ef-46c2-891c-e886ac9b0e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:18.508105 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6c202-a4ef-46c2-891c-e886ac9b0e84 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:18.508390 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6c202-a4ef-46c2-891c-e886ac9b0e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:18.508668 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6c202-a4ef-46c2-891c-e886ac9b0e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:18.510516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e1c6c202-a4ef-46c2-891c-e886ac9b0e84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:18.550099 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:18.581933 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1431/2816] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:55:18 2022] POST /identity/v3/users => generated 308 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:55:18.584033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4d319-9781-4be9-9aaf-b0575ed4decd admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:18.584586 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6c202-a4ef-46c2-891c-e886ac9b0e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:18.586091 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6c202-a4ef-46c2-891c-e886ac9b0e84 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:18.594504 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4d319-9781-4be9-9aaf-b0575ed4decd admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:18.597424 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1386/2817] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:55:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:55:18.600054 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bfe21-f33e-4677-b9d5-05aeef07f40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:18.600683 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bfe21-f33e-4677-b9d5-05aeef07f40c admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:18.600968 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bfe21-f33e-4677-b9d5-05aeef07f40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:18.601245 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bfe21-f33e-4677-b9d5-05aeef07f40c admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:18.602068 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bfe21-f33e-4677-b9d5-05aeef07f40c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:18.603804 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bfe21-f33e-4677-b9d5-05aeef07f40c admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:18.614790 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1432/2818] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:55:18.619191 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6c202-a4ef-46c2-891c-e886ac9b0e84 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:18.630900 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6c202-a4ef-46c2-891c-e886ac9b0e84 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:18.637666 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d8146-4475-436c-a279-b1d9cefd39f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:18.638301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d8146-4475-436c-a279-b1d9cefd39f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:18.638590 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d8146-4475-436c-a279-b1d9cefd39f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:18.638875 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d8146-4475-436c-a279-b1d9cefd39f1 admin admin] PATH_INFO: `/v3/projects/4cfde8f46e8b43d9b1af787a801910a8/users/4a2eaf70576c4befb2a3dcf9b1a67ac4/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:18.655938 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d8146-4475-436c-a279-b1d9cefd39f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cfde8f46e8b43d9b1af787a801910a8, user_id=4a2eaf70576c4befb2a3dcf9b1a67ac4, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:18.658629 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d8146-4475-436c-a279-b1d9cefd39f1 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:18.761612 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1387/2819] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:55:18 2022] PUT /identity/v3/projects/4cfde8f46e8b43d9b1af787a801910a8/users/4a2eaf70576c4befb2a3dcf9b1a67ac4/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:18.766082 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bfe21-f33e-4677-b9d5-05aeef07f40c admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:18.776900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bfe21-f33e-4677-b9d5-05aeef07f40c admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:18.838691 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9eb2e-4792-4495-a95b-713942b3aad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:18.846739 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9eb2e-4792-4495-a95b-713942b3aad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:18.846739 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9eb2e-4792-4495-a95b-713942b3aad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:18.846739 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9eb2e-4792-4495-a95b-713942b3aad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:18.846739 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9eb2e-4792-4495-a95b-713942b3aad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:18.846739 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9eb2e-4792-4495-a95b-713942b3aad6 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:18.853184 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1433/2820] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:55:18.857555 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d8146-4475-436c-a279-b1d9cefd39f1 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:18.868305 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d8146-4475-436c-a279-b1d9cefd39f1 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:18.873113 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c324d77-e0bb-4a9c-9f36-b41a76353e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:18.874159 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c324d77-e0bb-4a9c-9f36-b41a76353e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:18.874159 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c324d77-e0bb-4a9c-9f36-b41a76353e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:18.874383 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c324d77-e0bb-4a9c-9f36-b41a76353e95 admin admin] PATH_INFO: `/v3/projects/4cfde8f46e8b43d9b1af787a801910a8/users/4a2eaf70576c4befb2a3dcf9b1a67ac4/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:18.876703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c324d77-e0bb-4a9c-9f36-b41a76353e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cfde8f46e8b43d9b1af787a801910a8, user_id=4a2eaf70576c4befb2a3dcf9b1a67ac4, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:18.881098 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c324d77-e0bb-4a9c-9f36-b41a76353e95 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:18.892420 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1388/2821] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:55:18 2022] PUT /identity/v3/projects/4cfde8f46e8b43d9b1af787a801910a8/users/4a2eaf70576c4befb2a3dcf9b1a67ac4/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:20.703255 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d924acb-beb5-46a4-a300-111e79ff2c04 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:20.704088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d924acb-beb5-46a4-a300-111e79ff2c04 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:20.704088 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d924acb-beb5-46a4-a300-111e79ff2c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:20.739075 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-8d924acb-beb5-46a4-a300-111e79ff2c04 None None] MFA Rules not processed for user `4a2eaf70576c4befb2a3dcf9b1a67ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:20.740584 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-8d924acb-beb5-46a4-a300-111e79ff2c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:20.821298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1434/2822] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:20 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:22.512780 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c324d77-e0bb-4a9c-9f36-b41a76353e95 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:22.514562 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-6c324d77-e0bb-4a9c-9f36-b41a76353e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:22.628363 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c324d77-e0bb-4a9c-9f36-b41a76353e95 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:22.629939 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6623bb-8fba-4913-bff1-6b049ef3f713 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:22.632281 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6623bb-8fba-4913-bff1-6b049ef3f713 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:22.632574 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6623bb-8fba-4913-bff1-6b049ef3f713 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:22.632858 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6623bb-8fba-4913-bff1-6b049ef3f713 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:22.636083 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-9e6623bb-8fba-4913-bff1-6b049ef3f713 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:22.722510 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d924acb-beb5-46a4-a300-111e79ff2c04 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:22.736459 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6623bb-8fba-4913-bff1-6b049ef3f713 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:22.738888 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6623bb-8fba-4913-bff1-6b049ef3f713 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:22.755173 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1389/2823] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:55:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:55:22.781924 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:22.821858 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d924acb-beb5-46a4-a300-111e79ff2c04 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:22.834717 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdeb47-514a-4700-8a05-ace55eaec89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:22.835489 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdeb47-514a-4700-8a05-ace55eaec89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:22.835773 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdeb47-514a-4700-8a05-ace55eaec89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:22.836114 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdeb47-514a-4700-8a05-ace55eaec89a admin admin] PATH_INFO: `/v3/users/637ce930b8df48ab8664751e37a2fb92` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:22.838401 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffdeb47-514a-4700-8a05-ace55eaec89a admin admin] RBAC: Authorizing `identity:delete_user(user_id=637ce930b8df48ab8664751e37a2fb92)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:22.843967 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffdeb47-514a-4700-8a05-ace55eaec89a admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:23.180121 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-5ffdeb47-514a-4700-8a05-ace55eaec89a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '637ce930b8df48ab8664751e37a2fb92'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:23.180822 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-5ffdeb47-514a-4700-8a05-ace55eaec89a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '637ce930b8df48ab8664751e37a2fb92'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:23.303401 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-5ffdeb47-514a-4700-8a05-ace55eaec89a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '637ce930b8df48ab8664751e37a2fb92'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:23.319488 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-5ffdeb47-514a-4700-8a05-ace55eaec89a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '637ce930b8df48ab8664751e37a2fb92'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:23.327722 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-5ffdeb47-514a-4700-8a05-ace55eaec89a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '637ce930b8df48ab8664751e37a2fb92'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:23.335077 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1435/2824] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:55:22 2022] DELETE /identity/v3/users/637ce930b8df48ab8664751e37a2fb92 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:55:23.607583 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6623bb-8fba-4913-bff1-6b049ef3f713 service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:23.623069 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6623bb-8fba-4913-bff1-6b049ef3f713 service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:23.629891 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:23.695080 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d133c82-0ef2-4bd5-b8e7-dfb3477b5da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:23.696411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d133c82-0ef2-4bd5-b8e7-dfb3477b5da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:23.696411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d133c82-0ef2-4bd5-b8e7-dfb3477b5da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:23.696663 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d133c82-0ef2-4bd5-b8e7-dfb3477b5da7 admin admin] PATH_INFO: `/v3/projects/22c7ab5d46284d16b1380b6bd5733a26` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:23.697799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d133c82-0ef2-4bd5-b8e7-dfb3477b5da7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c7ab5d46284d16b1380b6bd5733a26)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:23.699768 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d133c82-0ef2-4bd5-b8e7-dfb3477b5da7 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:23.821723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8d133c82-0ef2-4bd5-b8e7-dfb3477b5da7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c7ab5d46284d16b1380b6bd5733a26', 'request_id': 'req-8d133c82-0ef2-4bd5-b8e7-dfb3477b5da7'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:23.827667 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8d133c82-0ef2-4bd5-b8e7-dfb3477b5da7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c7ab5d46284d16b1380b6bd5733a26', 'request_id': 'req-8d133c82-0ef2-4bd5-b8e7-dfb3477b5da7'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:23.897014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8d133c82-0ef2-4bd5-b8e7-dfb3477b5da7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c7ab5d46284d16b1380b6bd5733a26', 'request_id': 'req-8d133c82-0ef2-4bd5-b8e7-dfb3477b5da7'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:23.909148 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8d133c82-0ef2-4bd5-b8e7-dfb3477b5da7 admin admin] The token cache is being invalidate because project 22c7ab5d46284d16b1380b6bd5733a26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:55:23.909440 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8d133c82-0ef2-4bd5-b8e7-dfb3477b5da7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:23.910201 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-8d133c82-0ef2-4bd5-b8e7-dfb3477b5da7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:23.912193 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1390/2825] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:55:23 2022] DELETE /identity/v3/projects/22c7ab5d46284d16b1380b6bd5733a26 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:23.916237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdeb47-514a-4700-8a05-ace55eaec89a admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:23.917643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-5ffdeb47-514a-4700-8a05-ace55eaec89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:23.932095 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdeb47-514a-4700-8a05-ace55eaec89a admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:23.997349 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212a210-91e0-4263-b733-d2acf5d542be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:23.997915 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212a210-91e0-4263-b733-d2acf5d542be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:23.998200 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212a210-91e0-4263-b733-d2acf5d542be admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:23.998495 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212a210-91e0-4263-b733-d2acf5d542be admin admin] PATH_INFO: `/v3/users/4a2eaf70576c4befb2a3dcf9b1a67ac4` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:23.999748 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212a210-91e0-4263-b733-d2acf5d542be admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a2eaf70576c4befb2a3dcf9b1a67ac4)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:24.001690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212a210-91e0-4263-b733-d2acf5d542be admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:24.156989 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d212a210-91e0-4263-b733-d2acf5d542be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a2eaf70576c4befb2a3dcf9b1a67ac4'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:24.157761 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d212a210-91e0-4263-b733-d2acf5d542be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a2eaf70576c4befb2a3dcf9b1a67ac4'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:24.229407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d212a210-91e0-4263-b733-d2acf5d542be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a2eaf70576c4befb2a3dcf9b1a67ac4'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:24.230883 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:24.244111 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d212a210-91e0-4263-b733-d2acf5d542be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a2eaf70576c4befb2a3dcf9b1a67ac4'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:24.252350 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-d212a210-91e0-4263-b733-d2acf5d542be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a2eaf70576c4befb2a3dcf9b1a67ac4'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:24.259015 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1436/2826] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:55:23 2022] DELETE /identity/v3/users/4a2eaf70576c4befb2a3dcf9b1a67ac4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:24.499453 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d133c82-0ef2-4bd5-b8e7-dfb3477b5da7 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:24.500933 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8d133c82-0ef2-4bd5-b8e7-dfb3477b5da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:24.550222 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d133c82-0ef2-4bd5-b8e7-dfb3477b5da7 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:24.577699 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80412553-4f68-48a7-a39b-b19e2a9facb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:24.578355 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80412553-4f68-48a7-a39b-b19e2a9facb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:24.578639 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80412553-4f68-48a7-a39b-b19e2a9facb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:24.578921 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80412553-4f68-48a7-a39b-b19e2a9facb8 admin admin] PATH_INFO: `/v3/projects/4cfde8f46e8b43d9b1af787a801910a8` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:24.580124 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80412553-4f68-48a7-a39b-b19e2a9facb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cfde8f46e8b43d9b1af787a801910a8)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:24.582207 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80412553-4f68-48a7-a39b-b19e2a9facb8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:24.721644 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:24.729707 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-80412553-4f68-48a7-a39b-b19e2a9facb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cfde8f46e8b43d9b1af787a801910a8', 'request_id': 'req-80412553-4f68-48a7-a39b-b19e2a9facb8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:24.735380 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-80412553-4f68-48a7-a39b-b19e2a9facb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cfde8f46e8b43d9b1af787a801910a8', 'request_id': 'req-80412553-4f68-48a7-a39b-b19e2a9facb8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:24.835498 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-80412553-4f68-48a7-a39b-b19e2a9facb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cfde8f46e8b43d9b1af787a801910a8', 'request_id': 'req-80412553-4f68-48a7-a39b-b19e2a9facb8'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:24.847415 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-80412553-4f68-48a7-a39b-b19e2a9facb8 admin admin] The token cache is being invalidate because project 4cfde8f46e8b43d9b1af787a801910a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:55:24.847705 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-80412553-4f68-48a7-a39b-b19e2a9facb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:24.848370 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-80412553-4f68-48a7-a39b-b19e2a9facb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:24.849916 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1391/2827] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:55:24 2022] DELETE /identity/v3/projects/4cfde8f46e8b43d9b1af787a801910a8 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:24.854912 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df446753-eb48-4c2a-8a69-072f848436aa None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:24.855204 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df446753-eb48-4c2a-8a69-072f848436aa None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:24.855517 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df446753-eb48-4c2a-8a69-072f848436aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:24.875093 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-df446753-eb48-4c2a-8a69-072f848436aa None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:24.876337 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-df446753-eb48-4c2a-8a69-072f848436aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:24.936380 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1437/2828] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:24.945089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52804d33-4888-4168-9b32-963a05eac210 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:24.945377 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52804d33-4888-4168-9b32-963a05eac210 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:24.945659 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52804d33-4888-4168-9b32-963a05eac210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:24.966884 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-52804d33-4888-4168-9b32-963a05eac210 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:24.968148 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-52804d33-4888-4168-9b32-963a05eac210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:24.976077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1392/2829] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:24.980591 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df446753-eb48-4c2a-8a69-072f848436aa None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:24.990587 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df446753-eb48-4c2a-8a69-072f848436aa None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:24.995286 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ca4fc-e19f-4ca5-a3f9-871e80ab024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:24.995904 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ca4fc-e19f-4ca5-a3f9-871e80ab024d admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:24.996191 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ca4fc-e19f-4ca5-a3f9-871e80ab024d admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:24.996468 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ca4fc-e19f-4ca5-a3f9-871e80ab024d admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:24.997165 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ca4fc-e19f-4ca5-a3f9-871e80ab024d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:24.997475 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ca4fc-e19f-4ca5-a3f9-871e80ab024d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:24.999122 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ca4fc-e19f-4ca5-a3f9-871e80ab024d admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:25.011369 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1438/2830] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:25.015874 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52804d33-4888-4168-9b32-963a05eac210 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:25.025818 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52804d33-4888-4168-9b32-963a05eac210 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:25.030459 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc61578-7aa0-4f13-8cf4-8abc0b448aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:25.031066 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc61578-7aa0-4f13-8cf4-8abc0b448aaa admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:25.031379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc61578-7aa0-4f13-8cf4-8abc0b448aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:25.031654 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc61578-7aa0-4f13-8cf4-8abc0b448aaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:25.032312 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc61578-7aa0-4f13-8cf4-8abc0b448aaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:25.034281 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc61578-7aa0-4f13-8cf4-8abc0b448aaa admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:25.123691 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1393/2831] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:55:25 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:55:25.128008 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ca4fc-e19f-4ca5-a3f9-871e80ab024d admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:25.139816 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ca4fc-e19f-4ca5-a3f9-871e80ab024d admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:25.197319 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23feb6e-78ed-4df9-9cef-ba2e36221ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:25.197933 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23feb6e-78ed-4df9-9cef-ba2e36221ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:25.198216 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23feb6e-78ed-4df9-9cef-ba2e36221ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:25.198492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23feb6e-78ed-4df9-9cef-ba2e36221ec8 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:25.199164 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23feb6e-78ed-4df9-9cef-ba2e36221ec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:25.201126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23feb6e-78ed-4df9-9cef-ba2e36221ec8 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:25.332808 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1439/2832] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:55:25 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:55:25.337234 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc61578-7aa0-4f13-8cf4-8abc0b448aaa admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:25.347842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc61578-7aa0-4f13-8cf4-8abc0b448aaa admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:25.356492 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e69a57-8091-4add-bc6b-69a657389dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:25.360737 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e69a57-8091-4add-bc6b-69a657389dea admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:25.360737 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e69a57-8091-4add-bc6b-69a657389dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:25.360737 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e69a57-8091-4add-bc6b-69a657389dea admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:25.360737 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e69a57-8091-4add-bc6b-69a657389dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:25.360737 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e69a57-8091-4add-bc6b-69a657389dea admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:25.371865 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1394/2833] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:55:25.375914 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23feb6e-78ed-4df9-9cef-ba2e36221ec8 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:25.388065 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23feb6e-78ed-4df9-9cef-ba2e36221ec8 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:25.393560 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb602d-fd72-460f-9bb4-958da49c1f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:25.394188 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb602d-fd72-460f-9bb4-958da49c1f31 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:25.394475 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb602d-fd72-460f-9bb4-958da49c1f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:25.394754 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb602d-fd72-460f-9bb4-958da49c1f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:25.395487 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb602d-fd72-460f-9bb4-958da49c1f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:25.397151 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb602d-fd72-460f-9bb4-958da49c1f31 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:25.408819 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1440/2834] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:55:25.413560 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e69a57-8091-4add-bc6b-69a657389dea admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:25.424281 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e69a57-8091-4add-bc6b-69a657389dea admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:25.429630 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b8570-9b2b-4c06-b292-f42acc33e65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:25.430303 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b8570-9b2b-4c06-b292-f42acc33e65f admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:25.430583 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b8570-9b2b-4c06-b292-f42acc33e65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:25.430863 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b8570-9b2b-4c06-b292-f42acc33e65f admin admin] PATH_INFO: `/v3/projects/c73dd976ff6d42f7bc19a25ae122ddaf/users/632fa570008d4e749cef82416cf98d30/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:25.446627 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b8570-9b2b-4c06-b292-f42acc33e65f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c73dd976ff6d42f7bc19a25ae122ddaf, user_id=632fa570008d4e749cef82416cf98d30, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:25.449348 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b8570-9b2b-4c06-b292-f42acc33e65f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:25.519485 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1395/2835] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:55:25 2022] PUT /identity/v3/projects/c73dd976ff6d42f7bc19a25ae122ddaf/users/632fa570008d4e749cef82416cf98d30/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:25.530209 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14487783-66c4-4c6e-bf88-bd0ecfbebe72 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:25.530494 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14487783-66c4-4c6e-bf88-bd0ecfbebe72 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:25.530770 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14487783-66c4-4c6e-bf88-bd0ecfbebe72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:25.560026 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-14487783-66c4-4c6e-bf88-bd0ecfbebe72 None None] MFA Rules not processed for user `632fa570008d4e749cef82416cf98d30`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:25.561234 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-14487783-66c4-4c6e-bf88-bd0ecfbebe72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:25.587554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:25.625766 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1441/2836] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:25.630571 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b8570-9b2b-4c06-b292-f42acc33e65f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:25.694073 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b8570-9b2b-4c06-b292-f42acc33e65f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:25.698967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a95e0-aa49-4e70-86d4-502e291985a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:25.701166 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a95e0-aa49-4e70-86d4-502e291985a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:25.701166 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a95e0-aa49-4e70-86d4-502e291985a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:25.701166 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a95e0-aa49-4e70-86d4-502e291985a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:25.701166 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a95e0-aa49-4e70-86d4-502e291985a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:25.702764 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a95e0-aa49-4e70-86d4-502e291985a6 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:25.801280 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1396/2837] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:55:25 2022] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:55:25.805660 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14487783-66c4-4c6e-bf88-bd0ecfbebe72 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:25.816562 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14487783-66c4-4c6e-bf88-bd0ecfbebe72 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:25.876895 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007e0e6-74bf-4772-a31f-e79bf5a855ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:25.877506 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007e0e6-74bf-4772-a31f-e79bf5a855ee admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:25.877790 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007e0e6-74bf-4772-a31f-e79bf5a855ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:25.878068 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007e0e6-74bf-4772-a31f-e79bf5a855ee admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:25.878807 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007e0e6-74bf-4772-a31f-e79bf5a855ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:25.880856 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007e0e6-74bf-4772-a31f-e79bf5a855ee admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:26.070021 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1442/2838] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:55:25 2022] POST /identity/v3/users => generated 300 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:55:26.074397 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a95e0-aa49-4e70-86d4-502e291985a6 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:26.084996 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a95e0-aa49-4e70-86d4-502e291985a6 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:26.089637 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ba363-ef66-4666-b42f-1cef4ac12179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:26.090240 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ba363-ef66-4666-b42f-1cef4ac12179 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:26.090521 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ba363-ef66-4666-b42f-1cef4ac12179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:26.090797 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ba363-ef66-4666-b42f-1cef4ac12179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:26.091646 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ba363-ef66-4666-b42f-1cef4ac12179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:26.093253 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ba363-ef66-4666-b42f-1cef4ac12179 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:26.105569 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1397/2839] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:55:26.109709 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007e0e6-74bf-4772-a31f-e79bf5a855ee admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:26.121057 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007e0e6-74bf-4772-a31f-e79bf5a855ee admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:26.125713 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecc809-1df6-4754-bb2c-dfc4afd95346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:26.126388 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecc809-1df6-4754-bb2c-dfc4afd95346 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:26.126675 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecc809-1df6-4754-bb2c-dfc4afd95346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:26.126959 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecc809-1df6-4754-bb2c-dfc4afd95346 admin admin] PATH_INFO: `/v3/projects/115a425850eb482aa0cd4609bbe59e29/users/6a081a15dc5f4f2dad75e5e60f5cf3d3/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:26.142595 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fecc809-1df6-4754-bb2c-dfc4afd95346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=115a425850eb482aa0cd4609bbe59e29, user_id=6a081a15dc5f4f2dad75e5e60f5cf3d3, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:26.145316 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fecc809-1df6-4754-bb2c-dfc4afd95346 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:26.230425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1443/2840] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:55:26 2022] PUT /identity/v3/projects/115a425850eb482aa0cd4609bbe59e29/users/6a081a15dc5f4f2dad75e5e60f5cf3d3/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:26.234509 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ba363-ef66-4666-b42f-1cef4ac12179 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:26.245859 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ba363-ef66-4666-b42f-1cef4ac12179 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:26.284305 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:26.304220 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023dc07-7a26-42c0-ac1d-3e8f98ecaacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:26.304842 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023dc07-7a26-42c0-ac1d-3e8f98ecaacc admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:26.305123 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023dc07-7a26-42c0-ac1d-3e8f98ecaacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:26.305421 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023dc07-7a26-42c0-ac1d-3e8f98ecaacc admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:26.306117 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023dc07-7a26-42c0-ac1d-3e8f98ecaacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:26.307771 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023dc07-7a26-42c0-ac1d-3e8f98ecaacc admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:26.318284 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1398/2841] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:55:26.322412 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecc809-1df6-4754-bb2c-dfc4afd95346 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:26.332837 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecc809-1df6-4754-bb2c-dfc4afd95346 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:26.338269 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1dcbb-4ed8-4609-8ae3-6af261cf1b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:26.338841 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1dcbb-4ed8-4609-8ae3-6af261cf1b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:26.339129 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1dcbb-4ed8-4609-8ae3-6af261cf1b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:26.339438 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1dcbb-4ed8-4609-8ae3-6af261cf1b3b admin admin] PATH_INFO: `/v3/projects/115a425850eb482aa0cd4609bbe59e29/users/6a081a15dc5f4f2dad75e5e60f5cf3d3/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:26.341438 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1dcbb-4ed8-4609-8ae3-6af261cf1b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=115a425850eb482aa0cd4609bbe59e29, user_id=6a081a15dc5f4f2dad75e5e60f5cf3d3, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:26.344205 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1dcbb-4ed8-4609-8ae3-6af261cf1b3b admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:26.358576 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1444/2842] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:55:26 2022] PUT /identity/v3/projects/115a425850eb482aa0cd4609bbe59e29/users/6a081a15dc5f4f2dad75e5e60f5cf3d3/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:26.367910 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124a3c9-c461-4ef6-a6ee-b4e5cbe2e671 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:26.368204 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124a3c9-c461-4ef6-a6ee-b4e5cbe2e671 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:26.368487 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124a3c9-c461-4ef6-a6ee-b4e5cbe2e671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:26.402485 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-b124a3c9-c461-4ef6-a6ee-b4e5cbe2e671 None None] MFA Rules not processed for user `6a081a15dc5f4f2dad75e5e60f5cf3d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:26.403802 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-b124a3c9-c461-4ef6-a6ee-b4e5cbe2e671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:26.476555 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1399/2843] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:26.487520 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1dcbb-4ed8-4609-8ae3-6af261cf1b3b admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:26.489240 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-7ca1dcbb-4ed8-4609-8ae3-6af261cf1b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:26.549478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1dcbb-4ed8-4609-8ae3-6af261cf1b3b admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:26.553279 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508004c4-5028-49a0-a895-d4835ae8d6c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:26.554364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508004c4-5028-49a0-a895-d4835ae8d6c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:26.554364 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508004c4-5028-49a0-a895-d4835ae8d6c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:26.554566 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508004c4-5028-49a0-a895-d4835ae8d6c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:26.564081 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508004c4-5028-49a0-a895-d4835ae8d6c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:26.565542 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508004c4-5028-49a0-a895-d4835ae8d6c5 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:26.575279 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1445/2844] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:55:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:55:27.876998 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124a3c9-c461-4ef6-a6ee-b4e5cbe2e671 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:27.948328 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124a3c9-c461-4ef6-a6ee-b4e5cbe2e671 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:27.953607 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be186d09-7413-48e0-9a4f-7da81e70dc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:27.954266 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be186d09-7413-48e0-9a4f-7da81e70dc94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:27.954552 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be186d09-7413-48e0-9a4f-7da81e70dc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:27.954829 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be186d09-7413-48e0-9a4f-7da81e70dc94 admin admin] PATH_INFO: `/v3/users/632fa570008d4e749cef82416cf98d30` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:27.956101 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be186d09-7413-48e0-9a4f-7da81e70dc94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=632fa570008d4e749cef82416cf98d30)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:27.958051 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be186d09-7413-48e0-9a4f-7da81e70dc94 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:28.142966 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-be186d09-7413-48e0-9a4f-7da81e70dc94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '632fa570008d4e749cef82416cf98d30'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:28.143703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-be186d09-7413-48e0-9a4f-7da81e70dc94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '632fa570008d4e749cef82416cf98d30'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:28.280723 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-be186d09-7413-48e0-9a4f-7da81e70dc94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '632fa570008d4e749cef82416cf98d30'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:28.289250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:28.294904 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-be186d09-7413-48e0-9a4f-7da81e70dc94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '632fa570008d4e749cef82416cf98d30'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:28.295722 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-be186d09-7413-48e0-9a4f-7da81e70dc94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '632fa570008d4e749cef82416cf98d30'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:28.309830 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1400/2845] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:55:27 2022] DELETE /identity/v3/users/632fa570008d4e749cef82416cf98d30 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:28.314285 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7152cc-535e-4058-a851-deef184f9703 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:28.314971 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7152cc-535e-4058-a851-deef184f9703 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:28.314971 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7152cc-535e-4058-a851-deef184f9703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:28.336816 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-6f7152cc-535e-4058-a851-deef184f9703 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:28.338021 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-6f7152cc-535e-4058-a851-deef184f9703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:28.356719 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:28.400707 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1446/2846] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:55:28.413799 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be186d09-7413-48e0-9a4f-7da81e70dc94 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:28.418525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-be186d09-7413-48e0-9a4f-7da81e70dc94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:28.477386 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be186d09-7413-48e0-9a4f-7da81e70dc94 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:28.481791 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f8738-2853-4911-ae58-43281d83e708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:28.482429 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f8738-2853-4911-ae58-43281d83e708 service neutron] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:28.482752 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f8738-2853-4911-ae58-43281d83e708 service neutron] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:28.482992 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f8738-2853-4911-ae58-43281d83e708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:28.493946 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f8738-2853-4911-ae58-43281d83e708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:28.495441 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f8738-2853-4911-ae58-43281d83e708 service neutron] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:28.505711 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1401/2847] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:55:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:55:28.974363 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7152cc-535e-4058-a851-deef184f9703 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:28.976602 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-6f7152cc-535e-4058-a851-deef184f9703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:28.989106 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7152cc-535e-4058-a851-deef184f9703 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:28.994569 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a9b60-22bd-4eb0-9626-a698cc1f2715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:29.000595 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a9b60-22bd-4eb0-9626-a698cc1f2715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:29.000595 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a9b60-22bd-4eb0-9626-a698cc1f2715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:29.000595 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a9b60-22bd-4eb0-9626-a698cc1f2715 admin admin] PATH_INFO: `/v3/projects/c73dd976ff6d42f7bc19a25ae122ddaf` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:29.000595 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a9b60-22bd-4eb0-9626-a698cc1f2715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c73dd976ff6d42f7bc19a25ae122ddaf)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:29.000595 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a9b60-22bd-4eb0-9626-a698cc1f2715 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:29.133126 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-5e0a9b60-22bd-4eb0-9626-a698cc1f2715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c73dd976ff6d42f7bc19a25ae122ddaf', 'request_id': 'req-5e0a9b60-22bd-4eb0-9626-a698cc1f2715'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:29.138772 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-5e0a9b60-22bd-4eb0-9626-a698cc1f2715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c73dd976ff6d42f7bc19a25ae122ddaf', 'request_id': 'req-5e0a9b60-22bd-4eb0-9626-a698cc1f2715'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:29.189182 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-5e0a9b60-22bd-4eb0-9626-a698cc1f2715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c73dd976ff6d42f7bc19a25ae122ddaf', 'request_id': 'req-5e0a9b60-22bd-4eb0-9626-a698cc1f2715'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:29.202024 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-5e0a9b60-22bd-4eb0-9626-a698cc1f2715 admin admin] The token cache is being invalidate because project c73dd976ff6d42f7bc19a25ae122ddaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:55:29.208153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-5e0a9b60-22bd-4eb0-9626-a698cc1f2715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:29.208153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-5e0a9b60-22bd-4eb0-9626-a698cc1f2715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:29.208153 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1447/2848] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:55:28 2022] DELETE /identity/v3/projects/c73dd976ff6d42f7bc19a25ae122ddaf => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:29.208704 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f8738-2853-4911-ae58-43281d83e708 service neutron] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:29.219246 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f8738-2853-4911-ae58-43281d83e708 service neutron] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:29.275585 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ac139-3d30-4ad3-9315-4241f129f15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:29.276223 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ac139-3d30-4ad3-9315-4241f129f15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:29.276502 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ac139-3d30-4ad3-9315-4241f129f15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:29.276773 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ac139-3d30-4ad3-9315-4241f129f15a admin admin] PATH_INFO: `/v3/users/6a081a15dc5f4f2dad75e5e60f5cf3d3` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:29.277946 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ac139-3d30-4ad3-9315-4241f129f15a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a081a15dc5f4f2dad75e5e60f5cf3d3)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:29.279898 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ac139-3d30-4ad3-9315-4241f129f15a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:29.473310 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc8464-072f-437c-894e-df3a6df7830b None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:29.473769 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc8464-072f-437c-894e-df3a6df7830b None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:29.473873 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc8464-072f-437c-894e-df3a6df7830b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:29.493413 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-dcdc8464-072f-437c-894e-df3a6df7830b None None] MFA Rules not processed for user `5b4c4184e87b4dc5a4047310cd0122ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:29.494627 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-dcdc8464-072f-437c-894e-df3a6df7830b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:29.508110 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5e3ac139-3d30-4ad3-9315-4241f129f15a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a081a15dc5f4f2dad75e5e60f5cf3d3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:29.508782 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5e3ac139-3d30-4ad3-9315-4241f129f15a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a081a15dc5f4f2dad75e5e60f5cf3d3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:29.555008 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1448/2849] 10.222.0.65 () {58 vars in 967 bytes} [Wed Jul 27 18:55:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:29.589399 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5e3ac139-3d30-4ad3-9315-4241f129f15a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a081a15dc5f4f2dad75e5e60f5cf3d3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:29.597010 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc8464-072f-437c-894e-df3a6df7830b None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:29.606478 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-dcdc8464-072f-437c-894e-df3a6df7830b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:29.606616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5e3ac139-3d30-4ad3-9315-4241f129f15a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a081a15dc5f4f2dad75e5e60f5cf3d3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:29.606616 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5e3ac139-3d30-4ad3-9315-4241f129f15a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a081a15dc5f4f2dad75e5e60f5cf3d3'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:29.619433 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1402/2850] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:55:29 2022] DELETE /identity/v3/users/6a081a15dc5f4f2dad75e5e60f5cf3d3 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:29.654304 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:29.672850 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc8464-072f-437c-894e-df3a6df7830b None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:29.739220 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9949c-b33e-47cf-ae7a-f9c585dae9ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7832398e97af4e539e10d1eef49f6d6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:29.739831 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9949c-b33e-47cf-ae7a-f9c585dae9ea service swift] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:29.740738 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9949c-b33e-47cf-ae7a-f9c585dae9ea service swift] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:29.741045 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9949c-b33e-47cf-ae7a-f9c585dae9ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:29.742975 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-42d9949c-b33e-47cf-ae7a-f9c585dae9ea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:29.807756 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9949c-b33e-47cf-ae7a-f9c585dae9ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:29.814868 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9949c-b33e-47cf-ae7a-f9c585dae9ea service swift] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:29.827323 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1449/2851] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 18:55:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 18:55:30.098258 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ac139-3d30-4ad3-9315-4241f129f15a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:30.099921 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5e3ac139-3d30-4ad3-9315-4241f129f15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:30.105603 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:30.179350 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ac139-3d30-4ad3-9315-4241f129f15a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:30.184148 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311d81e-2bf5-4c9c-823f-7ecc78ed1708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:30.184823 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311d81e-2bf5-4c9c-823f-7ecc78ed1708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:30.185138 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311d81e-2bf5-4c9c-823f-7ecc78ed1708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:30.185420 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311d81e-2bf5-4c9c-823f-7ecc78ed1708 admin admin] PATH_INFO: `/v3/projects/115a425850eb482aa0cd4609bbe59e29` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:30.186661 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311d81e-2bf5-4c9c-823f-7ecc78ed1708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=115a425850eb482aa0cd4609bbe59e29)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:30.188618 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311d81e-2bf5-4c9c-823f-7ecc78ed1708 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:30.316110 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0311d81e-2bf5-4c9c-823f-7ecc78ed1708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '115a425850eb482aa0cd4609bbe59e29', 'request_id': 'req-0311d81e-2bf5-4c9c-823f-7ecc78ed1708'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:30.322501 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0311d81e-2bf5-4c9c-823f-7ecc78ed1708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '115a425850eb482aa0cd4609bbe59e29', 'request_id': 'req-0311d81e-2bf5-4c9c-823f-7ecc78ed1708'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:30.433374 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0311d81e-2bf5-4c9c-823f-7ecc78ed1708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '115a425850eb482aa0cd4609bbe59e29', 'request_id': 'req-0311d81e-2bf5-4c9c-823f-7ecc78ed1708'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:30.446147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0311d81e-2bf5-4c9c-823f-7ecc78ed1708 admin admin] The token cache is being invalidate because project 115a425850eb482aa0cd4609bbe59e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:55:30.446437 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0311d81e-2bf5-4c9c-823f-7ecc78ed1708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:30.447067 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-0311d81e-2bf5-4c9c-823f-7ecc78ed1708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:30.448623 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1403/2852] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:55:30 2022] DELETE /identity/v3/projects/115a425850eb482aa0cd4609bbe59e29 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:30.453674 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cdfb5-acb7-4ab7-bb94-54811b4ee737 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:30.453967 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cdfb5-acb7-4ab7-bb94-54811b4ee737 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:30.454248 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cdfb5-acb7-4ab7-bb94-54811b4ee737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:30.474613 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-ab2cdfb5-acb7-4ab7-bb94-54811b4ee737 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:30.476149 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ab2cdfb5-acb7-4ab7-bb94-54811b4ee737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:30.550824 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1450/2853] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:30.559703 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbaf94-116c-4d55-889e-e8870907bdad None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:30.562407 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbaf94-116c-4d55-889e-e8870907bdad None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:30.562407 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbaf94-116c-4d55-889e-e8870907bdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:30.581252 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-8fcbaf94-116c-4d55-889e-e8870907bdad None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:30.582401 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8fcbaf94-116c-4d55-889e-e8870907bdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:30.590679 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1404/2854] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:30.595061 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cdfb5-acb7-4ab7-bb94-54811b4ee737 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:30.605044 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cdfb5-acb7-4ab7-bb94-54811b4ee737 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:30.609668 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e16abb-4aa5-453c-8f54-854b82e199e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:30.610289 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e16abb-4aa5-453c-8f54-854b82e199e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:30.610574 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e16abb-4aa5-453c-8f54-854b82e199e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:30.610856 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e16abb-4aa5-453c-8f54-854b82e199e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:30.611598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e16abb-4aa5-453c-8f54-854b82e199e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:30.611912 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e16abb-4aa5-453c-8f54-854b82e199e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:30.613523 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e16abb-4aa5-453c-8f54-854b82e199e4 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:30.625774 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1451/2855] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:30.630340 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbaf94-116c-4d55-889e-e8870907bdad None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:30.641075 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbaf94-116c-4d55-889e-e8870907bdad None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:30.646276 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0364cba-31d7-4d1d-b6f8-c53f0dd9630a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:30.646905 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0364cba-31d7-4d1d-b6f8-c53f0dd9630a admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:30.647337 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0364cba-31d7-4d1d-b6f8-c53f0dd9630a admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:30.647708 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0364cba-31d7-4d1d-b6f8-c53f0dd9630a admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:30.648455 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0364cba-31d7-4d1d-b6f8-c53f0dd9630a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:30.650382 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0364cba-31d7-4d1d-b6f8-c53f0dd9630a admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:30.751059 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1405/2856] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:55:30 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:55:30.755420 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e16abb-4aa5-453c-8f54-854b82e199e4 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:30.766415 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e16abb-4aa5-453c-8f54-854b82e199e4 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:30.785928 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=100 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:30.830333 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b7804-6d12-4413-97a8-a3016a7826d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:30.834801 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b7804-6d12-4413-97a8-a3016a7826d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:30.834801 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b7804-6d12-4413-97a8-a3016a7826d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:30.834801 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b7804-6d12-4413-97a8-a3016a7826d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:30.834801 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b7804-6d12-4413-97a8-a3016a7826d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:30.834801 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b7804-6d12-4413-97a8-a3016a7826d0 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:30.921996 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1452/2857] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:55:30 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:55:30.926546 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0364cba-31d7-4d1d-b6f8-c53f0dd9630a admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:30.937870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0364cba-31d7-4d1d-b6f8-c53f0dd9630a admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:30.942849 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f1b64-bcea-481c-8806-fe75c7ef7942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:30.943488 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f1b64-bcea-481c-8806-fe75c7ef7942 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:30.943811 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f1b64-bcea-481c-8806-fe75c7ef7942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:30.944178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f1b64-bcea-481c-8806-fe75c7ef7942 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:30.945063 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f1b64-bcea-481c-8806-fe75c7ef7942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:30.946944 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f1b64-bcea-481c-8806-fe75c7ef7942 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:30.957111 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1406/2858] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:55:30.961400 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b7804-6d12-4413-97a8-a3016a7826d0 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:30.971513 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b7804-6d12-4413-97a8-a3016a7826d0 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:30.976852 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5446a-152c-479b-b1f4-91de6043f8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:30.977458 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5446a-152c-479b-b1f4-91de6043f8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:30.977739 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5446a-152c-479b-b1f4-91de6043f8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:30.978012 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5446a-152c-479b-b1f4-91de6043f8d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:30.978702 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5446a-152c-479b-b1f4-91de6043f8d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:30.980352 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5446a-152c-479b-b1f4-91de6043f8d6 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:30.993269 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1453/2859] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:55:30.996988 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f1b64-bcea-481c-8806-fe75c7ef7942 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:31.007774 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f1b64-bcea-481c-8806-fe75c7ef7942 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:31.012610 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18666ff4-a05f-4d5d-847f-7e9952beb9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:31.013289 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18666ff4-a05f-4d5d-847f-7e9952beb9a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:31.013599 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18666ff4-a05f-4d5d-847f-7e9952beb9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:31.013858 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18666ff4-a05f-4d5d-847f-7e9952beb9a8 admin admin] PATH_INFO: `/v3/projects/3b8f1cf4e3fa46ccae7120b89e798ce4/users/5bd3c984fbee486b8510df379bb44b09/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:31.031690 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18666ff4-a05f-4d5d-847f-7e9952beb9a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8f1cf4e3fa46ccae7120b89e798ce4, user_id=5bd3c984fbee486b8510df379bb44b09, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:31.034418 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18666ff4-a05f-4d5d-847f-7e9952beb9a8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:31.105522 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1407/2860] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:55:30 2022] PUT /identity/v3/projects/3b8f1cf4e3fa46ccae7120b89e798ce4/users/5bd3c984fbee486b8510df379bb44b09/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:55:31.118123 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcb163-41ae-4b9c-872a-d84fd551687f None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:31.121804 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcb163-41ae-4b9c-872a-d84fd551687f None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:31.121804 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcb163-41ae-4b9c-872a-d84fd551687f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:31.150714 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-30fcb163-41ae-4b9c-872a-d84fd551687f None None] MFA Rules not processed for user `5bd3c984fbee486b8510df379bb44b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:31.151983 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-30fcb163-41ae-4b9c-872a-d84fd551687f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:31.224889 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1454/2861] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:31.230598 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18666ff4-a05f-4d5d-847f-7e9952beb9a8 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:31.262853 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:31.295963 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18666ff4-a05f-4d5d-847f-7e9952beb9a8 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:31.300789 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce232a-591f-48da-9ad7-3c250293475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:31.301421 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce232a-591f-48da-9ad7-3c250293475f admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:31.301687 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce232a-591f-48da-9ad7-3c250293475f admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:31.301958 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce232a-591f-48da-9ad7-3c250293475f admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:31.302626 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce232a-591f-48da-9ad7-3c250293475f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:31.305219 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce232a-591f-48da-9ad7-3c250293475f admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:31.400118 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1408/2862] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:55:31 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:55:31.401369 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcb163-41ae-4b9c-872a-d84fd551687f None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:31.412588 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcb163-41ae-4b9c-872a-d84fd551687f None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:31.473798 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d89afb-af37-42dd-b572-597fdad8e114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:31.474425 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d89afb-af37-42dd-b572-597fdad8e114 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:31.474707 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d89afb-af37-42dd-b572-597fdad8e114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:31.475384 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d89afb-af37-42dd-b572-597fdad8e114 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:31.476571 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d89afb-af37-42dd-b572-597fdad8e114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:31.478257 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d89afb-af37-42dd-b572-597fdad8e114 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:31.590931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1455/2863] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:55:31 2022] POST /identity/v3/users => generated 298 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:55:31.595089 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce232a-591f-48da-9ad7-3c250293475f admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:31.605718 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce232a-591f-48da-9ad7-3c250293475f admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:31.610463 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc183ba3-feb5-436e-9a76-69f8c1cc8d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:31.611489 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc183ba3-feb5-436e-9a76-69f8c1cc8d0b admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:31.611489 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc183ba3-feb5-436e-9a76-69f8c1cc8d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:31.611709 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc183ba3-feb5-436e-9a76-69f8c1cc8d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:31.612338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc183ba3-feb5-436e-9a76-69f8c1cc8d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:31.613959 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc183ba3-feb5-436e-9a76-69f8c1cc8d0b admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:31.624500 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1409/2864] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:55:31.628783 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d89afb-af37-42dd-b572-597fdad8e114 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:31.639759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d89afb-af37-42dd-b572-597fdad8e114 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:31.645942 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eec1ae-aef8-4022-980b-b07cd598feff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:31.646619 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eec1ae-aef8-4022-980b-b07cd598feff admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:31.646906 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eec1ae-aef8-4022-980b-b07cd598feff admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:31.647225 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eec1ae-aef8-4022-980b-b07cd598feff admin admin] PATH_INFO: `/v3/projects/a04af2a905864bc18c1656a0b912e7ef/users/070976d054cf4e86a84c879a086f6c22/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:31.664495 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eec1ae-aef8-4022-980b-b07cd598feff admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04af2a905864bc18c1656a0b912e7ef, user_id=070976d054cf4e86a84c879a086f6c22, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:31.667232 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eec1ae-aef8-4022-980b-b07cd598feff admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:31.670366 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:31.737002 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1456/2865] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:55:31 2022] PUT /identity/v3/projects/a04af2a905864bc18c1656a0b912e7ef/users/070976d054cf4e86a84c879a086f6c22/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:31.741065 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc183ba3-feb5-436e-9a76-69f8c1cc8d0b admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:31.751154 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc183ba3-feb5-436e-9a76-69f8c1cc8d0b admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:31.812032 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b343047-2985-4784-ba08-73a3c50119a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:31.812656 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b343047-2985-4784-ba08-73a3c50119a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:31.812935 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b343047-2985-4784-ba08-73a3c50119a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:31.813211 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b343047-2985-4784-ba08-73a3c50119a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:31.813908 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b343047-2985-4784-ba08-73a3c50119a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:31.815553 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b343047-2985-4784-ba08-73a3c50119a0 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:31.829288 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1410/2866] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:55:31.830857 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eec1ae-aef8-4022-980b-b07cd598feff admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:31.841745 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eec1ae-aef8-4022-980b-b07cd598feff admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:31.847111 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0ec33-bf55-494b-a0d0-873ca6e173c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:31.847823 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0ec33-bf55-494b-a0d0-873ca6e173c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:31.848106 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0ec33-bf55-494b-a0d0-873ca6e173c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:31.848387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0ec33-bf55-494b-a0d0-873ca6e173c5 admin admin] PATH_INFO: `/v3/projects/a04af2a905864bc18c1656a0b912e7ef/users/070976d054cf4e86a84c879a086f6c22/roles/4ae8d11d74f14bcc80117d897ba2f5b6` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:31.851174 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0ec33-bf55-494b-a0d0-873ca6e173c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04af2a905864bc18c1656a0b912e7ef, user_id=070976d054cf4e86a84c879a086f6c22, role_id=4ae8d11d74f14bcc80117d897ba2f5b6)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:31.853871 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0ec33-bf55-494b-a0d0-873ca6e173c5 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:31.864391 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1457/2867] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:55:31 2022] PUT /identity/v3/projects/a04af2a905864bc18c1656a0b912e7ef/users/070976d054cf4e86a84c879a086f6c22/roles/4ae8d11d74f14bcc80117d897ba2f5b6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:31.875765 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d655f-8bb0-45b5-b0d1-ac3fbf0e456c None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:31.876056 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d655f-8bb0-45b5-b0d1-ac3fbf0e456c None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:31.876353 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d655f-8bb0-45b5-b0d1-ac3fbf0e456c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:31.904977 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-3c5d655f-8bb0-45b5-b0d1-ac3fbf0e456c None None] MFA Rules not processed for user `070976d054cf4e86a84c879a086f6c22`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:31.906398 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-3c5d655f-8bb0-45b5-b0d1-ac3fbf0e456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:31.986972 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1411/2868] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:55:32.000472 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0ec33-bf55-494b-a0d0-873ca6e173c5 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:32.003293 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-75d0ec33-bf55-494b-a0d0-873ca6e173c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:32.068774 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0ec33-bf55-494b-a0d0-873ca6e173c5 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:32.074069 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dd001-1c9a-422d-9476-c4f0c8705a30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:32.074878 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd001-1c9a-422d-9476-c4f0c8705a30 service cinder] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:32.075296 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd001-1c9a-422d-9476-c4f0c8705a30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:32.075703 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd001-1c9a-422d-9476-c4f0c8705a30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:32.087210 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dd001-1c9a-422d-9476-c4f0c8705a30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:32.089041 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dd001-1c9a-422d-9476-c4f0c8705a30 service cinder] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:32.103540 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1458/2869] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:55:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:55:32.262973 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d655f-8bb0-45b5-b0d1-ac3fbf0e456c None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:32.272870 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d655f-8bb0-45b5-b0d1-ac3fbf0e456c None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:32.276360 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98d8a2-e638-4aef-8972-a4a6ea2758b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:32.276977 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98d8a2-e638-4aef-8972-a4a6ea2758b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:32.277310 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98d8a2-e638-4aef-8972-a4a6ea2758b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:32.277590 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98d8a2-e638-4aef-8972-a4a6ea2758b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:32.298400 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:32.337809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98d8a2-e638-4aef-8972-a4a6ea2758b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:32.339327 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98d8a2-e638-4aef-8972-a4a6ea2758b3 service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:32.349143 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1412/2870] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:55:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:55:32.889225 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dd001-1c9a-422d-9476-c4f0c8705a30 service cinder] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:32.972552 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dd001-1c9a-422d-9476-c4f0c8705a30 service cinder] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:32.978500 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14b104-69a3-4697-bd50-5cbb747cd058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:32.979175 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14b104-69a3-4697-bd50-5cbb747cd058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:32.979487 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14b104-69a3-4697-bd50-5cbb747cd058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:32.979768 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14b104-69a3-4697-bd50-5cbb747cd058 admin admin] PATH_INFO: `/v3/users/5bd3c984fbee486b8510df379bb44b09` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:32.981054 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14b104-69a3-4697-bd50-5cbb747cd058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bd3c984fbee486b8510df379bb44b09)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:32.983130 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14b104-69a3-4697-bd50-5cbb747cd058 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:33.234900 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-1e14b104-69a3-4697-bd50-5cbb747cd058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bd3c984fbee486b8510df379bb44b09'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:33.235614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-1e14b104-69a3-4697-bd50-5cbb747cd058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bd3c984fbee486b8510df379bb44b09'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:33.309931 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-1e14b104-69a3-4697-bd50-5cbb747cd058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bd3c984fbee486b8510df379bb44b09'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:33.332872 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-1e14b104-69a3-4697-bd50-5cbb747cd058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bd3c984fbee486b8510df379bb44b09'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:33.342187 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-1e14b104-69a3-4697-bd50-5cbb747cd058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bd3c984fbee486b8510df379bb44b09'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:33.348947 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1459/2871] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:55:32 2022] DELETE /identity/v3/users/5bd3c984fbee486b8510df379bb44b09 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:33.353943 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af3f62-944a-41d9-85fc-93a813eb8d1b None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:33.354483 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af3f62-944a-41d9-85fc-93a813eb8d1b None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:33.354919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af3f62-944a-41d9-85fc-93a813eb8d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:33.376683 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-75af3f62-944a-41d9-85fc-93a813eb8d1b None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:33.377869 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-75af3f62-944a-41d9-85fc-93a813eb8d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:33.448425 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1413/2872] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:33.458524 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14b104-69a3-4697-bd50-5cbb747cd058 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:33.460897 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-1e14b104-69a3-4697-bd50-5cbb747cd058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:33.468844 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:33.522647 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14b104-69a3-4697-bd50-5cbb747cd058 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:33.526555 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157cfb1-5dc6-4bff-baed-953b83ea6fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:33.527191 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157cfb1-5dc6-4bff-baed-953b83ea6fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:33.527516 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157cfb1-5dc6-4bff-baed-953b83ea6fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:33.527796 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157cfb1-5dc6-4bff-baed-953b83ea6fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:33.541879 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157cfb1-5dc6-4bff-baed-953b83ea6fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:33.543744 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157cfb1-5dc6-4bff-baed-953b83ea6fa1 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:33.555506 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1460/2873] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:55:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:55:34.228039 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af3f62-944a-41d9-85fc-93a813eb8d1b None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:34.229862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-75af3f62-944a-41d9-85fc-93a813eb8d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:34.246611 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af3f62-944a-41d9-85fc-93a813eb8d1b None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:34.254250 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f2ef8-bb2f-449e-8b4a-c591cbd3fd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:34.255138 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f2ef8-bb2f-449e-8b4a-c591cbd3fd92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:34.255449 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f2ef8-bb2f-449e-8b4a-c591cbd3fd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:34.255846 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f2ef8-bb2f-449e-8b4a-c591cbd3fd92 admin admin] PATH_INFO: `/v3/projects/3b8f1cf4e3fa46ccae7120b89e798ce4` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:34.257152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f2ef8-bb2f-449e-8b4a-c591cbd3fd92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b8f1cf4e3fa46ccae7120b89e798ce4)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:34.259925 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f2ef8-bb2f-449e-8b4a-c591cbd3fd92 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:34.418437 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-436f2ef8-bb2f-449e-8b4a-c591cbd3fd92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b8f1cf4e3fa46ccae7120b89e798ce4', 'request_id': 'req-436f2ef8-bb2f-449e-8b4a-c591cbd3fd92'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:34.425387 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-436f2ef8-bb2f-449e-8b4a-c591cbd3fd92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b8f1cf4e3fa46ccae7120b89e798ce4', 'request_id': 'req-436f2ef8-bb2f-449e-8b4a-c591cbd3fd92'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:34.469434 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-436f2ef8-bb2f-449e-8b4a-c591cbd3fd92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b8f1cf4e3fa46ccae7120b89e798ce4', 'request_id': 'req-436f2ef8-bb2f-449e-8b4a-c591cbd3fd92'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:34.482077 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-436f2ef8-bb2f-449e-8b4a-c591cbd3fd92 admin admin] The token cache is being invalidate because project 3b8f1cf4e3fa46ccae7120b89e798ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:55:34.482371 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-436f2ef8-bb2f-449e-8b4a-c591cbd3fd92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:34.483028 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-436f2ef8-bb2f-449e-8b4a-c591cbd3fd92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:34.484983 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1414/2874] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:55:34 2022] DELETE /identity/v3/projects/3b8f1cf4e3fa46ccae7120b89e798ce4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:34.488780 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157cfb1-5dc6-4bff-baed-953b83ea6fa1 service neutron] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:34.498961 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157cfb1-5dc6-4bff-baed-953b83ea6fa1 service neutron] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:34.563152 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8cafe-9da5-4f1a-ba41-201b418f53b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:34.564007 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8cafe-9da5-4f1a-ba41-201b418f53b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:34.564298 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8cafe-9da5-4f1a-ba41-201b418f53b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:34.564579 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8cafe-9da5-4f1a-ba41-201b418f53b9 admin admin] PATH_INFO: `/v3/users/070976d054cf4e86a84c879a086f6c22` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:34.565787 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8cafe-9da5-4f1a-ba41-201b418f53b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=070976d054cf4e86a84c879a086f6c22)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:34.567769 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8cafe-9da5-4f1a-ba41-201b418f53b9 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:34.810485 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-bbc8cafe-9da5-4f1a-ba41-201b418f53b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '070976d054cf4e86a84c879a086f6c22'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:34.811216 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-bbc8cafe-9da5-4f1a-ba41-201b418f53b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '070976d054cf4e86a84c879a086f6c22'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:34.898765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-bbc8cafe-9da5-4f1a-ba41-201b418f53b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '070976d054cf4e86a84c879a086f6c22'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:34.916540 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-bbc8cafe-9da5-4f1a-ba41-201b418f53b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '070976d054cf4e86a84c879a086f6c22'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:34.925823 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-bbc8cafe-9da5-4f1a-ba41-201b418f53b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '070976d054cf4e86a84c879a086f6c22'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:34.934083 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1461/2875] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:55:34 2022] DELETE /identity/v3/users/070976d054cf4e86a84c879a086f6c22 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:35.551313 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f2ef8-bb2f-449e-8b4a-c591cbd3fd92 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:35.554034 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-436f2ef8-bb2f-449e-8b4a-c591cbd3fd92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:35.574483 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f2ef8-bb2f-449e-8b4a-c591cbd3fd92 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:35.625004 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:35.638304 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9ba24-4170-48ad-aa4f-531d090ad52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:35.639190 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9ba24-4170-48ad-aa4f-531d090ad52c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:35.644222 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9ba24-4170-48ad-aa4f-531d090ad52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:35.644222 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9ba24-4170-48ad-aa4f-531d090ad52c admin admin] PATH_INFO: `/v3/projects/a04af2a905864bc18c1656a0b912e7ef` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:35.644222 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9ba24-4170-48ad-aa4f-531d090ad52c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a04af2a905864bc18c1656a0b912e7ef)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:35.644222 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9ba24-4170-48ad-aa4f-531d090ad52c admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:35.782910 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-aba9ba24-4170-48ad-aa4f-531d090ad52c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a04af2a905864bc18c1656a0b912e7ef', 'request_id': 'req-aba9ba24-4170-48ad-aa4f-531d090ad52c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:35.788737 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-aba9ba24-4170-48ad-aa4f-531d090ad52c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a04af2a905864bc18c1656a0b912e7ef', 'request_id': 'req-aba9ba24-4170-48ad-aa4f-531d090ad52c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:35.851918 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-aba9ba24-4170-48ad-aa4f-531d090ad52c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a04af2a905864bc18c1656a0b912e7ef', 'request_id': 'req-aba9ba24-4170-48ad-aa4f-531d090ad52c'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:35.870593 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-aba9ba24-4170-48ad-aa4f-531d090ad52c admin admin] The token cache is being invalidate because project a04af2a905864bc18c1656a0b912e7ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:55:35.870993 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-aba9ba24-4170-48ad-aa4f-531d090ad52c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:35.872525 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-aba9ba24-4170-48ad-aa4f-531d090ad52c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:35.880787 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1415/2876] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:55:35 2022] DELETE /identity/v3/projects/a04af2a905864bc18c1656a0b912e7ef => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:35.886284 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1dd93-dd43-4d06-80cf-f5f8e8281c15 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:35.887472 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1dd93-dd43-4d06-80cf-f5f8e8281c15 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:35.887472 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1dd93-dd43-4d06-80cf-f5f8e8281c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:35.913258 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-83f1dd93-dd43-4d06-80cf-f5f8e8281c15 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:35.915374 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-83f1dd93-dd43-4d06-80cf-f5f8e8281c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:35.946822 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:35.995056 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1462/2877] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:36.002714 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7a2aa-6181-4390-9c26-70a91ce5c29d None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:36.003000 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7a2aa-6181-4390-9c26-70a91ce5c29d None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:36.003291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7a2aa-6181-4390-9c26-70a91ce5c29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:36.026027 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-23e7a2aa-6181-4390-9c26-70a91ce5c29d None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:36.027199 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-23e7a2aa-6181-4390-9c26-70a91ce5c29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:36.036516 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1416/2878] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:36.043394 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1dd93-dd43-4d06-80cf-f5f8e8281c15 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:36.058747 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1dd93-dd43-4d06-80cf-f5f8e8281c15 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:36.064005 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4116a68-96e1-4846-b538-0c80a4651270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:36.064633 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4116a68-96e1-4846-b538-0c80a4651270 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:36.064917 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4116a68-96e1-4846-b538-0c80a4651270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:36.065201 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4116a68-96e1-4846-b538-0c80a4651270 admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:36.065906 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4116a68-96e1-4846-b538-0c80a4651270 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:36.066216 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4116a68-96e1-4846-b538-0c80a4651270 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:36.067896 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4116a68-96e1-4846-b538-0c80a4651270 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:36.084221 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1463/2879] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:36.085760 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7a2aa-6181-4390-9c26-70a91ce5c29d None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:36.095366 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7a2aa-6181-4390-9c26-70a91ce5c29d None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:36.100815 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cb377-1488-4aca-99e2-104d9935d126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:36.101444 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cb377-1488-4aca-99e2-104d9935d126 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:36.101727 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cb377-1488-4aca-99e2-104d9935d126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:36.102007 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cb377-1488-4aca-99e2-104d9935d126 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:36.102689 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cb377-1488-4aca-99e2-104d9935d126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:36.104647 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cb377-1488-4aca-99e2-104d9935d126 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:36.195152 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1417/2880] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:55:36 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:55:36.196598 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4116a68-96e1-4846-b538-0c80a4651270 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:36.206765 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4116a68-96e1-4846-b538-0c80a4651270 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:36.266032 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37785a7c-fd8f-40a7-98e5-41bd6cb2184d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:36.266657 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37785a7c-fd8f-40a7-98e5-41bd6cb2184d admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:36.266935 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37785a7c-fd8f-40a7-98e5-41bd6cb2184d admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:36.267210 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37785a7c-fd8f-40a7-98e5-41bd6cb2184d admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:36.267902 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37785a7c-fd8f-40a7-98e5-41bd6cb2184d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:36.269853 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37785a7c-fd8f-40a7-98e5-41bd6cb2184d admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:36.356717 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1464/2881] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:55:36 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:55:36.357929 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cb377-1488-4aca-99e2-104d9935d126 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:36.369055 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cb377-1488-4aca-99e2-104d9935d126 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:36.374107 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11250aaf-8732-4a7f-99ae-6774d5932c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:36.374732 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11250aaf-8732-4a7f-99ae-6774d5932c39 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:36.375013 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11250aaf-8732-4a7f-99ae-6774d5932c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:36.375303 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11250aaf-8732-4a7f-99ae-6774d5932c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:36.376122 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11250aaf-8732-4a7f-99ae-6774d5932c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:36.383601 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11250aaf-8732-4a7f-99ae-6774d5932c39 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:36.395973 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1418/2882] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:55:36.400829 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37785a7c-fd8f-40a7-98e5-41bd6cb2184d admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:36.413002 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37785a7c-fd8f-40a7-98e5-41bd6cb2184d admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:36.418451 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6700823-dd19-481f-8d57-bca90ce52838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:36.419166 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6700823-dd19-481f-8d57-bca90ce52838 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:36.419550 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6700823-dd19-481f-8d57-bca90ce52838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:36.420019 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6700823-dd19-481f-8d57-bca90ce52838 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:36.420821 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6700823-dd19-481f-8d57-bca90ce52838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:36.423407 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6700823-dd19-481f-8d57-bca90ce52838 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:36.441802 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1465/2883] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:55:36.443007 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11250aaf-8732-4a7f-99ae-6774d5932c39 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:36.454836 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11250aaf-8732-4a7f-99ae-6774d5932c39 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:36.460326 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259ebcb-4477-4995-9f4b-73cdfa0f5963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:36.461008 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259ebcb-4477-4995-9f4b-73cdfa0f5963 admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:36.461411 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259ebcb-4477-4995-9f4b-73cdfa0f5963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:36.461696 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259ebcb-4477-4995-9f4b-73cdfa0f5963 admin admin] PATH_INFO: `/v3/projects/4c1bd48e13ee42c89439d17f26ee838c/users/04826bf30d4c4bb0bebbd8ed3f8d50b1/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:36.481715 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259ebcb-4477-4995-9f4b-73cdfa0f5963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1bd48e13ee42c89439d17f26ee838c, user_id=04826bf30d4c4bb0bebbd8ed3f8d50b1, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:36.484460 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259ebcb-4477-4995-9f4b-73cdfa0f5963 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:36.567625 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1419/2884] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:55:36 2022] PUT /identity/v3/projects/4c1bd48e13ee42c89439d17f26ee838c/users/04826bf30d4c4bb0bebbd8ed3f8d50b1/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:36.580503 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d7a19-e33d-4ce6-b051-0ad1706f8139 None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:36.581147 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d7a19-e33d-4ce6-b051-0ad1706f8139 None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:36.581691 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d7a19-e33d-4ce6-b051-0ad1706f8139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:36.619581 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-c03d7a19-e33d-4ce6-b051-0ad1706f8139 None None] MFA Rules not processed for user `04826bf30d4c4bb0bebbd8ed3f8d50b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:36.620776 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c03d7a19-e33d-4ce6-b051-0ad1706f8139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:36.688131 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1466/2885] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:55:36.699475 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259ebcb-4477-4995-9f4b-73cdfa0f5963 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:36.701351 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-c259ebcb-4477-4995-9f4b-73cdfa0f5963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:36.768662 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259ebcb-4477-4995-9f4b-73cdfa0f5963 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:36.774348 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbde23-f75d-4bdc-9716-70746b3bbedb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5579f23592846abb3273cc5f5658ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:36.775176 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbde23-f75d-4bdc-9716-70746b3bbedb service cinder] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:36.775652 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbde23-f75d-4bdc-9716-70746b3bbedb service cinder] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:36.775836 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbde23-f75d-4bdc-9716-70746b3bbedb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:36.785662 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbde23-f75d-4bdc-9716-70746b3bbedb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:36.787189 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbde23-f75d-4bdc-9716-70746b3bbedb service cinder] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:36.799292 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1420/2886] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:55:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:55:38.798702 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d7a19-e33d-4ce6-b051-0ad1706f8139 None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:38.799367 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c03d7a19-e33d-4ce6-b051-0ad1706f8139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:38.839763 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:38.877856 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d7a19-e33d-4ce6-b051-0ad1706f8139 None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:38.883650 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e7c96-dcef-4cf0-9ab8-df1efeb8d34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:38.884325 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e7c96-dcef-4cf0-9ab8-df1efeb8d34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:38.884594 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e7c96-dcef-4cf0-9ab8-df1efeb8d34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:38.894438 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e7c96-dcef-4cf0-9ab8-df1efeb8d34b admin admin] PATH_INFO: `/v3/users/ac6858df050e4488a4f8a7a608a04352` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:38.894438 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e7c96-dcef-4cf0-9ab8-df1efeb8d34b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac6858df050e4488a4f8a7a608a04352)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:38.894438 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e7c96-dcef-4cf0-9ab8-df1efeb8d34b admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:39.123336 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-672e7c96-dcef-4cf0-9ab8-df1efeb8d34b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac6858df050e4488a4f8a7a608a04352'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:39.123989 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-672e7c96-dcef-4cf0-9ab8-df1efeb8d34b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac6858df050e4488a4f8a7a608a04352'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:39.250271 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-672e7c96-dcef-4cf0-9ab8-df1efeb8d34b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac6858df050e4488a4f8a7a608a04352'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:39.264367 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-672e7c96-dcef-4cf0-9ab8-df1efeb8d34b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac6858df050e4488a4f8a7a608a04352'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:39.271438 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-672e7c96-dcef-4cf0-9ab8-df1efeb8d34b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac6858df050e4488a4f8a7a608a04352'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:39.278361 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1467/2887] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:55:38 2022] DELETE /identity/v3/users/ac6858df050e4488a4f8a7a608a04352 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:39.563627 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbde23-f75d-4bdc-9716-70746b3bbedb service cinder] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:39.576338 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbde23-f75d-4bdc-9716-70746b3bbedb service cinder] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:39.588790 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:39.634347 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de3e9e-a3e0-4600-8c8c-691ae99a6103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:39.634995 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de3e9e-a3e0-4600-8c8c-691ae99a6103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:39.635300 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de3e9e-a3e0-4600-8c8c-691ae99a6103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:39.635576 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de3e9e-a3e0-4600-8c8c-691ae99a6103 admin admin] PATH_INFO: `/v3/projects/8be080744f514295a40f9ebab2a18fbf` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:39.636736 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de3e9e-a3e0-4600-8c8c-691ae99a6103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8be080744f514295a40f9ebab2a18fbf)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:39.638923 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de3e9e-a3e0-4600-8c8c-691ae99a6103 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:39.765490 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e5de3e9e-a3e0-4600-8c8c-691ae99a6103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8be080744f514295a40f9ebab2a18fbf', 'request_id': 'req-e5de3e9e-a3e0-4600-8c8c-691ae99a6103'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:39.771221 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e5de3e9e-a3e0-4600-8c8c-691ae99a6103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8be080744f514295a40f9ebab2a18fbf', 'request_id': 'req-e5de3e9e-a3e0-4600-8c8c-691ae99a6103'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:39.839483 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e5de3e9e-a3e0-4600-8c8c-691ae99a6103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8be080744f514295a40f9ebab2a18fbf', 'request_id': 'req-e5de3e9e-a3e0-4600-8c8c-691ae99a6103'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:39.852367 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e5de3e9e-a3e0-4600-8c8c-691ae99a6103 admin admin] The token cache is being invalidate because project 8be080744f514295a40f9ebab2a18fbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:55:39.852683 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e5de3e9e-a3e0-4600-8c8c-691ae99a6103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:39.853331 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-e5de3e9e-a3e0-4600-8c8c-691ae99a6103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:39.855016 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1421/2888] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:55:39 2022] DELETE /identity/v3/projects/8be080744f514295a40f9ebab2a18fbf => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:39.859184 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e7c96-dcef-4cf0-9ab8-df1efeb8d34b admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:39.860686 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-672e7c96-dcef-4cf0-9ab8-df1efeb8d34b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:39.874611 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e7c96-dcef-4cf0-9ab8-df1efeb8d34b admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:39.932029 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a5ec3-1b6e-474c-a308-1e4370e56eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:39.932686 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a5ec3-1b6e-474c-a308-1e4370e56eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:39.932975 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a5ec3-1b6e-474c-a308-1e4370e56eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:39.933258 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a5ec3-1b6e-474c-a308-1e4370e56eb5 admin admin] PATH_INFO: `/v3/users/148c5d210a52406aae427d0bc0931801` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:39.934522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a5ec3-1b6e-474c-a308-1e4370e56eb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=148c5d210a52406aae427d0bc0931801)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:39.936492 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a5ec3-1b6e-474c-a308-1e4370e56eb5 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:40.130237 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:40.133051 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0e4a5ec3-1b6e-474c-a308-1e4370e56eb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '148c5d210a52406aae427d0bc0931801'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:40.133788 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0e4a5ec3-1b6e-474c-a308-1e4370e56eb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '148c5d210a52406aae427d0bc0931801'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:40.241731 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0e4a5ec3-1b6e-474c-a308-1e4370e56eb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '148c5d210a52406aae427d0bc0931801'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:40.255789 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0e4a5ec3-1b6e-474c-a308-1e4370e56eb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '148c5d210a52406aae427d0bc0931801'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:40.263840 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-0e4a5ec3-1b6e-474c-a308-1e4370e56eb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '148c5d210a52406aae427d0bc0931801'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:40.270899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1468/2889] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:55:39 2022] DELETE /identity/v3/users/148c5d210a52406aae427d0bc0931801 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:40.515156 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de3e9e-a3e0-4600-8c8c-691ae99a6103 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:40.516781 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-e5de3e9e-a3e0-4600-8c8c-691ae99a6103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:40.530994 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de3e9e-a3e0-4600-8c8c-691ae99a6103 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:40.605806 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273d905-c901-4031-82cb-908d1b6832fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:40.606570 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273d905-c901-4031-82cb-908d1b6832fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:40.606919 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273d905-c901-4031-82cb-908d1b6832fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:40.607438 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273d905-c901-4031-82cb-908d1b6832fa admin admin] PATH_INFO: `/v3/projects/34b59d5317a84a828aaf1e4a4f146843` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:40.608540 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273d905-c901-4031-82cb-908d1b6832fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=34b59d5317a84a828aaf1e4a4f146843)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:40.610671 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273d905-c901-4031-82cb-908d1b6832fa admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:40.731251 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:40.732729 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5273d905-c901-4031-82cb-908d1b6832fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34b59d5317a84a828aaf1e4a4f146843', 'request_id': 'req-5273d905-c901-4031-82cb-908d1b6832fa'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:40.738621 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5273d905-c901-4031-82cb-908d1b6832fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34b59d5317a84a828aaf1e4a4f146843', 'request_id': 'req-5273d905-c901-4031-82cb-908d1b6832fa'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:40.829687 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5273d905-c901-4031-82cb-908d1b6832fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34b59d5317a84a828aaf1e4a4f146843', 'request_id': 'req-5273d905-c901-4031-82cb-908d1b6832fa'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:40.844809 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5273d905-c901-4031-82cb-908d1b6832fa admin admin] The token cache is being invalidate because project 34b59d5317a84a828aaf1e4a4f146843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:55:40.845110 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5273d905-c901-4031-82cb-908d1b6832fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:40.845835 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-5273d905-c901-4031-82cb-908d1b6832fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:40.847419 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1422/2890] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:55:40 2022] DELETE /identity/v3/projects/34b59d5317a84a828aaf1e4a4f146843 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:43.770744 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a5ec3-1b6e-474c-a308-1e4370e56eb5 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:43.773167 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-0e4a5ec3-1b6e-474c-a308-1e4370e56eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:43.785915 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a5ec3-1b6e-474c-a308-1e4370e56eb5 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:43.843033 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccf4a7-a8dd-4f86-9eed-0d44a9e0afe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:43.843672 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccf4a7-a8dd-4f86-9eed-0d44a9e0afe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:43.843964 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccf4a7-a8dd-4f86-9eed-0d44a9e0afe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:43.844271 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccf4a7-a8dd-4f86-9eed-0d44a9e0afe6 admin admin] PATH_INFO: `/v3/users/04826bf30d4c4bb0bebbd8ed3f8d50b1` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:43.845720 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccf4a7-a8dd-4f86-9eed-0d44a9e0afe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04826bf30d4c4bb0bebbd8ed3f8d50b1)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:43.847743 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccf4a7-a8dd-4f86-9eed-0d44a9e0afe6 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:44.043565 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-2eccf4a7-a8dd-4f86-9eed-0d44a9e0afe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04826bf30d4c4bb0bebbd8ed3f8d50b1'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:44.044230 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-2eccf4a7-a8dd-4f86-9eed-0d44a9e0afe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04826bf30d4c4bb0bebbd8ed3f8d50b1'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:44.135573 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-2eccf4a7-a8dd-4f86-9eed-0d44a9e0afe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04826bf30d4c4bb0bebbd8ed3f8d50b1'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:44.149097 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-2eccf4a7-a8dd-4f86-9eed-0d44a9e0afe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04826bf30d4c4bb0bebbd8ed3f8d50b1'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:44.156317 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-2eccf4a7-a8dd-4f86-9eed-0d44a9e0afe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04826bf30d4c4bb0bebbd8ed3f8d50b1'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:44.162272 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1469/2891] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:55:43 2022] DELETE /identity/v3/users/04826bf30d4c4bb0bebbd8ed3f8d50b1 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:44.167580 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daca167-0fbc-43e7-ae86-4ea604015bb5 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:44.168071 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daca167-0fbc-43e7-ae86-4ea604015bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:44.168199 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daca167-0fbc-43e7-ae86-4ea604015bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:44.187420 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-0daca167-0fbc-43e7-ae86-4ea604015bb5 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:44.188758 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0daca167-0fbc-43e7-ae86-4ea604015bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:44.248852 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1423/2892] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:44.258922 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccf4a7-a8dd-4f86-9eed-0d44a9e0afe6 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:44.261280 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-2eccf4a7-a8dd-4f86-9eed-0d44a9e0afe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:44.305824 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:44.319274 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccf4a7-a8dd-4f86-9eed-0d44a9e0afe6 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:44.323798 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b23695-063d-40f6-be10-b8388545ff0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:44.324465 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b23695-063d-40f6-be10-b8388545ff0a service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:44.324742 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b23695-063d-40f6-be10-b8388545ff0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:44.325016 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b23695-063d-40f6-be10-b8388545ff0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:44.333999 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b23695-063d-40f6-be10-b8388545ff0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:44.336157 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b23695-063d-40f6-be10-b8388545ff0a service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:44.345796 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1470/2893] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:55:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:55:45.041235 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daca167-0fbc-43e7-ae86-4ea604015bb5 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:45.042967 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-0daca167-0fbc-43e7-ae86-4ea604015bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:45.057201 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daca167-0fbc-43e7-ae86-4ea604015bb5 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:45.062543 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812132b3-e0da-4c32-ae7c-44ddd26bbdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:45.063226 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812132b3-e0da-4c32-ae7c-44ddd26bbdda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:45.063539 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812132b3-e0da-4c32-ae7c-44ddd26bbdda admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:45.063822 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812132b3-e0da-4c32-ae7c-44ddd26bbdda admin admin] PATH_INFO: `/v3/projects/4c1bd48e13ee42c89439d17f26ee838c` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:45.065076 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812132b3-e0da-4c32-ae7c-44ddd26bbdda admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c1bd48e13ee42c89439d17f26ee838c)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:45.067044 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812132b3-e0da-4c32-ae7c-44ddd26bbdda admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:45.173132 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-812132b3-e0da-4c32-ae7c-44ddd26bbdda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c1bd48e13ee42c89439d17f26ee838c', 'request_id': 'req-812132b3-e0da-4c32-ae7c-44ddd26bbdda'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:45.179450 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-812132b3-e0da-4c32-ae7c-44ddd26bbdda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c1bd48e13ee42c89439d17f26ee838c', 'request_id': 'req-812132b3-e0da-4c32-ae7c-44ddd26bbdda'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:45.223291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-812132b3-e0da-4c32-ae7c-44ddd26bbdda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c1bd48e13ee42c89439d17f26ee838c', 'request_id': 'req-812132b3-e0da-4c32-ae7c-44ddd26bbdda'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:45.235396 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-812132b3-e0da-4c32-ae7c-44ddd26bbdda admin admin] The token cache is being invalidate because project 4c1bd48e13ee42c89439d17f26ee838c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:55:45.235719 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-812132b3-e0da-4c32-ae7c-44ddd26bbdda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:45.236363 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-812132b3-e0da-4c32-ae7c-44ddd26bbdda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:55:45.237888 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1424/2894] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:55:45 2022] DELETE /identity/v3/projects/4c1bd48e13ee42c89439d17f26ee838c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:45.244460 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d5a8e-d29b-457b-ae84-b973373125ae None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:45.245000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d5a8e-d29b-457b-ae84-b973373125ae None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:45.245000 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d5a8e-d29b-457b-ae84-b973373125ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:45.270382 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-733d5a8e-d29b-457b-ae84-b973373125ae None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:45.271718 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-733d5a8e-d29b-457b-ae84-b973373125ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:45.339853 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1471/2895] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:45.347957 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0b07b-95db-4e73-add4-1201895ffbf1 None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:45.348146 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0b07b-95db-4e73-add4-1201895ffbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:45.348537 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0b07b-95db-4e73-add4-1201895ffbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:45.369459 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-3cf0b07b-95db-4e73-add4-1201895ffbf1 None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:45.371466 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-3cf0b07b-95db-4e73-add4-1201895ffbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:45.381178 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1425/2896] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:45.385643 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d5a8e-d29b-457b-ae84-b973373125ae None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:45.395949 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d5a8e-d29b-457b-ae84-b973373125ae None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:45.401387 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfad98-c7cc-43aa-af32-dfa5afeea705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:45.402018 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfad98-c7cc-43aa-af32-dfa5afeea705 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:45.402462 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfad98-c7cc-43aa-af32-dfa5afeea705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:45.402612 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfad98-c7cc-43aa-af32-dfa5afeea705 admin admin] PATH_INFO: `/v3/domains` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:45.403381 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfad98-c7cc-43aa-af32-dfa5afeea705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:45.403690 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfad98-c7cc-43aa-af32-dfa5afeea705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:45.405333 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfad98-c7cc-43aa-af32-dfa5afeea705 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:45.418347 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1472/2897] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 18:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:45.422900 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0b07b-95db-4e73-add4-1201895ffbf1 None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:45.433236 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0b07b-95db-4e73-add4-1201895ffbf1 None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:45.437922 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee42fdb-517b-4651-9541-d7ee661c8c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:45.438551 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee42fdb-517b-4651-9541-d7ee661c8c86 admin admin] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:45.438833 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee42fdb-517b-4651-9541-d7ee661c8c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:45.439108 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee42fdb-517b-4651-9541-d7ee661c8c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:45.439818 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee42fdb-517b-4651-9541-d7ee661c8c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:45.441733 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee42fdb-517b-4651-9541-d7ee661c8c86 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:45.550740 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1426/2898] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 18:55:45 2022] POST /identity/v3/projects => generated 369 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:55:45.554614 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfad98-c7cc-43aa-af32-dfa5afeea705 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:45.564811 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfad98-c7cc-43aa-af32-dfa5afeea705 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:45.630443 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8edb83-888a-47d9-bc3a-2776f3a7aaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:45.631072 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8edb83-888a-47d9-bc3a-2776f3a7aaa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:45.631418 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8edb83-888a-47d9-bc3a-2776f3a7aaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:45.631692 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8edb83-888a-47d9-bc3a-2776f3a7aaa3 admin admin] PATH_INFO: `/v3/users` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:45.632375 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8edb83-888a-47d9-bc3a-2776f3a7aaa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:45.634308 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8edb83-888a-47d9-bc3a-2776f3a7aaa3 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:45.718672 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1473/2899] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 18:55:45 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:55:45.722725 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee42fdb-517b-4651-9541-d7ee661c8c86 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:45.733929 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee42fdb-517b-4651-9541-d7ee661c8c86 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:45.738663 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3eb204-1710-409a-9070-939a8f88e9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:45.739301 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eb204-1710-409a-9070-939a8f88e9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:45.740090 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eb204-1710-409a-9070-939a8f88e9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:45.740090 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eb204-1710-409a-9070-939a8f88e9e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:45.740600 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3eb204-1710-409a-9070-939a8f88e9e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:45.742214 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3eb204-1710-409a-9070-939a8f88e9e8 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:45.752745 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1427/2900] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:55:45.756823 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8edb83-888a-47d9-bc3a-2776f3a7aaa3 admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:45.767178 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8edb83-888a-47d9-bc3a-2776f3a7aaa3 admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:45.771836 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e75e2-0d62-4681-b789-137451e8cd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:45.772943 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e75e2-0d62-4681-b789-137451e8cd08 admin admin] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:45.773280 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e75e2-0d62-4681-b789-137451e8cd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:45.773554 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e75e2-0d62-4681-b789-137451e8cd08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:45.774248 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e75e2-0d62-4681-b789-137451e8cd08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:45.775874 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e75e2-0d62-4681-b789-137451e8cd08 admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:45.786556 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1474/2901] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 18:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:55:45.791677 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3eb204-1710-409a-9070-939a8f88e9e8 admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:45.801950 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3eb204-1710-409a-9070-939a8f88e9e8 admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:45.806672 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd72ffe-fc8f-407b-91ae-8772fb6c696d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:45.807363 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd72ffe-fc8f-407b-91ae-8772fb6c696d admin admin] REQUEST_METHOD: `PUT` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:45.807651 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd72ffe-fc8f-407b-91ae-8772fb6c696d admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:45.807932 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd72ffe-fc8f-407b-91ae-8772fb6c696d admin admin] PATH_INFO: `/v3/projects/2eddb470e61c42c791acb1e50fa7bfa5/users/2a01375412eb4c6db9a2ab042fd352d2/roles/f105208a21c84d4fa134aa0aeb62f3bb` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:45.823536 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd72ffe-fc8f-407b-91ae-8772fb6c696d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eddb470e61c42c791acb1e50fa7bfa5, user_id=2a01375412eb4c6db9a2ab042fd352d2, role_id=f105208a21c84d4fa134aa0aeb62f3bb)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:45.826188 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd72ffe-fc8f-407b-91ae-8772fb6c696d admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:45.829291 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:45.950927 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1428/2902] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 18:55:45 2022] PUT /identity/v3/projects/2eddb470e61c42c791acb1e50fa7bfa5/users/2a01375412eb4c6db9a2ab042fd352d2/roles/f105208a21c84d4fa134aa0aeb62f3bb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:45.962700 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda79cf-8435-41eb-a196-0e2e751ec1ac None None] REQUEST_METHOD: `POST` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:45.963076 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda79cf-8435-41eb-a196-0e2e751ec1ac None None] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:45.963335 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda79cf-8435-41eb-a196-0e2e751ec1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:46.000331 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.auth.core [None req-ffda79cf-8435-41eb-a196-0e2e751ec1ac None None] MFA Rules not processed for user `2a01375412eb4c6db9a2ab042fd352d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:46.000331 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-ffda79cf-8435-41eb-a196-0e2e751ec1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:46.037334 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:46.063353 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1475/2903] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:55:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:55:46.075970 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd72ffe-fc8f-407b-91ae-8772fb6c696d admin admin] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:46.077663 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-8fd72ffe-fc8f-407b-91ae-8772fb6c696d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:46.137147 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd72ffe-fc8f-407b-91ae-8772fb6c696d admin admin] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:46.140756 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227e708-28ee-4aaa-8921-a33b151b2451 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49a34cd99ab47bb92af6ed2f82fefde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:46.141372 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227e708-28ee-4aaa-8921-a33b151b2451 service glance] REQUEST_METHOD: `GET` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:46.141653 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227e708-28ee-4aaa-8921-a33b151b2451 service glance] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:46.141930 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227e708-28ee-4aaa-8921-a33b151b2451 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:46.150836 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227e708-28ee-4aaa-8921-a33b151b2451 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:46.152294 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227e708-28ee-4aaa-8921-a33b151b2451 service glance] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:46.161014 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1429/2904] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:55:46 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:55:56.086853 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=10 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:56.157060 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=28 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:56:09.324635 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda79cf-8435-41eb-a196-0e2e751ec1ac None None] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:56:09.385997 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda79cf-8435-41eb-a196-0e2e751ec1ac None None] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:56:09.390651 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c7807-c471-4ee5-9ff1-0fce955abcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:56:09.391331 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c7807-c471-4ee5-9ff1-0fce955abcda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:56:09.391615 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c7807-c471-4ee5-9ff1-0fce955abcda admin admin] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:56:09.391893 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c7807-c471-4ee5-9ff1-0fce955abcda admin admin] PATH_INFO: `/v3/users/2a01375412eb4c6db9a2ab042fd352d2` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:56:09.393067 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c7807-c471-4ee5-9ff1-0fce955abcda admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a01375412eb4c6db9a2ab042fd352d2)` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:56:09.395003 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c7807-c471-4ee5-9ff1-0fce955abcda admin admin] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:56:09.577397 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-cb7c7807-c471-4ee5-9ff1-0fce955abcda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a01375412eb4c6db9a2ab042fd352d2'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:56:09.577965 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-cb7c7807-c471-4ee5-9ff1-0fce955abcda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a01375412eb4c6db9a2ab042fd352d2'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:56:09.657169 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-cb7c7807-c471-4ee5-9ff1-0fce955abcda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a01375412eb4c6db9a2ab042fd352d2'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:56:09.669759 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-cb7c7807-c471-4ee5-9ff1-0fce955abcda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a01375412eb4c6db9a2ab042fd352d2'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:56:09.676674 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.notifications [None req-cb7c7807-c471-4ee5-9ff1-0fce955abcda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a01375412eb4c6db9a2ab042fd352d2'} {{(pid=80429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:56:09.682631 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1476/2905] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 18:56:09 2022] DELETE /identity/v3/users/2a01375412eb4c6db9a2ab042fd352d2 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:56:09.687379 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e8eeb-9328-499a-b00f-409572430bdf None None] REQUEST_METHOD: `POST` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:56:09.687882 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e8eeb-9328-499a-b00f-409572430bdf None None] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:56:09.688000 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e8eeb-9328-499a-b00f-409572430bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:56:09.708048 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.auth.core [None req-5d6e8eeb-9328-499a-b00f-409572430bdf None None] MFA Rules not processed for user `0dc5c37ef1d94f0cacb3f037f735dea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:56:09.709293 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5d6e8eeb-9328-499a-b00f-409572430bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:56:09.767810 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1430/2906] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 18:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:56:09.777762 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c7807-c471-4ee5-9ff1-0fce955abcda admin admin] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:56:09.779859 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-cb7c7807-c471-4ee5-9ff1-0fce955abcda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:56:09.837777 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c7807-c471-4ee5-9ff1-0fce955abcda admin admin] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:56:09.841987 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac1a9e-4ac5-4d2c-93fc-2d2f4e6a1181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee4a13d4fd4f86bd1c79b4535a0c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:56:09.842601 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac1a9e-4ac5-4d2c-93fc-2d2f4e6a1181 service neutron] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:56:09.842888 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac1a9e-4ac5-4d2c-93fc-2d2f4e6a1181 service neutron] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:56:09.843163 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac1a9e-4ac5-4d2c-93fc-2d2f4e6a1181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:56:09.852463 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac1a9e-4ac5-4d2c-93fc-2d2f4e6a1181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:56:09.853899 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac1a9e-4ac5-4d2c-93fc-2d2f4e6a1181 service neutron] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:56:09.864590 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1477/2907] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:56:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:56:10.298750 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e8eeb-9328-499a-b00f-409572430bdf None None] Authenticating user token {{(pid=80428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:56:10.300294 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.fernet_utils [None req-5d6e8eeb-9328-499a-b00f-409572430bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:56:10.313162 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e8eeb-9328-499a-b00f-409572430bdf None None] Validating token access rules against request {{(pid=80428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:56:10.317862 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09e2fa-dfcc-4bc9-b413-6cbcddca5102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc5c37ef1d94f0cacb3f037f735dea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '940bf108a6364eafb1a69efe7e124464', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:56:10.318558 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09e2fa-dfcc-4bc9-b413-6cbcddca5102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:56:10.318978 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09e2fa-dfcc-4bc9-b413-6cbcddca5102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:56:10.319281 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09e2fa-dfcc-4bc9-b413-6cbcddca5102 admin admin] PATH_INFO: `/v3/projects/2eddb470e61c42c791acb1e50fa7bfa5` {{(pid=80428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:56:10.320923 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09e2fa-dfcc-4bc9-b413-6cbcddca5102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eddb470e61c42c791acb1e50fa7bfa5)` {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:56:10.322860 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09e2fa-dfcc-4bc9-b413-6cbcddca5102 admin admin] RBAC: Authorization granted {{(pid=80428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:56:10.440568 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ee09e2fa-dfcc-4bc9-b413-6cbcddca5102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eddb470e61c42c791acb1e50fa7bfa5', 'request_id': 'req-ee09e2fa-dfcc-4bc9-b413-6cbcddca5102'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:56:10.446268 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ee09e2fa-dfcc-4bc9-b413-6cbcddca5102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eddb470e61c42c791acb1e50fa7bfa5', 'request_id': 'req-ee09e2fa-dfcc-4bc9-b413-6cbcddca5102'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:56:10.514786 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ee09e2fa-dfcc-4bc9-b413-6cbcddca5102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eddb470e61c42c791acb1e50fa7bfa5', 'request_id': 'req-ee09e2fa-dfcc-4bc9-b413-6cbcddca5102'} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:56:10.526571 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ee09e2fa-dfcc-4bc9-b413-6cbcddca5102 admin admin] The token cache is being invalidate because project 2eddb470e61c42c791acb1e50fa7bfa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:56:10.526863 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ee09e2fa-dfcc-4bc9-b413-6cbcddca5102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:56:10.527526 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG keystone.notifications [None req-ee09e2fa-dfcc-4bc9-b413-6cbcddca5102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:56:10.529755 dv-cinder-799871-43-smb devstack@keystone.service[80428]: [pid: 80428|app: 0|req: 1431/2908] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 18:56:10 2022] DELETE /identity/v3/projects/2eddb470e61c42c791acb1e50fa7bfa5 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:56:19.859529 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:56:20.523409 dv-cinder-799871-43-smb devstack@keystone.service[80428]: DEBUG dbcounter [-] [80428] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:29.133331 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac1a9e-4ac5-4d2c-93fc-2d2f4e6a1181 service neutron] Authenticating user token {{(pid=80429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:29.134798 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-b4ac1a9e-4ac5-4d2c-93fc-2d2f4e6a1181 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:29.203697 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac1a9e-4ac5-4d2c-93fc-2d2f4e6a1181 service neutron] Validating token access rules against request {{(pid=80429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:29.268580 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f420a8-b981-462f-a6ea-8d4d49def6b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa971da983ea48c3b6d4c68a5d454bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2880a34079d742c38bfdace2c04564c7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:29.269207 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f420a8-b981-462f-a6ea-8d4d49def6b0 service placement] REQUEST_METHOD: `GET` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:29.269493 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f420a8-b981-462f-a6ea-8d4d49def6b0 service placement] SCRIPT_NAME: `/identity` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:29.269771 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f420a8-b981-462f-a6ea-8d4d49def6b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:29.271602 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.fernet_utils [None req-c3f420a8-b981-462f-a6ea-8d4d49def6b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:29.283522 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f420a8-b981-462f-a6ea-8d4d49def6b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:29.285109 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f420a8-b981-462f-a6ea-8d4d49def6b0 service placement] RBAC: Authorization granted {{(pid=80429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:58:29.295646 dv-cinder-799871-43-smb devstack@keystone.service[80429]: [pid: 80429|app: 0|req: 1478/2909] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 18:58:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:58:39.290796 dv-cinder-799871-43-smb devstack@keystone.service[80429]: DEBUG dbcounter [-] [80429] Writing DB stats keystone:SELECT=58 {{(pid=80429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}